13 lines
281 B
Plaintext
13 lines
281 B
Plaintext
User-Agent: *
|
|
Disallow: /upload
|
|
Disallow: /participate/direct-claim
|
|
Disallow: /participate/direct-claim?*
|
|
Disallow: /participate/claim
|
|
Disallow: /myclaims
|
|
Disallow: /myclaims?*
|
|
Disallow: /claims
|
|
Disallow: /claims?*
|
|
Crawl-delay: 30
|
|
Sitemap: https://explore.openaire.eu/sitemap.xml
|
|
|