usage-counts/src/prod/robots.txt

5 lines
84 B
Plaintext

User-Agent: *
Crawl-delay: 30
sitemap: https://usagecounts.openaire.eu/sitemap.xml