usage-counts/src/robots.prod.txt

5 lines
84 B
Plaintext

User-Agent: *
Crawl-delay: 30
sitemap: https://usagecounts.openaire.eu/sitemap.xml