# Spiders, crawlers, robots - you're welcome!
User-agent: *
Disallow:
Crawl-delay: 5
Request-rate: 1/5         # maximum rate is one page every 5 seconds