# disallow all bots from crawling site
User-agent: *
Disallow: /