# robots.txt 2009-10-05 User-agent: * Disallow: / Crawl-delay: 3