# All robots will spider the domain User-agent: * Disallow: /downloads/ Disallow: /private/ Disallow: /secret/ Disallow: /cgi-bin/ Disallow: /chat/ Disallow: /closed/ Disallow: /forum/ Disallow: /stats/ Disallow: /scholarship/ Disallow: /Templates/