# robots.txt User-agent: * Disallow: /app_code/ Disallow: /app_support/ Disallow: /aspnet_client/ Disallow: /bin/ Disallow: /*.axd$ User-Agent: Slurp Disallow: / User-Agent: Yahoo! Slurp Disallow: / User-Agent: yahoo-mmcrawler Disallow: /