User-agent: * Disallow: /phpMyAdmin/ Disallow: /*.cgi$ Disallow: /webcalendar/ Disallow: /awstats/ User-agent: BaiDuSpider Disallow: / User-agent: EchO! Disallow: / User-agent: crawl Disallow: / User-agent: bot/ Disallow: / User-agent: bot- Disallow: / User-agent: robot Disallow: / User-agent: baiduspider Disallow: / User-agent: Baidu Disallow: / User-agent: echo Disallow: / User-agent: 'crawl' Disallow: / User-agent: Java Disallow: / User-agent: java Disallow: /