User-agent: * Disallow: /cgi-bin/ Disallow: /images/ Disallow: /includes/ User-Agent: Googlebot-Image Disallow: / User-agent: ASPSeek Disallow: / User-agent: asterias Disallow: / User-agent: baiduspider Disallow: / User-agent: BravoBrian Disallow: / User-agent: dloader(NaverRobot) Disallow: / User-agent: Dumbot Disallow: / User-agent: EgotoBot Disallow: / User-agent: Gaisbot Disallow: / User-agent: Generic Disallow: / User-agent: grub-client Disallow: / User-agent: http://www.almaden.ibm.com/cs/crawler Disallow: / User-agent: ia_archiver Disallow: / User-agent: InfoNaviRobot Disallow: / User-agent: jyxobot Disallow: / User-agent: Larbin Disallow: / User-agent: MSIECrawler Disallow: / User-agent: NaverRobot Disallow: / User-agent: NexaBot Disallow: / User-agent: NPBot Disallow: / User-agent: obot Disallow: / User-agent: OWR_Crawler Disallow: / User-agent: PhpDig Disallow: / User-agent: psbot Disallow: / User-agent: puf Disallow: / User-agent: QuepasaCreep Disallow: / User-agent: rabaz Disallow: / User-agent: Reaper Disallow: / User-agent: RPT-HTTPClient Disallow: / User-agent: ScoutAbout Disallow: / User-agent: Scooter Disallow: / User-agent: semanticdiscovery Disallow: / User-agent: Steeler Disallow: / User-agent: Teleport Pro Disallow: / User-agent: TurnitinBot Disallow: / User-agent: TutorGig Disallow: / User-agent: vsecrawler Disallow: / User-agent: Wget Disallow: /