User-agent: UCSD-Crawler Disallow: / User-agent: MwdSearch/0.1 Disallow: / User-agent: TeleportPro Disallow: / User-agent: DragonBot/1.0 libwww/5.0 Disallow: / User-agent: BackRub/*.* Disallow: / User-agent: gestaltIconoclast/1.0 libwww-FM/2.17 Disallow: / User-agent: dlw3robot/x.y (in TclX by http://hplyot.obspm.fr/~dl/) Disallow: / User-agent: spyder3.microsys.com Disallow: / User-agent: SG-Scout Disallow: / User-agent: Zeus 32297 Webster Pro V2.9 Win32 Disallow: / User-agent: Explorer Disallow: / User-agent: MOMspider/1.00 libwww-perl/0.40 Disallow: / User-agent: BizBot04 kirk.overleaf.com Disallow: / User-agent: EroCrawler Disallow: / User-agent: ia_archiver Disallow: / User-agent: webvac/1.0 Disallow: / User-agent: Freecrawl Disallow: / User-agent: Patric/0.01a Disallow: / User-agent: SafetyNet Robot 0.1, Disallow: / User-agent: combine/0.0 Disallow: / User-agent: MediaFox/x.y Disallow: / User-agent: WebBandit Disallow: / User-agent: Katipo/1.0 Disallow: / User-agent: ExtractorPro Disallow: / User-agent: Road Runner: ImageScape Robot (lim@cs.leidenuniv.nl) Disallow: /