# /robots.txt file for http://www.magnabenefits.com/ # for use by all robots User-Agent: * User-agent: Googlebot User-agent: InfoNaviRobot User-agent: TV33_Mercator User-agent: AVSearch User-agent: Mercator User-agent: Scooter User-agent: Slurp User-agent: SearchengineLicenceSheep User-agent: shadow User-agent: MultiText User-agent: FAST-WebCrawler User-agent: Lycos_Spider User-agent: Atomz User-agent: htdig User-agent: spider00.logika.net User-agent: NetMechanic User-agent: libwww-perl User-agent: Teleport Pro User-agent: * Disallow: /test/robots/noindex/ Disallow: /test/robots/disal/ Disallow: /test/robots/partial Disallow: /background/ Disallow: /cgi-bin/ Disallow: /confirm/ Disallow: /banners/ Disallow: /feedback/ Disallow: /graphics/ Disallow: /legal/ Disallow: /noscript.html Disallow: /scripts/ Disallow: /styles/ Disallow: /tmp Disallow: /logs Disallow: /searchtools-rss.xml Disallow: /privacy/ Disallow: /copyright/