# 20041206 mirror@switch.ch # http://www.kollar.com/robots.html # http://www.searchengineworld.com/robots/robots_tutorial.htm # http://www.searchengineworld.com/cgi-bin/robotcheck.cgi # valid for all robots and individuals User-agent: * # mostly mirrored or copied Disallow: /LDP/ Disallow: /bcp/ Disallow: /debian-amd64/ Disallow: /debian-secure-testing/ Disallow: /eclipse/ Disallow: /ftp/mirror/ Disallow: /ftp/pub/ Disallow: /ftp/software/ Disallow: /ftp/ubuntu/ Disallow: /fyi/ Disallow: /mirror/ Disallow: /rfc/ Disallow: /std/ Disallow: /www/ # changing information Disallow: /stat/ #Disallow: /cgi-bin/ # only internal use Disallow: /cug/