User-agent: * #direct all spiders Disallow: /cgi-bin Disallow: /images Disallow: /admin Disallow: /phpMyAdmin Disallow: /stats Disallow: /adodb Disallow: /includes User-agent: Roverbot Disallow: / User-agent: Teleport Pro/1.2 Disallow: / User-agent: WebCopie Disallow: /