User-Agent: * Disallow: /cgi-bin/ Disallow: /links/badlink/ User-Agent: sitecheck.internetseer.com Disallow: /