User-agent: * Disallow: /cgi-bin/ Disallow: /awstats/ Disallow: /css/ Disallow: /video/ Disallow: /tsend.php