User-agent: * Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /~joe/ Disallow: /codecwebsite/ Disallow: /demo/ Disallow: /codec/ Disallow: /demo2/ Disallow: /new-demo/ Disallow: /emailer/ Disallow: /codec-ntws/ Disallow: /democodec/ Disallow: /democodec1/ ErrorDocument 404 /404.php RewriteEngine On RewriteRule ^/robots\.txt$ /robots.real [L] RewriteRule ^/[^/]*\.txt$ /404.php [L]