User-agent: Googlebot Disallow: /view/ Better yet, use X-Robots-Tag: noindex, nofollow in the HTTP response header for .shtml files. Run a grep scan across your webroot:
location /view ssi off;
Add a robots.txt (note: not foolproof against malicious crawlers but helps with Google’s bot): inurl view index shtml 14 patched