This meta tag does that,
<head><meta name=”robots” content=”noindex, nofollow”> inside your HTML, before </head>
No more search engines visiting your pages worry. Using this tag you are clearly telling the search engines or any other bot that These searches are not indexed and publicly viewable.
http://www.google.com/search?hl=en&q=%22robots.txt%22+%22disallow%3A%22+filetype%3Atxt&aq=f&oq=&aqi=g6
whitehouse.gov/robots.txt
google.com/robots.txt
microsoft.com/robots.txt
facebook.com/robots.txt
bbc.co.uk/robots.txt
Robot.txt file is used to tell Search engines STOP PEAKING IN THESE AREAS. If you want to make a Robot.txt file for many of your pages do that.
Here on HongKiat an article:
http://www.hongkiat.com/blog/chat-logs-searchable-in-google-are-yours-exposed-too/
From this article and knew way before a quick tip to disallow indexing of your pages you don't want to show is to use a meta in the header.
July - William Bolton - BATSH*T (Lyrics)
2 years ago
No comments:
Post a Comment