The Blogger Tips

You are browsing the archives of Robot.txt.

Robots.txt file is very important for search engine optimization. It is a file placed in your server to notify various of search engine’s spiders not to crawl or index certain sections of your site. All search engines now look for a robots.txt file as soon their spiders or bots arrive on your site. There are [...]