Robots.txt

[Will C]

I dont want any of the pages to be blocked from the Search Engines. Do i need to place a blank robots.txt file

please advise

thanks

[razitun]

SE can't block any of your page until you put some scamming contents on your page... so, why do you want to put rebot.txt file on your server?

[siteadmin]

Blank text file saved as robots.txt is recommended since every search engine first searches for your robots.txt before crawling your site.

Also from time to time your robots.txt file will be fetched by crawlers to prevent search engines from hitting 404s on your site we recommend adding a blank robots file to your root folder

[lupinesteve]

The robots.txt file is useful in keeping your spiders from accessing parts folders and files in your hosting directory that are absolutely different to your absolute web website content. Also, This gives you a little more control over the robots.

[susan_jane]

Robots.txt is a file through which you can guide search engines to crawl or not to crawl certain sections of your website.Google specifically follows instructions given in this robots.txt file.

[heenakapoor]

Google doesn't read blank pages. So You can inform to Google by use the code of allow all URLs for crawling in robots.txt file. It helps to crawl all pages of your website in Google.