SEO Forum
 		 SEO Problems SEO Knowledge Database Seo Forum Search engine optimization
  FAQ   Search   Memberlist   Usergroups   Register   Profile   Log in to check your private messages   Log in 
Robots.txt

 
Post new topic   Reply to topic    Seo FORUM » Search Engine Optimization View previous topic :: View next topic  
Robots.txt
 PostPosted: Tue Nov 21, 2006 9:35 am Reply with quote  
Message
  Will C

Joined: 21 Nov 2006
Posts: 3

I dont want any of the pages to be blocked from the Search Engines. Do i need to place a blank robots.txt file

please advise

thanks
Hi
 PostPosted: Fri Feb 02, 2007 9:03 pm Reply with quote  
Message
  razitun

Joined: 02 Feb 2007
Posts: 8

SE can't block any of your page until you put some scamming contents on your page... so, why do you want to put rebot.txt file on your server?
 PostPosted: Mon Mar 26, 2007 8:12 pm Reply with quote  
Message
  siteadmin
Site Admin

Joined: 18 Dec 2005
Posts: 303

Blank text file saved as robots.txt is recommended since every search engine first searches for your robots.txt before crawling your site.

Also from time to time your robots.txt file will be fetched by crawlers to prevent search engines from hitting 404s on your site we recommend adding a blank robots file to your root folder
Post new topic   Reply to topic    Searchenginegenie.com Forum Index » Search Engine Optimization

Page 1 of 1 		All times are GMT

Display posts from previous:

  

Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Search Engine Optimization SEO Company