SEO Forum
 		 SEO Problems SEO Knowledge Database Seo Forum Search engine optimization
  FAQ   Search   Memberlist   Usergroups   Register   Profile   Log in to check your private messages   Log in 
robot.txt it is important?

 
Post new topic   Reply to topic    Seo FORUM » Search Engine Optimization View previous topic :: View next topic  
robot.txt it is important?
 PostPosted: Sat Apr 21, 2007 5:37 am Reply with quote  
Message
  siva_aarya

Joined: 11 Apr 2007
Posts: 4
Location: Chennai

In all of my websites, there is no robots.txt. But tag <META NAME="ROBOTS" CONTENT="INDEX,FOLLOW"> and <META NAME="ROBOTS" CONTENT="all"> both are used. Is it enough or I need to add robots.txt. How important is this file. How search engine treats / uses it. If it is necessary to add Robots.txt what should be the code included in this file?

Google is visiting only home page of my website and goes back without following links on that page. Is this is because of robots.txt. If no what can be the reason. CONFUSED


Thank you

http://www.g-antssoft.com/
 PostPosted: Mon Oct 01, 2007 1:00 pm Reply with quote  
Message
  Gloria

Joined: 01 Oct 2007
Posts: 11

You can learn basic things about robots.txt from wikipedia

http://en.wikipedia.org/wiki/Robots.txt
Post new topic   Reply to topic    Searchenginegenie.com Forum Index » Search Engine Optimization

Page 1 of 1 		All times are GMT

Display posts from previous:

  

Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Search Engine Optimization SEO Company