File and Directory Structure
2. Entry pages. Pages that bring you traffic are entry pages, and each should be optimized and submitted to directories and search engines. Make the pages stand-alone, like your home page. When a visitor lands on one of your entry pages, the visitor needs to know where they are, who your organization is, and what the page is about. Include full navigation on all entry pages and make it obvious what the page and site is about. Don’t assume visitors will find the index page first.
3. Robots.txt file. Search engine robots will check a special plain text file in the root of each server called robots.txt before indexing a site. Robots.txt implements the Robots Exclusion Protocol, which allows the website administrator to define what parts of the site are off-limits to specific robot user agent names. Web administrators can disallow access to the Common Gateway Interface (CGI), private and temporary directories, for example, because they do not want pages in those areas indexed . Learn more about search engine indexing and robots.txt files.
No comments yet.
Leave a comment
Blogroll
Categories
Recent Posts
Recent Comments
Archives
- December 2023
- November 2023
- October 2023
- September 2023
- August 2023
- June 2023
- May 2023
- April 2023
- March 2023
- February 2023
- October 2020
- January 2020
- January 2017
- January 2016
- July 2014
- June 2014
- May 2014
- April 2014
- December 2012
- October 2012
- July 2012
- May 2012
- April 2012
- March 2012
- February 2012
- January 2012
- December 2011
- November 2011
- October 2011
- September 2011
- August 2011
- May 2011
- April 2011
- July 2010
- December 2009
- March 2009
- February 2009
- January 2009
- December 2008
- November 2008
- October 2008
- September 2008
- August 2008
- July 2008
- June 2008
- May 2008
- April 2008
- March 2008




