Archive for September, 2008
File and Directory Structure
Most search engines don’t recognize anything beyond two directory levels. They will index 40 to 50 files in those directories and do it alphabetically. It is crucial for you to place your most important pages at the first or second directory level, breaking it up into 50 files per directory. Be sure to name your files and directories with your keywords. Don’t underscore to separate keywords. Instead, use hyphens. Don’t stuff too many keywords in your file or directory names. Make them keyword rich but not too long. Name image files after keywords, which is particularly important now that many search engines have image searches. Name your PDF files after your keywords as well.
Entry pages
Pages that bring you traffic are entry pages, and each should be optimized and submitted to directories and search engines. Make the pages stand-alone, like your home page. When a visitor lands on one of your entry pages, the visitor needs to know where they are, who your organization is, and what the page is about. Include full navigation on all entry pages and make it obvious what the page and site is about. Don’t assume visitors will find the index page first.
Robots.txt file
Search engine robots will check a special plain text file in the root of each server called robots.txt before indexing a site. Robots.txt implements the Robots Exclusion Protocol, which allows the website administrator to define what parts of the site are off-limits to specific robot user agent names. Web administrators can disallow access to the Common Gateway Interface (CGI), private and temporary directories, for example, because they do not want pages in those areas indexed . Learn more about search engine indexing and robots.txt files.
How is PageRank beneficial and how it is determined?
For a webmaster, a high PR is a sign of accomplishment. It shows that your website is moving in the right direction and has the potential to become successful. PageRank also directly effects your Google search engine listings. Acquiring a higher PR than your competition could mean more traffic for you, and less traffic for your competitors.
Visitors to your website probably won’t care about the page’s rank. However, visitors who understand PageRank may use your PR as a sign of how credible your content is. Would you rather use the information from a website with 0 PR or a website with 5 PR and hundreds of other websites linking to it?
How is Page Rank determined?
Page Rank is basically determined by backlinks. A back link is when another page links to your page. For every page that links to you, that page is “voting” for you. The more votes you get, the better your Page Rank will be.
However, it gets more complicated than that because some votes weigh more heavily than others. The weight of the vote is determined by the PageRank of the page linking to you. This means that a couple links from pages with high PR could be more beneficial than hundreds of links from pages with low PR. But it gets even more complicated – each page can only transfer so much PageRank. The set amount of PR that the page can transfer must be split up between each “vote” that the page gives out. This means that a PR 7 page could actually give out as much weight per vote as a PR 3 page if it had too many outgoing links.
Site structural design that helps Search Engines to find you
Navigation
- Be consistent and consolidate information wherever possible. “Help”, “FAQ” and “Instructions” can be all put into one page or one category that makes it easy for users to find that type of information. Break information up inside the category if you need to. In addition, saying “Instructions for filling out such and such form,” uses the keywords of what the page is about, helping search engines find the page.
- Use breadcrumb trails. This type of navigation literally creates a trail that users can follow back to where they came from. For example: Home > Category 1> Bucket A > Bucket B > Bucket C. Breadcrumbs are used in conjunction with regular navigation. They don’t replace it. They are nearly always text links, in a smaller font. Large sites should have top-of-the-page navigation pointing to the top-level pages and category navigation on the left with breadcrumb navigation on the page itself. Footer navigation should be placed at the bottom of the page.
- The footer of web pages is also important. It is important to give your users a quick way to the home page or key pages. The footer is a good place to put text-only links that are redundant to the top-level navigation, so your user doesn’t have to scroll back up to the top of the page. Supplying this added convenience also allows another chance for you to use those important keywords, and helps users who have their graphics turned off.
- Use keyword phrases within your main content links. These links may go to the exact same place as top-level navigation links but they’re labeled with keywords related to the same topic. For example, a top-level navigation link may be labeled “Local Weather Forecasts,” while a text link lower down on the page from inside a paragraph (pointing to the same page) might say “Weather for your Zip Code.” Since users and search engines use both terms heavily, you are covering your bases by taking this extra measure.
- Always use a sitemap. Search engines love to have a site map through which they can quickly and easily access your site’s pages for indexing. When creating a site map for your websites, be sure to put it at the root level (not within any subfolders or directories), link to it from your home page, and name it site_map.html (or .htm, whichever extension you are using for your site). A table of contents is also helpful in some cases.
- Simply create a list of links (similar to an outline format) that shows how the pages of your site are linked to from each upper tier page, and name these links using keyword-rich, but relevant, text links. Add a small paragraph about your organization, or about the subject matter of the page, at the top of the page. Keep the site map page simple, using no graphics (or very few if necessary, perhaps your organization’s logo). Be sure to link to your site map or table of contents near the top of the homepage as it will be picked up by crawlers. And when submitting your site’s pages to the major engines, be sure to submit the site map page as well as your home page.
Choosing a Search Engine
Providing a search function is one of the most valuable tools you can provide for visitors to your website and many good options are available to you.
Inexpensive Search Engine Solutions
Search engine solution prices have dropped dramatically, making it affordable for even the smallest organization to add a search function to their website. Below are several easy-to-implement and inexpensive search engine solutions. This list is by no means comprehensive and does not imply an endorsement of these products or services.
Inexpensive solutions include:
- A link to a search engine that indexes your content
- A search box from a search engine that indexes your content.
- Small business or enterprise solutions from major search engines, which can be as inexpensive as $2,000.
Hosted Search Solutions
Hosted search services live on a server located and are managed by a search hosting company. The host’s crawler indexes the pages on your website and stores the index in a database on the remote server. When a user searches your website, the request is directed to the remote server, returning the results to the user.




