Potential reasons for Sites Crawled But Not Indexed – search engine optimization tip – march 15th 2005

For a more detailed list of search engine crawlers contact us and we will send it to you for free,

Many of us have noticed sometimes search engines keep visiting the site regularly but dont index the site nor show it in the site: command,

There are various reasons for this to happen,

1. The domain is an expired domain, if the domain expires and not registered for a certain period of time google imposes a expired domain penalty on that domain, That domain is left to suffer for certain number of months, in that period googlebot keeps visiting the site but they don’t index it and they don’t show the site in site: command too,

2. An other reason is the domain is a new domain and if the domain is a new domain sometimes the crawler regularly visits the site and it doesn’t show up in the index for a long time, There is nothing wrong with this, probably google index is taking longer time to expand, you just have to wait till google updates its index,

3. An other possible reason is the site is banned from the search engines for any particular onpage factor, In that case search engines periodically checks to see whether the onpage spam tactics is removed and as soon as they see the spam being removed they might reinclude the site into the index, So for people who are complaining that their site was previously indexed and listed in google but suddenly it disappeared from the index and googlebot keeps visiting the site it is good to look at your onpage work and see if there is any spam tactics like hidden text, cloaking, keyword stuffing etc,

4. An other important reason could be that the site was permanently banned from the search engines, Even here search engine crawlers visit the site following existing links to the site but they don’t index the site because the site is banned, This is common with Yahoo slurp yahoo’s robot, yahoo slurp is known to visit the site and don’t index the site if the site is banned,

List of top search engine user-agents – search engine optimization tip march 14th 2005

List of top search engine user-agents

We get lot of mails from people who want to know the names of the leading user-agents, We will be pleased to give the information, Identifying the useragents is a very important criteria in search engine optimization, A regular visit by search engine robots like Googlebot, yahoo slurp etc is a good sign,

Here is the list of top search engines crawlers,

Googlebot/2.*ooglebot@googlebot.com)
Yahoo – Yahoo Slurp
Msn – Msnbot
Lycos – Lycos_Spider_(T-Rex)/3.
Teoma- Mozilla/2.0 (compatible; Ask Jeeves/Teoma)

For a more detailed list of search engine crawlers contact us and we will send it to you for free,

Google’s new feature gives answer to your questions, –

Google blog says,

Just the facts, fast
Have you ever needed a piece of info right now? Today we’re excited to introduce Google Q&A. We’ve pulled together facts from all over the Web to help give you the fastest possible access to the quick bits of information you need every day; just type a query into the search box, and you’ll get back the answer at the top of your search results. Q&A knows about a lot of areas: celebrities, countries of the world, the planets, the elements, electronics, movies, and anything else we’ve thought of so far (including enabling you to get answers on your mobile device). Try it out, and keep checking back. This is only the beginning.

Google Q and A gives great accurate answers, try some queries like Capital India

who discovered car

Google Adds Satellite Imagery to maps.google.com

Google now adds a cool feature the satellite image with their google maps,

Please check it out here, http://maps.google.com

Google acquires urchin web analytics software – Google Agrees To Acquire Urchin

press release on Urchin site,

Google Agrees To Acquire Urchin
MOUNTAIN VIEW, Calif. – March 28, 2005 – Google Inc. today announced it has agreed to acquire Urchin Software Corporation, a San Diego, California based web analytics company.
Financial terms of the deal were not disclosed.
Urchin is a web site analytics solution used by web site owners and marketers to better understand their users’ experiences, optimize content and track marketing performance. Urchin tools are available as a hosted service, a software product and through large web hosting providers. These products are used by thousands of popular sites on the Internet.
Google plans to make these tools available to web site owners and marketers to better enable them to increase their advertising return on investment and make their web sites more effective.
“We want to provide web site owners and marketers with the information they need to optimize their users’ experience and generate a higher return-on-investment from their advertising spending,” said Jonathan Rosenberg, vice president of product management, Google. “This technology will be a valuable addition to Google’s suite of advertising and publishing products.”
The acquisition is subject to customary closing conditions. Google anticipates that the acquisition will close before the end of April.

http://www.urchin.com/company/news/03282005.html

Does search engines crawl Javascript links ? – search engine optimization tip – march 13th 2005

Scripts are complex codings which difficult for some browsers and crawlers to read, Some tough javascripts are read only by advanced browsers, search engine crawlers are not advanced browsers some of the browsers that search engines use find difficult to index high graphics, So it is best to avoid too much javascript,

Prevent creating menus in javascript or in any scripting language, Create menus in simple html or other crawler understandable language, Javascript menus wont be crawled by search engines, Best is to avoid using clickable menus and other important inner page links in javascript,

if you cannot avoid using javascript menus just add the links to a sitemap and attach the sitemap to the homepage or any other important page,

SEO BLog Team,

Does outgoing links affect your site – seo tip march 12th 2005

Outbound links are links going out from a site to an other site, Whole internet/WWW was built upon links, Inbound links and Outbound links make up the web, Outbound links are good to maintain the quality of a site, search engines like links, they like outbound links too, If you link out to a collection of quality sites then definitely there is a small boost to that page,

Jon M. Kleinberg proposed that hubs are a collection of quality links, More information on hubs and authorities in this paper, http://www.cs.cornell.edu/home/kleinber/auth.pdf

Outbound links are good for usability too, For certain references it is important to give the source so that people are guided in the correct way, Especially non commercial sites need to link out freely for people to find relevant information if they are found elsewhere on the web,

SEO Blog Team,

Does H1 header tags help in search engines? – search engine optimization tip – march 11th 2005

Header tags used to carry weight in search engine algorithms, Today header tags carry very low weightage in search algorithms, Infact you can build sites without it, It is never needed infact, Quality contents and high quality backlinks are more important than header tags,

It never hurts to use header tags, It doesnt help too much too,

SEO BLog Team,

Do tracking parameters dilute ranking of page? – search engine optimization tip march 10th 2005

tracking parameters dilute ranking of page?

many will be having question whether tracking URLs like the one below will dilute pagerank/link popularity/ranking,

www.myURL.com/page.htm?trackingid=theirURL

Nope they dont dilute much, if you think they are diluting the link better option is to 301 redirect them to the main URL, that way all link popularity is passed to the main URL and no duplicate pages are formed,

Do search engines index flash?? – search engine optimization tip march 9th 2005

Flash is not good for search engines, Most of the search engines have difficulty in parsing code from the complex DHTML coding of flash, Google has been recently reported on following links from flash .SWF files, We have seen google read text within a flash file and follow links from a flash file,

But yahoo don’t read flash they are not sophisticated to do so, Similarly MSN, gigablast and lot of other search engines don’t follow flash, Best bet is to avoid flash sites if you are planning to do search engine optimization,

Flash has always been a hindrance for search engines better avoid designing full sites with flash,

SEO BLOG TEAM,