Maximum page limits Search Engine crawlers can crawl

One of the most asked question in forums and in message boards what is the maximum depth a search engine can crawl for a page. What is the maximum size Of html /pdf that can indexed by top search engines.

1. For google: As per our latest research Google has a maximum crawl and cache depth of 1 MB only ( excluding images / graphics ) . It Used to be 100 kb then they increased to 250 kb then to 500kb and the latest update is 1 MB per file.

2. Yahoo overtakes Google by a long way, Their indexing and caching limit is 5 MB, check the screen shots below,

3. MSN Search engine: Its very unpredictable for MSN but from our experiment MSN can cache upto 3 MB, we never tested about that probably someone in their search quality team can answer that.

I dont think we worry about any more search engines. I am sure at some point this data is useful for anyone out there. I know we do have some PDFs and large doc to be indexed. Its very important we know the cache limit for that,

SEO Blog Team,

Misspellings and SEO – Is it Good for Search Engines.

Some people have questions whether misspellings of words you target of your company name or any products or services you sell really helps. I would say misspellings are a natural part of the web, but there is a limit for it.

Misspelling SEO has been part of strategy for many Search Engine Spammers for a very long time. Because of this search engines see misspelling on pages especially done on a high level as a major Search engine spam. If you want to misspell your company name for 4 or 5 words then you are perfectly fine with it. But if you are looking to spam then you are not going to win against search engines.

Don’t misspell your competitor names on your pages there were spammers who used to do it and you might be sued by big corporations if you are misspelling their names.

Google says

“Keyword stuffing

“Keyword stuffing” refers to the practice of loading a webpage with keywords in an attempt to manipulate a site’s ranking in Google’s search results. Filling pages with keywords results in a negative user experience, and can harm your site’s ranking. Focus on creating useful, information-rich content that uses keywords appropriately and in context.

To fix this problem, review your site for misused keywords. Typically, these will be lists or paragraphs of keywords, often randomly repeated. Check carefully, because keywords can often be in the form of hidden text, or they can be hidden in title tags or alt attributes.

“

Mathew Marlon – alias matt marlon where is he now

Matt Marlon was the CEO was the infamous SEO company which made news when Google penalized their site and their client sites for using deceptive tactics. After the fall of Traffic power Matt has tried running his business in various other names like First Place , Tech Power, Tech traffic, Search engine power etc. It seems now his latest company name is toprankweb.com , according to his former employee’s website www.mattmarlon.info . He seems to be running most of his business from Egypt and very less work in Las Vegas Nevada his home town. It seems his Newest “Brand” is now toprankweb.com supposedly in Salem, Oregon, but really in Las Vegas, NV

i thought he is in Las Vegas but Matt cutts reported here that Matt Marlon is in Jail for Home foreclosure fraud. Matt wrote beautifully that if people are doing one type of scam most probably they are fully into major scamming in all businesses. This became true in case of Matt marlon. So where is he now is he still in Jail?

text link brokers dont send Pagerank or anchor text links any more.

Its very good to see that after Google’s action against a lot of sites selling text link advertisements which passes pagerank and was destroying Google’s search results by manipulating with heavy anchor text now there are no sites which advertise selling pagerank anymore. Google is very tough on these sites.

Especially sites like text link ads and text link brokers were advertising pagerank links all over their site now its not the case anymore with them. If you see there sites

this is what they advertise

text link ads

“Why Buy Text Link Ads?
1.
Text Link Ads are served as static links that can help your natural (organic) search engine rankings.
2. We have an exhaustive inventory of quality niches that can send targeted traffic to your website.
3. Flat price per ad for a 30 day ad run. Never worry about cost per click or CPM rates.

As per text link brokers:

Our Standard link building products
Blog Reviews
Hosted Marketing Pages™
Social Media BookMarking
Advanced Article Marketing
Text Link Ad Inventory
SEO-Friendly Directory Submission
Custom Link Acquisition
Dedicated Link Builders
Link Baiting a.k.a. Viral Content Promotion
Permanent One-Way Links™

If can see none of them mention about pagerank in their advertising.

but their archives say otherwise

http://web.archive.org/web/20070814085014/http://www.textlinkbrokers.com/

I hope this trend continues where there is a delicate balance for all sites and not just link mongers who dominate the search results.

Page specific Google ban / penalty – Does it really exist?:

We have often heard of google imposing penalty for sites or infact ban them completely from the index. Some of the forums had been buzzing on whether Google has any sort of page specific penalty in my experience yes google does have a page specific penalty. Here is a simple check what are possible reasons that could cause a page specific Google penalty

1. Links to a bad neighbourhood from that page. Say you have a grea site and you run a grea forum in that, one day some spammer posts an adult spam post. If googlebot sees this and see that your site is linking to an other highly spammed site then mostly that page will be penalized and stopped from entering google’s index. This is particularly tough when you run a good site and only one page is all adult stuff. Googlebot is designed to understand potential reasons how adult content came into your forum and they will impose a penalty only for that URL. we have seen this in our very own site’s forum.

2. Too many spammy links to sites that google considers spammy will hurt that page.

3. Duplicate content across the web or within your site if you have a particular page that is replicated as multiple versions within your site then it will hurt the duplicate page copy and Google will impose penalty or ban on duplicate version of the page / pages and keep just one copy of the page. Ban can simply be for the duplicate pages.

4. Strong filters applied by google on specific pages can also boot a page from rankings or prevent it from ranking. Google has very strong ranking filters and this could stop a page from ranking or penalizing it for reasons that are in the filter.

5. Hidden links or hidden images /gifs or hidden content can also cause page ban please make sure you do a complete review of that.

SEO Blog Team,

Payperpost blogging no more for link juice and pagerank

Google in their december update make most of the pay per post blogs pagerank zero or a reduced pagerank to fight those sites from manipulating the search engines by writing posts and providing links so that it passes Pagerank and link juice to the site for which the content is posted and inturn manipulate google’s search results.

if you go to payperpost.com most of the blogs listed there are PR0, it seems google is aware of those blogs and imposed their powerful PR0 penalty on them. Google is looking into all possible areas of exploitation on their algorithm, So probably they will be killing almost all sites which sell excessive links from passing any link juice or pagerank,

Cross linking 1500 sites – Isn’t that seriously insane

When I was reading through some of the posts in webmaster central official blog, I came across this particular post by Matt cutts,

http://googlewebmastercentral.blogspot.com/2007/12/information-about-buying-and-selling.html#c9006371411647145471

“Michael Clark, cross-linking between your own sites can be perfectly fine, especially if the links are relevant and you have a small number of sites. At a site review panel, an audience member once claimed that he had been deindexed by two major search engines for only cross-linking. Tim Mayer from Yahoo asked how many sites he had. The audience member sheepishly replied that he had 1500 (!) sites. I definitely wouldn’t recommend heavy cross-linking if you’ve got that many sites. That’s a lot of sites no matter how you slice it.
“

Isn’t that insane crosslinking 1500 domains. We are afraid to cross link even 5 domains just to make sure google don’t think that we are spamming the Search engines but this guy has cross linked 1500 domains and complains that his sites got booted. Mattcutts has confirmed in the same post that cross linking to a small limit is perfectly fine especially if the sites are on topic and they don’t have duplicate contents.

Google’s April fool 2008 Joke project virgil

Google plays with people’s mind again with their new april fool joke named project virgil, If you can see from this URL http://www.google.com/virgle/index.html google has plan to send people to space. LOL that is a very cool joke . They claim to form a human colony in mars with the help of virgin airlines I am sure people dont fall for google’s april fool pranks anymore

Remember their previous prank like the Lunar job or the pigeon rank instead of pagerank

From their FAQ that was very well written statement,

How are you planning to reach Mars?

During the first couple of decades Virgle will use standard technology of the day – chemical rockets to ferry cargo and crews to Mars. As the bootstrap plan stands today, in order to reach Mars (once the tri-module is assembled in LEO) the Virgle 1’s cruise stage will start a burn for insertion into a lunar trajectory and then back toward Earth for final insertion into a modified Hohmann Transfer Orbit. This multi-day round trip will use a variant of the Oberth effect, the Krasnokutskaya periapsis maneuver, to increase the final Earth-to-Mars transfer velocity through a periapsis delta-v burn performed at the closest lunar and subsequent Earth approach, with the additional delta v gained on account of the potential energy from the mass of expended propellant. The total useful mass sent this way to Mars will be 569 metric tons, meaning (obviously) that it will take four launches to complete the assembly. The design does allow for easy reconfiguration for varying payload capacities and transfer duration times. This round trip is also a final test and verification of the cruise configuration, assuring mission support that all systems are running within their nominal values. The design also provides for several orbital abort modes, decreasing significantly the probability of any mission losing a payload, human or otherwise.

Google update April 2008- Update Dewey names by matt cutts of Google

Google’s web spam head Mr.Matt Cutts has asked for feedback on new changes being rolled out in Google. Google has done a major update to its index and it seems lots of sites are affected. I personally see none of our client sites affected in any of the ips mentioned . One DC to look out for is DC 64.233.167.104 , When I checked I dont see much difference does anyone figure out what’s happening.

Here is Matt’s post

“Hey all, I asked a few people to look into this and they weren’t seeing many large differences in rankings between these datacenters. The issue with discussing on this thread is that specific urls/queries aren’t allowed. If anyone wants to mention a search where they see large-scale differences, feel free to send feedback to Google in the usual way. I’m going to pick a random-but-pretty-unique keyword so that I can look up reports. Let’s use “dewey” as the word. So if you want to mention a search where you think the results are very different at one data center compared to other data centers, use the spam report form at ihttp://www.google.com/contact/spamreport.html\ and make sure to include the word “dewey” in the “Additional details” text area. Or feel free to point out differences in other ways: do a blog post, leave specifics on the Google webmaster help group, or whatever way you want to point out specific searches that look different to you.
The usual rules of thumb apply: you probably won’t get a personal reply, but I’ll try to get someone to check out reports that get sent in. There shouldn’t be much difference between data centers, so I’m curious to find out what queries people seem to be seeing different results on. “

Dewey what a weird name for an Update, I hope people never forgot the great updates like Google florida update, Austin update, Jagger and more.

Forum discussion and ramblings as always here webmasterworld.com/google/3615693-3-30.htm

Google webmaster central full audio transcript raw unedited version

Hello Everyone,
Atlast we are done with audio transcript from the Google webmaster central live chat audio which was recorded last friday when webmasters around the world had live chat session with Google. we have posted that here its about 11,000 plus words which is equal to 20 plus 500 words article. Google did a great job and we were able to record the full audio ( transcript here ) as well as the full Q and A session as well as full chat log. The audio came out to be of very poor quality since it was recorded with a Mobile phone and the mobile phone was placed near the laptop computer through which we were monitoring and listening the session. Laptop’s speakers messed up the audio but still we were able to get the transcript read which you can read it here. Please read the disclaimer and NOTE before proceeding on reading the transcript.

Feel free to link to the document, don’t copy it.

Search Engine Genie SEO Blog Team,