SEO Advanced Topics

ID #1125

what are search engines page cache limit?

All search engines have a cache limit for pages they crawler, The html of a page is considered as the size of the page the search engine crawler,

For yahoo bot ( yahoo slurp ) cache limit is 500 KiloBytes, Maximum size of a page yahoo robot crawls is 500 KB,

For Google robot ( Googlebot ) cache limit is Unknown, Before couple of months the cache limit was only 101 kb, Pages above that size was partially indexed, Anything above the 101 kb limit was ignored, Now it has changed and googlebot is known to index files of size more than 400 kb, So it is unknown exactly what the new cache limit is for googlebot.


Visit www.searchenginegenie.com for SEO introduction, free tips and tools. Want your website to be search engine optimized? Click here to Contact us or send your queries to support@searchenginegenie.com


Digg it! Print this record Send to a friend Show this as PDF file
Propose a translation for Propose a translation for
Please rate this entry:

Average rating: 0 out of 5 (0 Votes )

completely useless 1 2 3 4 5 most valuable

You can comment on this entry