What google uses to crawl websites – Is it something similar to chrome

Is Google using chrome to crawl websites?

An interesting thread in Webmasterworld.com :

webmasterworld.com/google/3760236.htm

Thought i would drop in to report a very interesting Google activity I’ve been observing today.
I have an “who’s online” script running and reporting visitors in real time as they browse the site. The script uses javascript to report referrer and currently viewed page.
One of the visitors today was from 66.249.72.180 [google.com] sucking approx 200 pages in a 15-20 minutes frame and invoking the on page tracking javascript….sending referring page and current URL information (it had to invoke javascript just like a browser would to do that). In other words acting very much like it is a full on browser.
Maybe it is already old news to some, maybe i missed previous topics discussing this. Anyway, it is the first time i see this thing in real time. Very interesting crawl development.
Anyone else noticed this ?
P.S. Page to page browsing was occuring at a very fast rate, could not be human.

No comments yet.

Leave a comment