How Google handles Scrapers – Nice information from Google team

Its been a long battle between Google, webmasters and content thieves who scrap information from a website and display it on their website to get traffic. Many Webmasters had been complaining for a long time about this problem. As far as i know Google is already doing a good job with content thieves and scraper sites. Now they have opened up with their inner workings on how they tackle this problem.

We tackle 2 types of dupe content problems one within a site and other with external sites. Dupe content within a site can easily be fixed. I am sure we have full control over it. We can find all potential areas which might create 2 pages of same content and prevent one version from crawling or remove any links to those pages which might be duplicates.

External sites are always a problem since we don’t have any control over it. Google says they are now effectively tracking down potential duplicates and give maximum credit to the Original source and filter out rest of the duplicates.

If you find a site which is ranking above you using your content Google says

1. Check if your content is still accessible to our crawlers. You might unintentionally have blocked access to parts of your content in your robots.txt file.
2. You can look in your Sitemap file to see if you made changes for the particular content which has been scraped.
3. Check if your site is in line with our webmaster guidelines.

For more information read this official Blog posting

Digg effect – Effect of ranking on digg homepage

Digg killed my friends server. Few day’s back one of my friend’s article featured of Digg homepage. Within few minutes his server can’t withstand the massive traffic and was down for 5 hours. Is Digg homepage ranking worth anyone else had that experience?

Please share it here

Chris.

Is Microsoft indirectly going for a Proxy fight?

BLB&G LLB group is taking on Yahoo on behalf of some share holders for not accepting Microsoft bid. this page has some very useful information that’s just revealed.

On February 21, 2008, BLB&G, on behalf of Plaintiffs, filed a Class Action Complaint against Yahoo and its board of directors (the “Board”), alleging that they have acted to thwart a non-coercive takeover bid by Microsoft, which would provide a 62% premium over Yahoo’s pre-offer share price, and have instead approved improper defensive measures and pursued third party deals that would be destructive to shareholder value. Yahoo’s “Just Say No to Microsoft” approach is a result of resentment by the Board, and not any good faith focus on maximizing shareholder value. Microsoft attempted to initiate merger discussions in late 2006 and early 2007, but was rebuffed, supposedly so Yahoo’s management could implement existing strategic plans. None of those initiatives improved Yahoo’s performance. On February 1, 2008, over a year after its initial approach, Microsoft returned, offering to acquire Yahoo for $31 per share, representing a 62% premium above the $19.18 closing price of its stock on January 31, 2008.

Looks like the proxy fight is about to move forward more aggressively. Lets wait and see

SearchMarketing Expo Conference – recap and write up

Barry of Search Engine Roundtable has a very good writeup of the recently concluded Search marketing expo conference organized by the Search engine industry expert Danny Sullivan. Barry also blogs for Search engine land Danny’s official blog. Please read Barry’s write-ups here

My favourite is the tip provided Roger on finding edu domains for links

“Tips in Yahoo Link Commands:
linkdomain:example.com site:.edu “bookmarks”
linkdomain:example.com site:.edu “links”
linkdomain:example.com site:.edu “favorite sites”
linkdomain:example.com site:.edu “your product or service”
More examples:
linkdomain:example.com site:.edu sponsors
linkdomain:example.com site:.edu donors
linkdomain:example.com site:.org sponsors
linkdomain:example.com site:.org benefactors”

Yahoo index update May 2008 – Yahoo search engine algorithm and ranking update

Yahoo has made some changes to its algorithm and ranking factors. Yahoo calls its index update a weather update and Yahoo Weather updates are posted in the their Official blog by some Search Engineer.

Priyank Garg & Sharad Verma both from Search had posted an update here

“We’ll be rolling out some changes to our crawling, indexing and ranking algorithms over the next few days, but expect the update will be completed soon. As you know, throughout this process you may see some ranking changes and page shuffling in the index. “

SEO comic strip – Incompetent webmaster whining about his rankings.

Can links from foreign sites hurt your Google US rankings?

I have seen more and more people getting worried about their US ranking affected just because they get links from sites hosted in foreign countries. I recommend there is nothing to worry because of this.

Google ofcourse geo-targeting buy they also have ways to relate links to sites regardless of where they come from. If your site is hosted in US and have enough US backlinks i wouldn’t worry about links from other sites.

Its very normal to get backlinks from other language sites especially if you run an information site. We get ton of backlinks from Japanese, swedish, german, spanish and lots and lots of other language sites still our rankings never moved. So i wouldn’t worry about it. Just keep improving your site and always lookout for natural backlinks it will be a hit.

Viacom’s threat might kill internet freedom – Youtube lawsuit

Viacom sued youtube and its owner Google for allowing copyrighted videos to be posted on their website. Viacom claims there are more than 150,000 of copyrighted videos posted in youtube and they claim a billion dollar as damages for illegal viewing of their copyrighted videos.

“Viacom claimed YouTube consistently allowed unauthorised copies of popular television programming and movies to be posted on its website and viewed tens of thousands of times.
It said it had identified more than 150,000 such abuses which included clips from shows such as South Park, SpongeBob SquarePants and MTV Unplugged.
The company says the infringement also included the documentary An Inconvenient Truth which had been viewed “an astounding 1.5 billion times”. “

Detailed news here

According to the document:

threatens the way hundreds of millions of people legitimately exchange information

I agree with above Google’s claim. The whole Internet is built upon sharing information with each other just because someone illegal posted a copyrighted video on a popular video hosting site it doesn’t mean video site is responsible for it. If this is the case then there wont be any Forums or blogs or message boards out there. Then every site that runs a message board will have to verify each and every comment posted since some of them might be copyrighted.

Dow Jones: “When we filed this lawsuit, we not only served our own interests, we served the interests of everyone who owns copyrights they want protected.”

Well i am not sure what is the interest of other copyright owners i feel Dow jones comments should be for Viacom only. Google’s policy has always been don’t be evil they grew up with that motto. Today they are way ahead of all other Search Engines because users are their No.1 priority. Even though Google’s Search engine indexes millions of copyrighted pages and stores in their database still no-one complains since they are done what is best for Internet users.

Video sharing websites are a great way to share legitimate information across Internet. Just because someone posted some copyrighted videos its not fair to blame Youtube totally.

Well, I can give a number of reasons why Viacom is completely wrong with their lawsuit.

1. If Youtube is suppose to verify all millions of videos posted in their site they cannot run a site at all. There are so many areas where legitimate information is shared like forums, blog comments, news sites etc. If every single information needs to be verified then there won’t be any good information sites on the web.

2. The word “copyright” itself will kill the way Internet works. Today anything and everything is copyrighted and its impossible to share legitimate information unless they are verified. I feel Copyright kills Internet freedom and there should be New laws for Internet information sharing which will help freedom of sharing.

3. After they faced lawsuit last year Google added automated copyright detection tool which stops some copyright videos from being uploaded. This is a very legitimate move and the best Youtube can do to prevent copyright videos. It also shows Google or Youtube don’t want copyrighted videos on their sites.

4. Youtube has a very clear copyright policy on videos hosted by them. If you read the following

Commercial Content Is Copyrighted

The most common reason we take down videos for copyright infringement is that
they are direct copies of copyrighted content and the owners of the copyrighted
content have alerted us that their content is being used without their
permission. Once we become aware of an unauthorized use, we will remove the
video promptly. That is the law.
Some examples of copyrighted content
are:
TV shows
Including sitcoms, sports broadcasts, news broadcasts,
comedy shows, cartoons, dramas, etc.
Includes network and cable TV,
pay-per-view and on-demand TV
Music videos, such as the ones you might find
on music video channels
Videos of live concerts, even if you captured the
video yourself
Even if you took the video yourself, the performer controls
the right to use his/her image in a video, the songwriter owns the rights to the
song being performed, and sometimes the venue prohibits filming without
permission, so this video is likely to infringe somebody Else’s rights.
Movies and movie trailers
Commercials
Slide shows that include
photos or images owned by somebody else
A Few Guiding Principles
It
doesn’t matter how long or short the clip is, or exactly how it got to YouTube.
If you taped it off cable, videotaped your TV screen, or downloaded it from some
other website, it is still copyrighted, and requires the copyright owner’s
permission to distribute.
It doesn’t matter whether or not you give credit
to the owner/author/songwriter—it is still copyrighted.
It doesn’t matter
that you are not selling the video for money—it is still copyrighted.
It
doesn’t matter whether or not the video contains a copyright notice—it is still
copyrighted.
It doesn’t matter whether other similar videos appear on our
site—it is still copyrighted.
It doesn’t matter if you created a video made
of short clips of copyrighted content—even though you edited it together, the
content is still copyrighted.

You can see they are very clear about copyright and even provide links for copyright complains.

5. As of March there are over 3 Billion videos hosted in Youtube. Viacom claim 150,000 copyrighted videos which is only a fraction of the overall videos posted in Youtube. How can you expect youtube to check through this rubble and find copyrighted videos when its actually the user who is suppose to care about this.

6. Most of the time quality of videos posted in Youtube are very bad and they are also very short videos. I feel its not a big deal for small videos of low quality posted in youtube for viewing will kill media Business like Viacom altogether.

7. Some people suggest effective verification system like asking for Credit Card details to post videos. Well i know so many people who are not willing to post their CC information for legitimate online buying how can you expect them to give their CC details just for uploading videos this is a bit too much and anything like this will stop legitimate users from enjoying the freedom of Internet.

Viacom should withdraw their lawsuit to avoid humiliation in court, i feel there wont be anything legitimate against Youtube or Google which will prove Viacom’s claim. If Viacom ever win this lawsuit which looks highly unlikely the way the whole Internet works will change and everyone will start suing each other which will be a disaster for Internet.

Lets all stand behind Youtube and Google and wish them success with their defence. Youtube should come out clear from this for the welfare of Internet.

Search Engine Genie

Google Advisor site diagnostics tool – Google’s free tool

Google now offers diagnostics report for a site for example

For our Site Searchenginegenie.com Google says the following
www.google.com/safebrowsing/diagnostic?site=http://searchenginegenie.com

Safe Browsing
Diagnostic page for searchenginegenie.com/
What is the current listing status for searchenginegenie.com/?
This site is not listed as suspicious.
What happened when Google visited this site?
Of the 2 pages we tested on the site over the past 90 days, 0 page(s) resulted in malicious software being downloaded and installed without user consent. The last time Google visited this site was on 05/10/2008, and suspicious content was never found on this site within the past 90 days.
Has this site acted as an intermediary resulting in further distribution of malware?
Over the past 90 days, searchenginegenie.com/ did not appear to function as an intermediary for the infection of any sites.
Has this site hosted malware?
No, this site has not hosted malicious software over the past 90 days.

Well though the report sounds great for our site i am not sure how much i can believe Google on this.
I did the same search for serials.ws a popular crack download site. This site has f**ked up my system couple of times just for downloading some useless cracks. I am not sure how Google gives the following certification.

Safe Browsing
Diagnostic page for serials.ws/
What is the current listing status for serials.ws/?
This site is not listed as suspicious.
What happened when Google visited this site?
Of the 1310 pages we tested on the site over the past 90 days, 0 page(s) resulted in malicious software being downloaded and installed without user consent. The last time Google visited this site was on 05/26/2008, and suspicious content was never found on this site within the past 90 days.
Has this site acted as an intermediary resulting in further distribution of malware?
Over the past 90 days, serials.ws/ did not appear to function as an intermediary for the infection of any sites.
Has this site hosted malware?
No, this site has not hosted malicious software over the past 90 days.

Well no malicious stuff on this site according to Google? that’s very weird since this site is very popular for malicious downloads. Don’t have a hint on what criteria Google judges the quality of a site.

Search Engine / SEO events visit us to know the happenings in SEO industry

We are proud to announce the launch of Search Engine events calendar where you can find out all the latest happenings in search engine and SEO industry. This is a completely free service, please feel free to submit your events here and we will be proud to add it to our calendar totally for a free. Plus you will get a free backlink to your Events page from our site at no extra cost. Your event will not be deleted for 6 months even after the event is over,
Check out the currently updated events here,

http://www.searchenginegenie.com/search-events/month.php