Wednesday, October 26, 2005
Remove a blog from Blog Search
Only blogs with site feeds will be included in Blog Search. If you'd like to prevent your feed from being crawled, make use of a robots.txt file or meta tags (NOINDEX or NOFOLLOW), . Please note that if you have a feed that was previously included, the old posts will remain in the index even though new ones will not be added.
Remove a RSS or Atom feed
When users add your feed to their Google homepage or Google Reader, Google's Feedfetcher attempts to obtain the content of the feed in order to display it. Since Feedfetcher requests come from explicit action by human users, Feedfetcher has been designed to ignore robots.txt guidelines. It's not possible for Google to restrict access to a publicly available feed. If your feed is provided by a blog hosting service, you should work with them to restrict access to your feed.
Only blogs with site feeds will be included in Blog Search. If you'd like to prevent your feed from being crawled, make use of a robots.txt file or meta tags (NOINDEX or NOFOLLOW), . Please note that if you have a feed that was previously included, the old posts will remain in the index even though new ones will not be added.
Remove a RSS or Atom feed
When users add your feed to their Google homepage or Google Reader, Google's Feedfetcher attempts to obtain the content of the feed in order to display it. Since Feedfetcher requests come from explicit action by human users, Feedfetcher has been designed to ignore robots.txt guidelines. It's not possible for Google to restrict access to a publicly available feed. If your feed is provided by a blog hosting service, you should work with them to restrict access to your feed.
recently some of our clients have reports some erronous backlinks showing in their backlinks, they think they never had backlinks from those bad neighbourhood sites but still those sites appear in backlinks,
Immediately we jumped into research and found out that there are many other people seeing the same problem,
This member in webmasterworld.com has reported the same problem faced by some of our clients
he says
"
I am getting referrals in my logs from extremely explicit websites.
I visit the URL in the log and it brings me to a totally pornographic page with absolutely no links to my site. I have however found a few of these pages cached in Google, and they start out linking to a bunch of legitimate sites, then throw up porn once the pages get indexed.
What is the purpose of this, and what benefit can come of it for the publisher.
How can I block referrals from these domains? Will receiving referrals from domains of this nature cause G to assume my site is somehow related?
"
Immediately we jumped into research and found out that there are many other people seeing the same problem,
This member in webmasterworld.com has reported the same problem faced by some of our clients
he says
"
I am getting referrals in my logs from extremely explicit websites.
I visit the URL in the log and it brings me to a totally pornographic page with absolutely no links to my site. I have however found a few of these pages cached in Google, and they start out linking to a bunch of legitimate sites, then throw up porn once the pages get indexed.
What is the purpose of this, and what benefit can come of it for the publisher.
How can I block referrals from these domains? Will receiving referrals from domains of this nature cause G to assume my site is somehow related?
"
