Friday, August 7th, 2009

Bing SE ignoring NoIndex/NoFollow Meta tags

Despite the webmaster’s efforts to keep it out of the search engine, Bing is indexing the sensitive content.

Many people are complaining that Bing will not index their content while many other, however, are having the opposite problem.

Content that webmaster do not want be indexed is being indexed by Bing, despite the webmaster’s efforts to keep it out of the search engine.

Are search engines ignoring your NoIndex/Nofollow attributes?

Seems like both Google and Yahoo respected the tag and pages containing NoIndex/NoFollow Meta tags are not being indexed.

Program Manager from Bing Webmaster Center says:

“This is a known issue we are working quickly to resolve. If you have pages you would like permanently removed from our index, please send me a mail to bwmc@microsoft.com with your domain name and “MSNBot ignoring robots tags” in the subject line. Please also include the URLs in the body of the message. You may use an * wildcard for any directories such as:

http:example.com/ wrongdirectory/*

Normally, I would request that you fill out a content removal request, however, since this is a problem on our side, I’ll do the leg work for you.”

But it doesn’t stop there… Many others have complained recently that in some cases even Yahoo has been ignoring NoIndex and Nofollow in Meta tags.

Have you experienced any similar issues? If you have a sensitive information on your webpage’s don’t trust too much in search engine robots… do check if your pages are indexed and appearing on SERP’s.

What to do and how to hide those pages from search engines is the issue for another article coming soon.

Follow me on Twitter: http://twitter.com/sambaron