I have a site containing pages that I don't want their content being indexed by search engines so all of those pages have
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW" />
in their header and it has been like this for a while now.
Both Google and Yahoo respected the tag and those pages are not being indexed by them but today I checked and found all those pages even recent ones are indexed and cached on Bing.
Any idea?
Thanks,
Soroush
Hi,
This is a known issue we are working quickly to resolve. If you have pages you would like permanently removed from our index, please send me a mail to bwmc@microsoft.com with your domain name and "MSNBot ignoring robots tags" in the subject line. Please also include the URLs in the body of the message. You may use an * wildcard for any directories such as:
http:example.com/ wrongdirectory/*
Normally, I would request that you fill out a content removal request, however, since this is a problem on our side, I'll do the leg work for you.
Brett Yount
Program Manager | Bing Webmaster Center
Webmaster Blog
Remember, don't post your personal information!