Bing
Beta
Beta

How to remove URLs from our index (expanded edition)

June 08, 2009, 02:25 PM by Rick DeJarnette | 35 Comments

This has been an excellent week in Webmaster Center. Our new Bing community forums are alive and vibrant with excellent questions and people who are willing to share their knowledge. I would like to take this opportunity to thank everyone who has participated. We look forward to your continued participation going forward!

I’ve received a couple great questions on the forums lately and, although we have posted on a few of these topics in the past, I think it is time to expand on one of those topics.

Removing URLs from the index

In our earlier blog post, we provided instructions on how to request URL removals. The previous post indicated that the page must be rendered unavailable to the crawler by a 404 or to use <meta> robots tags. I want to expand on this. Our current requirements for URL removal are (pick one):

  1. 404 the page
  2. Use <meta name="robots" content="noindex">  within your page’s <head> tags
  3. Block the content in your robots.txt file
  4. Follow the remaining directions in the original post linked to above

There has been some confusion in the past as to what type of request to use.

Remove my content: This is the option to remove the URL from our index. It takes between 48 and 72 hours once the ticket has been created by the Bing support team for the content to be fully removed from the index. 

Cache removal:  This option will only remove the cached page but not the actual URL from the index. Some have requested this option hoping to trigger a recrawl. However, if that is the goal, this method doesn’t lead to the desired effect. This option is best when there has been an important content change, but the old page is still available.

Unfortunately, we have seen many instances where people have mistakenly asked for a cache removal and after waiting a week or two, they contact us again asking why the page is still in our index. Because URL removal is permanent until you file a reinclusion request (located on the same form), it is imporatant that we accept the requests as they are specifically submitted. We don’t want to make the mistake of removing a URL if you really did only want a cache removal.

When entering your information in the support request form, you have two choices for either option:

  • Enter single URLs line by line
  • Use a wildcard after the domain name, such as example.com/* or example.com/directory/*

If this post did not answer your questions about content removal from the Bing index, please feel free to post your questions on our webmaster forums. Thanks!

-- Brett Yount, Bing Webmaster Center

subscribe

Comments

Vikrant Jain

Posted On June 08, 2009, 09:18 PM

It is a great topic t learn, but i want to know more huge info. on same.


Deb

Posted On June 09, 2009, 12:20 AM

Interesting post, and it's really helpful, I am a seo-er and need to no follow the page for some time when we do the work.

I have a request - when you said we can blog the page by robot text file, I can't fine how, so do you tell me how is the code to block the page in robots.txt file


Michael Raines

Posted On June 09, 2009, 01:06 AM

Yes, its helpful.


Shaikh Izaj Ahmed

Posted On June 09, 2009, 02:01 AM

I was in a search for a long time to remove urls from index, and found a correct and up to date article. Thanks.


Magesh

Posted On June 09, 2009, 05:20 AM

i thought we need to implement nofollow tag instead of noindex, so thanks for this information


Into Windows

Posted On June 09, 2009, 06:17 AM

Great info. Will help me to optimize my site.


fisher

Posted On June 09, 2009, 08:47 AM

Gret post and i have another question

How can i do to remove dynamics urls?


Rick DeJarnette

Posted On June 09, 2009, 09:16 AM

Hi Deb,

you can block the page in robots.txt using your normal url structure such as:

/exampledirectory/page. I suggest reading www.bing.com/.../robots-exclusion-protocol-joining-together-to-provide-better-documentation.aspx


Rick DeJarnette

Posted On June 09, 2009, 09:18 AM

Fisher, I suggest reading the post I linked to in Deb's reply. It demonstrates how to use wildcards. If you need more help, post on the forums and I will respond.

~B


Brett Yount

Posted On June 09, 2009, 03:12 PM

Magesh,

nofollow works great when you don't want us to follow a link on your page. Noindex means not to index the current page.

to recap:

you don't want us to crawl example.com/nocrawl.html

all links pointing to that page would benifit from the nofollow tag. The page itself should be blocked using noindex tag or block it in your robots.txt file.

Cheers!

~B


Quality Directory

Posted On June 09, 2009, 10:17 PM

I think it would be better to deny URL removal, if the web page is still available and its index is not blocked in robots.txt.


jackin

Posted On June 09, 2009, 11:01 PM

First of all thanks for nice post but i have one query, like i have comment option on my site now i want to put no follow on comment section but page should be index and comment also should be index, then how to do?


Rick DeJarnette

Posted On June 10, 2009, 10:25 AM

Jackin,

Not sure I'm following this.

"i have comment option on my site now i want to put no follow on comment section but page should be index and comment also should be index, then how to do?"

If you want comments indexed and page indexed, why put a tag at all? Are you thinking of putting tags around links in the comments section to control spam?


Philip Werner

Posted On June 12, 2009, 04:21 AM

I submitted a request for a cached page to be removed over 72 hours ago and was contacted by Bing/Microsft support support and told it would be removed in 48, but it still hasn't been. What gives?


ismnet1

Posted On June 17, 2009, 08:34 AM

i submitted 2005 url in site but i get error in site map please help me how to solve it.


Welcome

to the Microsoft Bing community

Remember, don't post your personal information!