Bing
Beta

adidxbot/1.1 is not reading robots.txt - hitting us at 150 request/second

Answered (Verified)
This post has 2 verified answers | 2 Replies | 1 Follower

vinceh

You guys need to make adidxbot/1.1 (+http://search.msn.com/msnbot.htm) obey robots.txt

150 requests per second sustained is an attack.

Vince

CTO

SHOP.COM


 
 

Answered (Verified) Verified Answer

Brett Yount

Verified by Brett Yount

Hi Vince,

Sorry for the delay. I'm working on this and will get back to you later today with our solution.

Many apologies,

Brett

Brett Yount

Program Manager | Bing Webmaster Center

 Webmaster Blog


 

Brett Yount

Verified by Brett Yount

Vince,

I just received word that they fixed the bug that was causing this. If you are still experiencing issues, please email me at lswmc@microsoft.com

 

~Brett

Brett Yount

Program Manager | Bing Webmaster Center

 Webmaster Blog


 

Welcome

to the Microsoft Bing community

Remember, don't post your personal information!