This is a place devoted to giving you deeper insight
into the news, trends, people and technology behind Bing.
Bing.com was down between about 6:30 and 7:00 PM Pacific Time on Dec 3, 2009. During this time, users were either unable to get to the site, or their queries were returning incomplete results page. The cause of the outage was a configuration change during some internal testing that had unfortunate and unintended consequences. As soon as the issue was detected, the change was rolled back, which caused the site to return to normal behavior. Unfortunately the detection and rollback took about half an hour, and during that time users were unable to use bing.com. We strive to maintain a high standard of operational excellence at Bing. We are running a post mortem to find out how our software and processes need to be improved to prevent anything like this from happening again. Satya Nadella Senior Vice President, Online Services Division
Its ok. Just that many were waiting for something like this to trash bing (like techcrunch)
This is a little incorrect, the outage and errors started occurring at 6:24pm and finished at 7:10pm. That makes it down for 45 mins and not 30 mins as some are reporting.
Thank you for this post to advise of the difficulties that were experienced. As more features are enabled and things are made more complex it is expected.
Thanks for the notification. Although it didn't affect me, it's great with some openness in relation to unexpected downtime.
Thanks for the notificatio
you should have forwarded the requests to google during the 45 minutes downtime.
I did not notice a return to service until PST 7:15 P.M. In total, from my perspective, the bing.com outage was 40+ minutes. What took so long to back-out the change? Was it a reboot?
Screenshots of what I saw on Internet Explorer are included on my post. whatwillweuse.com/.../hold-on-40-minutes-while-i-bing-that
I recommend pushing configuration changes to a staging server first, then to production in the future.
Quite agreed swartkrans - Microsoft you should know better than that ~
Haha. I like Bing, but half-an-hour downtime is unacceptable these days. Do you guys not have failover systems? Even routing us queries to computers in europe causing slow results would be better than a http 500 error code. Speaking of that, no custom error pages? I haven't seen a plain white http 500 error code page on a production site in years.
BTW, great timing too. right in the middle of cnbc's report on Google!
All in all it was amusing to me and caused me to change my default internet search back to Google. I'll continue to watch Bing, but you guys have A LOT of work to do!
I didn't the outage, but I read about it on techcrunch!
I wasn't online during that time. Happy to hear it was fixed immediately after the detection.
Dear Mr. Nadella,
I am leaving this comment in hope to make you and the bing team aware of the difficulties bing users are facing in claiming cashback. Purchases made with Dell (via bing) seem not to have any associated transaction ids - it is odd since other minor purchases made during the session do result in a transaction id. The bing cashback forum (www.bing.com/.../12266.aspx) is flooded with similar observations.
This goes to show that significant disruptions in service quality still happen to large and mature organizations, who have a lot riding on being perceived as a trusted provider of services over the internet.
I'm still trying to decide whether I should be surprised or not about the issue Bing just encountered. One part of me says that as systems and organizations get more complex, it's nearly impossible to be perfect at operational excellence (at least not cost-effectively), and these types of outages are bound to happen. On the other hand, if I was the exec in charge of Bing, I'd have a hard time not being extremely unhappy with my team.
I'd think that as hard as I'm working to gain (or not lose) market share to the competition, I couldn't afford this kind of mistake. There don't seem to be any mitigating circumstances here. It's not like the search site was missing some less-known features, or returning slightly outdated results. Instead, I'd be fuming that my entire business was closed during business hours (this didn't happen in the middle of the night) during the holiday season (remember, Bing is not just search, it's shopping, maps, travel, etc). If Bing was a brick and mortar store, this would not be like being out of stock for a couple items, it would be like having the lights out and doors closed at 6:30 PM PST.
[Read rest of entry at ooluck.com/.../it-even-happens-to-the-big-boys.html ]
Already difficult problem of power cuts caused a lot of problems that you do it well
© 2013 Microsoft