Bing

Picked Fresh Daily

August 22, 2005, 11:43 AM by Bing | 12 Comments

One of the key elements of having a great index is having fresh content.  If someone searches for Vista on the day that we announced the name for the next version of Windows then they should be able to see relevant results.  This means that we need to have the content in our index within minutes of these types of events happening. In order to do this we built a simple crawler to get News and Blogs that break this type of news.

As you may have seen from Jeremy Zawodny's blog, Greg Hughes blog and others we are crawling RSS and other content that we want to be sure is always fresh in our index.  At this point we are just experimenting and suffice to say that in our short experiment we have learned a lot.  We have been a bit more zealous in our crawling then we would have liked and we are going to fix that.  Thanks for the feedback!  Stay tuned for more as we figure out what to do with all of this data...

Eytan Seidman, Program Manager, MSN Search

subscribe

Comments

randfish

Posted On August 22, 2005, 02:20 PM
Eytan, I've been very impressed with how well you keep the MSN engine up-to-date. It's a feather in MSN's cap that one of your larger competitors is so consistently slow with these sorts of events.

One item I wanted to point out to you, however, is that reporting search spam on MSN is exceptionally difficult. Can you make this page easier to access and make sure that a search for "report search spam site:search.msn.com" comes up with a reault. Thanks much!

search-engines-web

Posted On August 22, 2005, 03:35 PM
The new MSN IS impressive in terms of updating content, and because the current ALGOs do NOT over emphasize Link Popularity - new content can get noticed without Months of acquiring Bacwards Links...

However, to be fair to the other major Search Engines Google Yahoo) - Windows Vista comes up #1 and #4

Ask Jeeves, with its Subject Specific Popularity - does not have it in their top SERPs, but ironies of ALL ironies - doing a search for the term "HOME" (which indicates link popularity priority in ALGOS) - ASK has the most relevant SERPS.

It would be interesting to see a Blog about MSN experiments with ALGOs and Relevancy

Search Grub

Posted On August 23, 2005, 06:25 AM
As a professional SEO Specialist I have found MSN continues to impress me. If someone had asked at the start of this year, or even at the end of the beta what I thought the chances of MSN doing well were I would have said "not great at all, it's MSN!!".

However I have grown to love this engine, I also now use the toolbar for making my searches in additiona to "other" engines, but am finding more and more that the results I want are located in MSN and not in the "Others".

Additionally, getting my sites indexed with MSN is a breeze and very very quick, the updates take place quickly too, so MSN, my hat is off to you!

I would like to know if your picking all RSS feeds up or just "selected sources" for helping with indexing the latest content? I am always sure to have a working RSS feed on my sites to try and help things along.

Thanks again MSN! And keep up the good work.

Dave

http://www.searchgrub.com

k3l

Posted On August 23, 2005, 09:58 AM
SO.. .should we submit our RSS feeds to ur search engine? or do we wait spiders to crawl and find it?
thx

Ashish Thakkar

Posted On August 26, 2005, 05:44 AM
Personally i feel that you're doing a good job and the new msn search is awesome.

It would be nice if you would allow the rss and blogs to ping msn.com rather than the frequest crawl that exists currently.


Regards,
Ashish T.
http://www.jimmythakkar.com/blog

Scott

Posted On August 26, 2005, 09:52 AM
I like that your bot is the freshest but you really need to figure out how to read the robots.txt file.

Despite having read the robots.txt file nearly everyday for the last week, and having read it at least once a week your bot decided it was ok to pull a bunch of my dynamic url's that are for users.

I hope that is what you are fixing. I love the new search.

Scott

Eric Swanson

Posted On August 26, 2005, 05:24 PM
"We have been a bit more zealous in our crawling then we would have liked and we are going to fix that."

LOL! I think I made up for it by indexing your guys' MSN Spaces website a bit more than I would have liked and I fixed it (got tons of bloggers screaming at me for appearing in their stats). Crawling for content has opened up a whole new world of possibilities to me as a programmer and I am continuing to learn what others have already learned, but applying it in new ways I haven't seen it applied.

Keep up the good work and I'll just continue trying to catch up and keep up.

My bot works for AndNBSP.com, a dynamic list of updated MSN Spaces (spaces.msn.com) and content.

Welcome

to the Microsoft Bing community

Remember, don't post your personal information!