Live Search is committed to continuing to improve how we discover and crawl your content. In the coming weeks, we will be testing an update to MSNBot, which may show up as a new crawler name in your referrer logs. The new crawler user agent string will appear as: msnbot/2.0b (+http://search.msn.com/msnbot.htm) You’ll still see the current version msnbot/1.1 (+http://search.msn.com/msnbot.htm) as Live Search’s primary user agent. We intend to ensure that any robots exclusion protocol you are using is respected. As such, you don’t need to update your Robots.txt file. We plan on crawling at a slow speed during the tests with the updated version. When the new crawler replaces our current crawler...
On the web, links are the coin of the realm and as such, it is probably one of the most talked about subjects in webmaster blogs and at search conferences. In the last few weeks, there have been a few blog posts and “link” related product launches that make it clear there are still some misconceptions about what are effective and beneficial ways to build links. Link building is one of the most important and difficult jobs for a webmaster. Generating links for a site is not always obvious and webmasters may not know where to begin getting links for their sites. This leads some to focus on link exchanges or use complex link schemes to improve the rank of their sites. The truth about link exchanges...
