New MSN Crawler and Index Update

Posted on

  • email
  • twitter
  • facebook
  • share this

share this

Last week on Microsoft's Webmaster Center Blog, the Live Search team announced that it will be testing an update to MSNBot (the company's official site crawler), which may show up as a new crawler name in your referrer logs. The new crawler user agent string will appear as:

    msnbot/2.0b (+

If you take a look at your raw server logs, you will still see the current version msnbot/1.1 (+ as Live Search’s primary user agent.

Many webmasters are seeing results from different data centers, and Live has been rotating different indexes in and out as recently as yesterday. This could mean that the crawlers represent two completely different algorithms. Whether this ultimately will improve relevancy at or any of the Microsoft Search properties is anyone's guess. It is probably safe to say that the damage has been done, so don't expect your MSN traffic stats to shoot up any time soon. Remember, this is all about users, and Microsoft has a long way to go to steal back its share of global searches from Google and Yahoo.

Login To Comment

Become a Member

Not already a part of our community? Sign up to participate in the discussion. It's free and quick.

Sign Up

1 comment

CarolineB 12-17-2008 9:39 PM

So far as Microsoft continue to research and work on its search agent and don't give up, its engineers might one day catch up with Google and Yahoo.

Add to the discussion!

999 E Touhy Ave
Des Plaines, IL 60018

Toll Free: 1.800.817.1518
International: 1.773.628.2779
Fax: 1.773.272.0920