Microsoft Live Search Fixes Issue With Listing Google AdWords Ads

Earlier today, we reported that over 4 million Google AdSense ads were being indexed by Microsoft Live Search. Tonight, the Microsoft Live Search Webmaster Center blog has posted that they’ve identified and fixed the issue and that search results should return to normal within the next few days.

What happened? Google AdWords URLs are blocked by Google’s robots.txt file with this command:

Disallow: /pagead/

The blog post explains that when Live Search finds links to pages that are blocked by robots.txt, they may index the link (as listed URL) and anchor text (as the listed title). Google and Yahoo do the same. Google calls these results “partially indexed URLs” and Yahoo! calls them “thin listings.” Live Search found these AdWords URLs as links in AdSense blocks on sites they crawled.

In this case, AdWords URLs were listed not only because of the way Live Search indexes blocked URLs, but also because of a change in how Google renders AdSense units. However, the blog post doesn’t describe this change and the Google AdSense blog doesn’t mention changes.

Microsoft recently posted about another issue with their crawler that caused them to download AdSense blocks, which may have skewed ads reporting. Likely this latest issue wouldn’t impact ad reporting, as the bot crawling the AdSense links identified itself as MSNbot.

Opinions expressed in this article are those of the guest author and not necessarily Search Engine Land. Staff authors are listed here.

About The Author

Vanessa Fox

Vanessa Fox is a Contributing Editor at Search Engine Land. She built Google Webmaster Central and went on to found software and consulting company Nine By Blue and create Blueprint Search Analytics< which she later sold. Her book, Marketing in the Age of Google, (updated edition, May 2012) provides a foundation for incorporating search strategy into organizations of all levels. Follow her on Twitter at @vanessafox.