Why Is Google Promoting Scrapers Over Time Mag?

Author: Gab Goldenberg

Google promoting scrapers over Time magazine

Google’s promoting scrapers over Time magazine. Seems Google’s exception list isn’t as robust as one might have thought, or perhaps it’s that the news business just ain’t what it was

Ideas why this is happening?

Update: 1 idea is that it’s tied to the latest algo change. See also Mashable’s status.

One guess I’d have is a high ratio of surrounding junk to the main body of content. That would fit under the layout/design/user experience angle targeted by the latest algo update.

If you have a legitimate need, read this review of three web screen scrapers?

Sidebar Story


  1. Looks like TIME is above the ProfessorsHouse site now .. 3 vs 4.

    Comment by Matt Cullen - March 18, 2011 @ 8:41am
  2. Think it was due to human signals and/or a manual change?

    Comment by Gabriel Goldenberg - March 23, 2011 @ 10:38am
  3. Not sure if this is related, but I did read that Google, post Panda, are prefering snipets rather than full blown pages. But I can't remember in what context that was - probably in the context of a HOME page

    Comment by Brian Parnall - May 25, 2011 @ 11:04am
  4. What do you mean preferring? For the same site to show snippets on the homepage instead of full posts, to avoid canonicalization issues?

    Comment by Gabriel Goldenberg - May 25, 2011 @ 12:50pm

Leave a Reply