In Links We Trust – How Google Reshaped The Web

 

Google arrived on the scene in 1998 with all the exuberance and naivete of a grad student, not surprising given that its creators, Larry Page and Sergey Brin were both graduate students when they first met at Stanford University.

Their collaboration on a 1996 project known as BackRub, (so named because backlinks were analyzed) became the search engine we all know as Google. By 1999 Google was no longer a beta engine and had moved from the garage to an office on University Avenue in Palo Alto.

The PageRank Citation System was indeed bringing order to the Web. Even as early as 1998 some thought was given to the impact that commercial interests would have on their search engine algorithm, as evidenced by the following quote,

“At worst, you can have manipulation in the form of buying advertisements (links) on important sites. But, this seems well under control since it costs money.” – From, Bringing Order To The Web -1998

That woefully short sighted observation should have been a warning to everyone that Google’s idealistic creators had no idea the impact their search engine would have on e-commerce, and that buying links, even in 1998, was a practice that Google’s creators frowned on.

tb2Buying and selling links was a common practice in 1998. It was simply known as ‘advertising.’ In 2000, Google would launch their toolbar and this simple browser plugin would have as much of an impact on the Web as the search engine itself.

With the addition of the little green bar as an indicator of PageRank, Google had unwittingly supplied a tool to those that wanted to manipulate Google’s search engine results. Now the link merchants had an easy way of valuing the links they were selling and to those people that craved the #1 spot in the Google results, control now seemed to be in their hands. The longer the little green bar, the more green could be generated by both link sellers and webmasters.

Link exchange UCE (spam) quickly became a problem. Anyone and everyone with a website that had a decent PageRank value became the target of those wishing to buy, sell or trade links. Link farms sprang up all over the Web. Directories were created that took advantage of PageRank values as price points. By 2003 PageRank was seen as so important that the first lawsuit occurred over the perceived sale of it.

To help combat the problem, Google reduced the accuracy of their PageRank indicator to the point that it became useless. In 2003 however, Google launched a program known as Adsense and the Web is still reeling from the impact.

With the launch of Adsense it was now possible for anyone to make money on the Web. No need for a product, tax tables, shipping cost calculators, expensive shopping carts, no need for any confusing or low-paying affiliate program, all you needed was a website or blog and enough know-how to copy and paste a snippet of code.

With high payouts and such easy implementation, it wasn’t long before everyone wanted to cash in on the Adsense phenomenon. Unfortunately, not everyone wanted to take the time to create a worthwhile site. It was much easier to scrape content from other sites and places Adsense on the stolen content. To make matters worse, once someone is approved for Adsense, the code can be placed on any number of sites, with no review.

This fast and loose policy is directly responsible for the proliferation of ‘Made For Adsense’ sites, known as MFAs. Only one ingredient was missing for success with Adsense. Links. Even scraper sites need links and since the content is typically poor or worthless other webmasters won’t link to them. A solution was available however. Link spam, in the form of comments on blogs.

Automated programs seek out blogs and add a link to the target site in the form of a thinly disguised comment. The automation of comment spam became so bad the major search engines like Google and Yahoo banded together to find a solution. Their answer to the problem is known as ‘nofollow’. Place ‘nofollow’ on the links people add in their comments and the the target site receives no boost from the search engines.

As solutions go, nofollow is a poor one. People running the automated comment spam programs simply don’t care about nofollow. With billions of pages out there, they’ll find pages in which nofollow isn’t used. Real solutions, like Akismet, have proven much more effective.

While nofollow as a solution to comment spam has been largely ineffective, Google is now recommending its use for other purposes such as combatting the efficacy of paid links. Google wants to know which links to trust, and to Google, paid links simply aren’t trustworthy? Why? The answer is simple, paid links are effective. Buying links allows anyone to manipulate Google’s results. Which brings into question the continued viability of the citation-based ranking system that is crucial to Google’s success.

How is it possible to tell that paid links are effective? Because Matt Cutts, a Google engineer, wants people to report paid links. On the surface, that might not seem like such a bad thing, but the reality may be quite different.

Google’s citation-based system is falling apart in a world in which links are traded like commodities and Google wants control, not just control of their own results but control of other people’s websites. They’ve basically stated that paid links are bad for the Web unless they’re Google’s links. Anyone that thinks that Adsense ads, (paid links) don’t directly affect the search engine results doesn’t understand the impact that Adsense has had on the Web.

Links are the very essence of the Web, allowing Google to tell you how to link gives them with far too much power. If you want to follow Google’s advice, build your site for your visitors, not for the search engines, and that includes your links. If a paid link is beneficial to the user, so be it. Whether or not it was paid for should have no bearing on the issue.

If you think for a minute that Google cares about the user experience, think about this, Google allows Adsense to be placed on sites without regard to quality of content and they advise blending your ads to look like site navigation, a perfect example of deceiving the user. What their actions say is simply this, paid links are just fine, as long as Google is the one getting paid.

Link freely, link often, and let Google clean up their own mess.

About these ads

  1. Rafa

    Damn dude, I wish I had said that. I’ll give you a call when I get back from London.

  2. That was a great post! It will be interesting in how Google handles paid links, even though paid can stand for a vast number of things…

  3. Very well written summary of the situation and background DG. Now Google has moved so strongly to a link based algo, you wonder where they can go now. The genie is well and truely out of the bottle here.

  4. Now Dean that’s just plain cruel – all you’re trying to do is create more work for poor little Matt Cutts.

    Go for it!!

    :)

  5. Kirby

    All they will get are the low hanging fruit. The Cuttlets will go wild with reports, but the players will remain unscathed. It’s Google’s version of gun control and the result of this logic will be the same – the people the Cutletts hope to see disarmed will be the only ones with the weapons.

  6. DG

    Hello Nick,

    >>wonder where they can go now.

    Semantic search is the holy grail. Their Ph.Ds seem to be stuck in word matching and link manipulation.

    Kirby, I love your analogy. Then again, I own lots of guns. ; )

  7. Major kudos for the post, DG! Amazingly well said!

  8. Word up. Nicely written and pretty much says it all.

  9. DG

    Hey guys, glad you like the piece but Google isn’t going to change anytime soon. Arrogance comes to mind. Check out the forums and you’ll see the Googlers fiercely defending Google’s actions.

    One of the problem is that some people actually believe that Google will be able to correctly identify paid links and that identification will improve the algo. Others just don’t seem to grasp that this is entirely different than official ‘webmaster guidelines’.

  10. Repeat after me: slippery slope, slippery slope, slippery slope.

    I still find it ironic Matt linked to a site that was chock-full of non-relevant text-links.

  11. Matt

    Google says I can’t pay for links. Willing to have sex with seller instead. ;-)

  12. Great article. Thanks for taking the time to give an insightful and well thought out perspective. It will be intersting to see future developments….

  13. robert

    Great stuff! I love this article. It just the truth und so helpful.

  14. Magnificent beat ! I would like to apprentice at the same time as you amend your web site, how could i subscribe for a blog website? The account helped me a appropriate deal. I have been a little bit acquainted of this your broadcast provided vivid transparent idea

  1. 1 » Pay For Display: Editorial Integrity and Paid Links - rogerd’s notebook

    […] Adwords for reaching some consumers, particularly early adopters. A lengthy and informative post, In Links We Trust – How Google Reshaped The Web, by our buddy DG describes the history of Google-driven link strategies (and countermeasures), and […]

  2. 2 Google vs. Paid Links - TheVanBlog

    […] In Links We Trust – How Google Reshaped The Web […]

  3. 3 WordPress PHP Programming » Google-Approved Links

    […] A good account of the history of Google vs the […]

  4. 4 Technology Directions

    Link Quality Decay and Incentivized Links

    AI researchers have long known that there are two ways to build an intelligent system: 1) Design a very simple reasoning engine, but feed it with lots and lots and lots of data that can be used as the basis

  5. 5 Google Webmaster Tools - Report Paid Links « Speaking Freely

    […] If you’ve ever wanted confirmation that paid links work, this is it. For more on Google’s link issues, see In Links We Trust – How Google Reshaped The Web. […]

  6. 6 Google vs. Paid Links | TheVanBlog

    […] In Links We Trust – How Google Reshaped The Web […]




Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s


  • Blog Stuff

  • What People Are Saying

  • People Are Interested In

  • RSS Word Of The Day

  • RSS Quote Of The Day

  • RSS Neologisms

    • Gray Thursday November 26, 2014
      n. The evening of the United States Thanksgiving holiday, when some retailers offer sales and stay open until the early morning or all night.Once upon a time, we used to call Gray Thursday "Thanksgiving." With Black Friday sales starting earlier each year, they were bound to bleed into Turkey Day.—Tony Bravo, “The Sixteen Days of Holiday Retail,” S […]
    • happiness curve November 25, 2014
      n. The U-shaped curve obtained by graphing individual happiness levels over time, which typically drop until midlife, level off for a time, and then rise.The apes' well-being bottomed out at ages comparable, in people, to between 45 and 50 -- implying that the happiness curve is not uniquely human.—Jonathan Rauch, “The Real Roots of Midlife Crisis,” The […]
    • brocialist November 21, 2014
      n. A man who has progressive views, but who is also insensitive to women and dismissive of feminist issues.The "brocialist" is generally a good leftist. His heart is probably in the right place. But he has a gigantic blind spot when it comes to women, one that is both political (he is not sensitive to feminist concerns) and personal (he can be a pi […]
    • budtender November 20, 2014
      n. A person who dispenses marijuana in a cannabis shop or medical marijuana clinic.Colorado law says cannabis must be sold in rooms that can't be seen from outside, so the real business happens in an interior room. A helpful and knowledgeable "budtender" -- a guy in his 20s or 30s, typically, who has submitted to a state background check -- gu […]
    • hicksploitation November 19, 2014
      n. A TV or film genre that features stereotypical depictions of rural people, particularly those from the American South.Robertson is the biggest star of the biggest boom in reality TV: hicksploitation. The genre laughs at (and sometimes with) the last group of people its still ostensibly OK to stereotype -- white backwoodsy men.—Grayson Schaffer, “Why Duck […]
    • small data November 18, 2014
      n. The data generated by an individual or small company.Throughout the two days I found myself constantly presented with new ideas -- of course, many of these were not new at all, just new for me to think about. So when Richard Nash talked about "small data" (metadata about you: your cookies, your web search history, your Amazon clicks, and so on), […]
    • dronestagram November 14, 2014
      n. A photo or video shot from a drone.Apropos of autonomous weapons, Cody highlighted some "dronestagrams" taken by the unmanned vehicles.—Benjamin Bissell, “The Week that Was: All of Lawfare in One Post,” Lawfare, November 1, 2014See the full entry
    • tube site November 13, 2014
      n. A video sharing website modeled after YouTube.com, particularly one that specializes in pornographic movies.Specifically, MindGeek owns a large number of porn aggregator "tube sites" (so named because they mimic YouTube's format) such as Pornhub, YouPorn, and Redtube, which serve up huge amounts of free porn funded by ads.—David Auerbach, “ […]
    • fintech November 12, 2014
      n. The industry consisting of companies that create or sell financial technology.Scores of fintech enterprises in London and Silicon Valley are devising new ways to lend cash, transfer money abroad, settle international commercial transactions and score credit risk -- all of which have been the domain of banks for centuries.—Edward Robinson, “In Britain, fin […]
    • super-gentrification November 11, 2014
      n. The rebuilding and upgrading that occurs when exceptionally wealthy people move into an already well-off or middle-class area.Postcode 94027 is now undergoing something of a "super-gentrification", where an entirely new strata of super-rich are taking over already affluent areas.—Julie Ensor, “The sleepy American suburb turned super-rich playgro […]
  • More Blog Stuff


Follow

Get every new post delivered to your Inbox.

%d bloggers like this: