Google Explains How It Stays Head and Shoulders Above Search Competitors

By Tracey E. Schelmetic April 14, 2011

Did you ever wonder how Google stays so consistently at the top of the heap of search engines? Why it has outpaced all competitors, both old and new? Apparently, by never sitting back and assuming that Google's flagship service is “complete.”

Evidently, they use trial and error, and testing, testing, testing. AFP news filed a story today that reported that the Google search evaluation team, headed by one Scott Huffman, tested more than 6,000 changes to the Google search engine in 2010. Five hundred of them “stuck.” Engineers “reverently” refine Google's search algorithm so consistently that it often ends a day a tad different from when it started.

“We have changed engines on a flying plane so many times it has become second nature to us,” said Google fellow Amit Singhal, referring to how Internet firms modify services while they are live online.

“Alongside changing the engines, the plane has become quieter, the ride got more comfortable, and we even changed your seat while you were sleeping,” he continued. “We just do it in small steps that go unnoticed.”

Singhal said Google's search is tweaked, on average, twice in a working day. It's a fine line between making changes too slowly – or too abruptly.

“On the one hand, we want to be moving quickly and we want to make great changes,” Huffman told AFP. “On the other hand, we don't want people to come to Google and say they don't recognize it.”

Google in February took the unusual step of spotlighting an improvement to its secret search formula in the United States.

The move was part of an ongoing duel between Google and low-quality Web sites that feature only content copied from elsewhere on the Internet or use techniques to trick their way to high search rankings.

“The feedback has been tremendously positive from users,” Singhal told AFP in an interview at Google's headquarters in Mountain View, California.

“Overwhelmingly, the change raised ranks of high-quality sites and dropped ranks of low-quality sites.”

Huffman's team is responsible for insuring that ideas for improving Google search results do just that.

“People are not just expecting a search engine to return every document that has most of the words typed in a query box," Huffman said. "They want the context understood; there are a lot of nuances hidden within that.”

For example, someone searching with the word “Japan” is likely interested in real-time news about the tsunami tragedy there as well as other information about the nation.

One of Huffman's favorite “broken queries” from a couple of years ago was the term “Thai restaurant.”

General Web searches kept giving top rank to a Thai restaurant in the upstate New York city of Schenectady.

“I used to go complain to the ranking people,” Huffman recalled with a laugh. “I'm in Mountain View. It might be a great Thai restaurant, but I'm not going to Schenectady to get Pad Thai. It just isn't going to happen.”

Google began letting users set locations so the search engine could factor proximity into results when appropriate.

Proposed changes to Google's formula are first tested on a separate set of computers that imitate real-world search. Those deemed worthy are next sent to evaluators around the world who act as online searchers and rate the relevance of results in various languages and regions.

Google then does live testing, with promising algorithm enhancements carefully blended into results served up by the main search engine.

“At any given time, some percentage of our users is actually seeing experiments,” Huffman said.

“It is interesting because users don't know what is happening,” he continued. “Of course, we don't put things out there that are terrible; we have filters to know when something is bad.”

Google is steadfast – even indignant – when suggestions are made that organic search results are manipulated to rank advertisers higher.

“If you think of the scale of what we are talking about, it is almost absurd to say we could rig results,” Huffman said, noting that Google handles more than a billion searches daily.

Singhal agrees. “If we care about our users -- don't care about money -- everything else just falls in line,” he said. “A healthy Web and happy users are key to our future.”


Tracey Schelmetic is a contributing editor for TechZone360. To read more of Tracey's articles, please visit her columnist page.

Edited by Rich Steeves

TechZone360 Contributor

SHARE THIS ARTICLE
Related Articles

Bloomberg BETA: Models Are Key to Machine Intelligence

By: Paula Bernier    4/19/2018

James Cham, partner at seed fund Bloomberg BETA, was at Cisco Collaboration Summit today talking about the importance of models to the future of machi…

Read More

Get Smart About Influencer Attribution in a Blockchain World

By: Maurice Nagle    4/16/2018

The retail value chain is in for a blockchain-enabled overhaul, with smarter relationships, delivering enhanced transparency across an environment of …

Read More

Facebook Flip-Flopping on GDPR

By: Maurice Nagle    4/12/2018

With GDPR on the horizon, Zuckerberg in Congress testifying and Facebook users questioning loyalty, change is coming. What that change will look like,…

Read More

The Next Phase of Flash Storage and the Mid-Sized Business

By: Joanna Fanuko    4/11/2018

Organizations amass profuse amounts of data these days, ranging from website traffic metrics to online customer surveys. Collectively, AI, IoT and eve…

Read More

Satellite Imaging - Petabytes of Developer, Business Opportunities

By: Doug Mohney    4/11/2018

Hollywood has programmed society into believing satellite imaging as a magic, all-seeing tool, but the real trick is in analysis. Numerous firms are f…

Read More