Twitter Improves Its Search Using the 'Blender'


Microblogging site Twitter has vastly improved search speed using a Java server called Blender, the company announced on the Twitter Engineering blog today. Early last year, the search team at Twitter began an effort to rewrite its search engine in order to serve its ever-growing traffic, improve the end-user latency and availability of the service, and enable rapid development of new search features, said the company.

The change, reports Mashable, has reduced search latencies by approximately three times (from 800ms to 250ms), Twitter has claimed, and CPU load on Twitter's front-end servers was cut in half.

The advantage of Twitter's new search architecture was starkly illustrated in a real-life example with the spike in Twitter search queries after the Tohoku earthquake and tsunami hit Japan on March 11, which significantly increased search latencies.

Noted Twitter engineers, “Following the launch of Blender, our 95th percentile latencies were reduced by 3x from 800ms to 250ms and CPU load on our front-end servers was cut in half. We now have the capacity to serve 10x the number of requests per machine. This means we can support the same number of requests with fewer servers, reducing our front-end service costs by an order-of-magnitude.”

Twitter search is one of the most heavily-trafficked search engines in the world, serving over one billion queries per day. For the end users, Twitter's search engine, which serves more than 1 billion queries per day, will work much faster, with the dreaded “fail whale” making fewer appearances, said Mashable.

For a detailed explanation of how the new Blender works, check out Twitter's engineering blog here.

Tracey Schelmetic is a contributing editor for TechZone360. To read more of Tracey's articles, please visit her columnist page.

Edited by Janice McDuffee

TechZone360 Contributor

Related Articles

Coding and Invention Made Fun

By: Special Guest    10/12/2018

SAM is a series of kits that integrates hardware and software with the Internet. Combining wireless building blocks composed of sensors and actors con…

Read More

Facebook Marketplace Now Leverages AI

By: Paula Bernier    10/3/2018

Artificial intelligence is changing the way businesses interact with customers. Facebook's announcement this week is just another example of how this …

Read More

Oct. 17 Webinar to Address Apache Spark Benefits, Tools

By: Paula Bernier    10/2/2018

In the upcoming webinar "Apache Spark: The New Enterprise Backbone for ETL, Batch and Real-time Streaming," industry experts will offer details on clo…

Read More

It's Black and White: Cybercriminals Are Spending 10x More Than Enterprises to Control, Disrupt and Steal

By: Cynthia S. Artin    9/26/2018

In a stunning new report by Carbon Black, "Hacking, Escalating Attacks and The Role of Threat Hunting" the company revealed that 92% of UK companies s…

Read More

6 Challenges of 5G, and the 9 Pillars of Assurance Strategy

By: Special Guest    9/17/2018

To make 5G possible, everything will change. The 5G network will involve new antennas and chipsets, new architectures, new KPIs, new vendors, cloud di…

Read More