Please ensure Javascript is enabled for purposes of website accessibility

Google's New Chip May Be the Future of AI Systems

By Danny Vena - Updated Apr 18, 2017 at 1:43PM

You’re reading a free article with opinions that may differ from The Motley Fool’s Premium Investing Services. Become a Motley Fool member today to get instant access to our top analyst recommendations, in-depth research, investing resources, and more. Learn More

Google's latest revelation may be the biggest advancement yet in chips that power artificial intelligence systems, but other companies are releasing innovations of their own.

Alphabet's (GOOGL 2.84%) (GOOG 2.96%) Google announced at its I/O Developers Conference in May 2016 that it had designed a new chip, called the tensor processing unit (TPU), specifically designed for the demands of training artificial intelligence (AI) systems. The company didn't divulge much at the time, but in a blog post that same week, hardware engineer Norm Jouppi revealed that Google had been running the TPU in the company's data centers for more than a year and...

... found them to deliver an order of magnitude better-optimized performance per watt for machine learning. This is roughly equivalent to fast-forwarding technology about seven years into the future (three generations of Moore's Law).

The chip was an application-specific integrated circuit (ASIC), a microchip designed for a specific application. Little else was known about the enigmatic TPU, and the mystery continued until last week, when Google pulled back the curtain to reveal the inner workings of this new groundbreaking advancement for AI.

Tensor processing unit chip.

Google's tensor processing unit could revolutionize AI processing. Image source: Google.

Speed and efficiency

The TPU underlies TensorFlow, Google's open-source machine learning framework, a collection of algorithms that power the company's deep neural networks. These AI systems are capable of teaching themselves by processing large amounts of data. Google tailored the TPU to meet the unique demands of training its AI systems, which had previously been run primarily on graphics processing units (GPUs) manufactured by NVIDIA Corporation (NVDA 9.46%). While the company currently runs the TPU and GPU side by side (for now), this could have drastic implications for how AI systems are trained going forward.

Google released a study -- authored by more than 70 contributors -- that provided a detailed analysis of the TPU. In a blog post earlier this month, Jouppi laid out the capabilities of the chip. He described how it processed AI production workloads 15 to 30 times faster than CPUs and GPUs performing the same task, and achieved a 30 to 80 times improvement in energy efficiency. 

Saved the cost of 12 new data centers 

Google realized several years ago that if customers were to use Google voice search for just three minutes each day, that would require the company to double its existing number of data centers. The company also credits the TPU with providing faster response times for search, acting as the linchpin for improvements in Google Translate, and was a key factor in its AI system's defeat of a world champion in the ancient Chinese game of Go.

Companies are taking a variety of approaches to bring improvements to AI systems. Intel Corporation's (INTC 1.77%) recently acquired start-up Nervana has developed its own ASIC, the Nervana Engine, that eliminates components from the GPU not essential to the functions necessary for AI. The company also re-engineered the memory and believed it could realize 10 times the processing currently performed by GPUs. Intel is working to integrate this capability on its existing processor platforms to better compete with NVIDIA's offering.

Not the only game in town

A field-programmable gate array (FPGA) processor can be reprogrammed after installation and is another chip being leveraged for gains in AI. FPGAs have increasingly been used in data centers to accelerate machine learning. Apple Inc. (AAPL 3.19%) is widely believed to have installed this chip in its iPhone 7 to promote sophisticated AI advances locally on each phone. The company has emphasized not sacrificing user privacy to make advances in AI, so this would be a logical move for its smartphones.

Tesla P100 chip.

NVIDIA Tesla P100 powers Facebook's AI server. Image source: NVIDIA.

Facebook, Inc. (FB 3.86%) has taken a different approach in optimizing its recently released data center server named Big Basin. The company created a platform that utilizes eight NVIDIA Tesla P100 GPU accelerators attached with NVLink connectors designed to reduce bottlenecks, in what it described as "the most advanced data center GPU ever built." The company revealed that this latest server is capable of training 30% larger machine learning data systems in about half the time. Facebook also indicated that the architecture was based NVIDIA's DGX-1 "AI supercomputer in a box." 

Much more innovation to come

Though we have been hearing about almost daily breakthroughs in AI, it is important to remember that the science is still in its infancy and new developments will likely continue at a rapid pace. These advances provide for more efficient systems and lay the foundation for future progress in the field. These necessary advances will propel future innovation, but are difficult to quantify in terms of dollars and cents, as well as the potential effects on future revenue and profitability.

Invest Smarter with The Motley Fool

Join Over 1 Million Premium Members Receiving…

  • New Stock Picks Each Month
  • Detailed Analysis of Companies
  • Model Portfolios
  • Live Streaming During Market Hours
  • And Much More
Get Started Now

Stocks Mentioned

Alphabet Inc. Stock Quote
Alphabet Inc.
$2,321.01 (2.84%) $64.13
Alphabet Inc. Stock Quote
Alphabet Inc.
$2,330.31 (2.96%) $67.09
Apple Inc. Stock Quote
Apple Inc.
$147.11 (3.19%) $4.55
Intel Corporation Stock Quote
Intel Corporation
$43.60 (1.77%) $0.76
NVIDIA Corporation Stock Quote
NVIDIA Corporation
$177.06 (9.46%) $15.31
Meta Platforms, Inc. Stock Quote
Meta Platforms, Inc.
$198.62 (3.86%) $7.38

*Average returns of all recommendations since inception. Cost basis and return based on previous market day close.

Related Articles

Motley Fool Returns

Motley Fool Stock Advisor

Market-beating stocks from our award-winning service.

Stock Advisor Returns
S&P 500 Returns

Calculated by average return of all stock recommendations since inception of the Stock Advisor service in February of 2002. Returns as of 05/16/2022.

Discounted offers are only available to new members. Stock Advisor list price is $199 per year.

Premium Investing Services

Invest better with The Motley Fool. Get stock recommendations, portfolio guidance, and more from The Motley Fool's premium services.