Netflix Is Building an Artificial Brain Using Amazon's Cloud


Illustration: Hong Li/Getty

This article was written by Wired.com -- the leading provider of technology and innovation news.

Nothing beats a movie recommendation from a friend who knows your tastes. At least not yet. Netflix (NASDAQ: NFLX  ) wants to change that, aiming to build an online recommendation engine that outperforms even your closest friends.

The online movie and TV outfit once sponsored what it called the Netflix Prize, asking the world's data scientists to build new algorithms that could better predict what movies and shows you want to see. And though this certainly advanced the state of the art, Netflix is now exploring yet another leap forward. In an effort to further hone its recommendation engine, the company is delving into "deep learning," a branch of artificial intelligence that seeks to solve particularly hard problems using computer systems that mimic the structure and behavior of the human brain. The company details these efforts in a recent blog post.

With the project, Netflix is following in the footsteps of web giants like Google and Facebook, who have hired top deep-learning researchers in an effort to improve everything from voice recognition to image tagging. But Netflix is taking a slightly different tack. The company plans to run its deep learning algorithms on Amazon's cloud service, rather than building their own hardware infrastructure a la Google and Facebook. This shows that, thanks to rise of the cloud, smaller web companies can now compete with the big boys — at least in some ways.

Many deep learning methods involve neural networks — computer simulations of the vast networks of neurons that pass signals back and forth across your brain. When you consider that we don't completely understand how the brain works, these neutral nets can't even come close to matching it. But they're a start.

Deep learning remained on the outskirts of academia until the mid-aughts, when computers were finally powerful and affordable enough to begin doing some practical work. Although today's largest neural networks mimic only about one percent of the human brain, according to Engineering and Technology Magazine, modern deep learning algorithms can detect faces in photos, learn your tastes and habits, and, to a certain extent, understand what you say.

This has now pushed deep learning into a wide range of companies, including not only Google and Facebook but Microsoft, Chinese search giant Baidu, and now Netflix. At the heart of the movement, you'll find a man named Geoffrey Hinton, an academic who now spends part of his time at Google, and it appears that open source software created in part by one of his students, Jasper Snoek, underpins the work at Netflix.

Why Brains Run on Graphics Chips
Although Qualcomm is working on computer chips that model the brain, most of today's commercial deep learning neural networks run on GPUs, or graphical processing units. Designed to process massive images at speed, GPUs were originally installed inside machines used by gamers, product designers, and mechanical engineers. But because they're so good at handling many tasks at the same time, through what's known as parallel processing, massive GPU farms are now used to power all sorts of supercomputing applications, including deep learning software. In their blog post, the Netflix engineers say that deep learning is now economically viable thanks in large part to the GPU work done by Stanford professor and Google researcher Andrew Ng, another disciple of Hinton.

Like Google, Netflix is relying on GPUs to build its neural networks. But unlike Google, it's not going to build its own GPU farms. It developed its algorithms on its own workstations, but plans on tapping an Amazon cloud service that lets you run software using GPUs.

The company isn't releasing details about how it will apply neural networks to personalized recommendations. The work is still experimental. But in keeping with the way it open sources much of its infrastructure work, Netflix does describe efforts to get its deep learning system ready for the cloud. This could help smaller start-ups and independent researchers launch their own deep learning experiments atop Amazon — experiments that could push the whole of deep learning movement forward. That's what open source is all about.

Written by Klint Finley at Wired.com.

More from Wired:

Looking for the next big idea? Why not find a way to profit?
Let's face it, every investor wants to get in on revolutionary ideas before they hit it big. Like buying PC-maker Dell in the late 1980's, before the consumer computing boom. Or purchasing stock in e-commerce pioneer Amazon.com in late 1990's, when they were nothing more than an upstart online bookstore. The problem is, most investors don't understand the key to investing in hyper-growth markets. The real trick is to find a small-cap "pure-play", and then watch as it grows in EXPLOSIVE lock-step with it's industry. Our expert team of equity analysts has identified 1 stock that's poised to produce rocket-ship returns with the next $14.4 TRILLION industry. Click here to get the full story in this eye-opening report.


Read/Post Comments (0) | Recommend This Article (4)

Comments from our Foolish Readers

Help us keep this a respectfully Foolish area! This is a place for our readers to discuss, debate, and learn more about the Foolish investing topic you read about above. Help us keep it clean and safe. If you believe a comment is abusive or otherwise violates our Fool's Rules, please report it via the Report this Comment Report this Comment icon found on every comment.

Be the first one to comment on this article.

Sponsored Links

Leaked: Apple's Next Smart Device
(Warning, it may shock you)
The secret is out... experts are predicting 458 million of these types of devices will be sold per year. 1 hyper-growth company stands to rake in maximum profit - and it's NOT Apple. Show me Apple's new smart gizmo!

DocumentId: 2840187, ~/Articles/ArticleHandler.aspx, 10/1/2014 10:28:18 PM

Report This Comment

Use this area to report a comment that you believe is in violation of the community guidelines. Our team will review the entry and take any appropriate action.

Sending report...


Advertisement