Invest better with The Motley Fool. Get stock recommendations, portfolio guidance, and more from The Motley Fool's premium services.
Reinforcement learning is a branch of machine learning that's used with artificial intelligence. Agents are rewarded with positive values for achieving desired outcomes and prevented from undesired actions through negative values.
This article will discuss reinforcement learning, explain how it's different from other types of machine learning, and review common algorithms used in reinforcement learning. Finally, we'll explore the pros and cons of reinforcement learning and provide an example of how it's used in a vintage video arcade game.
Artificial intelligence (AI) agents can learn, but it takes time and effort. An important part of teaching AI agents involves machine learning; reinforcement learning is an important branch of machine learning that assigns positive or negative values to outcomes. The AI agent is programmed to maximize the assigned value and calculate the most effective method for a desired outcome.
Reinforcement learning is only one branch of machine learning. It requires extra work for programmers to define clear goals, as well as values for positive and negative outcomes. Once the programming is done, however, the algorithm operates independently.
Related forms of machine learning that are often confused with reinforcement learning include:
Because reinforcement learning involves leaving the agent to its own devices once parameters have been established, it's often considered to be more like semi-supervised learning. The key difference, however, is that the level of explicit programming is higher for reinforcement learning.
Reinforcement learning isn't that much different from human learning in that it uses different approaches to achieve its goals. People generally are guided by teachers; reinforcement learning is steered by algorithms. There are a large number of algorithms that have been developed for reinforcement learning, but three of the most common include:
As with any branch of artificial intelligence, there are pros and cons. Some of the advantages of reinforcement learning are obvious. Like other AI features, it can be used to solve extremely complex problems, including issues that involve decision-making, control, and optimization.
Reinforcement learning also can deal with environments where outcomes aren't always easily predicted, an especially useful feature for real-world applications, such as healthcare. It can fix mistakes that happen during its shakedown process and can be combined with other branches of machine learning to improve performance.
Of course, there are downsides. Reinforcement learning isn't terribly useful for dealing with simple problems. It requires a lot of data and can be extremely difficult to debug if and when problems occur. Finally, it depends heavily on the quality of the positive value description. If the description is designed poorly, the agent may be a failure.
It's hard to imagine that a branch of AI can be tied to a 1980 program that’s considered to be the basis for one of the greatest video games of all time. Then again, it's hard to deny the cultural appeal of the once-ubiquitous Pac-Man. Indeed, the structure of the game is used in many university computer science syllabi to provide students with an appreciation of the abilities of reinforcement learning.
The video game's algorithm can be described as a form of reinforcement learning. The grid where the Pac-Man eats pellets while avoiding ghosts is its environment. A positive value is assigned for certain outcomes, such as finishing a level; a negative value is given for others, such as being eaten by Blinky, Pinky, Inky, or Clyde.
Given enough repetition and some help from a well-designed deep-q network algorithm, reinforcement learning can sort through an almost infinite number of pixel combinations to achieve the desired outcome -- in this case, being consumed by a red, pink, cyan, or orange blob.
