The Skinner Box - How Games Condition People to Play More - Extra Credits

Channel:Extra Credits · Length:6:57 · Published:2012-03-13 · Views:1180182

Watch on YouTube

Summary

An Extra Credits episode on how games use Skinner box operant conditioning and reward schedules to keep players playing and spending. It argues for more immersive design mechanics than simple reward loops.

Why HN recommends it

HN points to it as a short source on operant conditioning in games, loot boxes and engagement loops, with design alternatives.

Extra Credits has a nice overview, which includes a few design suggestions — HN, 2015

Psychology & human behavior · Game design

Subtitles (excerpt)

In the early 1930s a man named Burrhus Frederic Skinner began to study psychology in a radical new way. See, before him we only knew how to condition reactions; we could condition a person to be terrified of pumpkins or hungry at the sight of office supplies. But Skinner theorized that you could go one further. He theorized that you could condition volition—that you could change the way that people make choices So why are we talking about it? Because a vast number of today's games are built upon Skinner's discoveries, and it's starting to become a bad habit. But, before I get ahead of myself, let's take a closer look at what Skinner did. Skinner created a machine: a simple box with a button in it that he would put pigeons in. When the pigeons pecked at the button the machine would give them food. He then hooked the box up to a recording device so he could tell how often the pigeons pecked the button. Seems simple enough, so: why was this so groundbreaking? Because pecking the button is active. This wasn't just an automatic reaction to stimuli, it involved making a decision. So if Skinner could show that he could consistently change how often the pigeons peck the button, he could show that he could condition them to make a specific choice.

On Hacker News

Take a look at this video [1] for explanation, and possibly other Extra Credits videos if you're interested in game design. [1]: [VIDEO] — glogla, 2017-09
> time slips away It doesn't help that many modern games explicitly use Operant Conditioning to keep people playing. MMOs and "free to play" games are notorious, but you will find Skinner Boxes in a lot of modern games. Extra Credits has a nice overview, which includes a few design suggestions which games can use instead of hooking players with a reward schedule. [VIDEO] Also, it's not just games… — pdkl95, 2015-09
These days though, monetization frequently means vastly inferior games make way, way more money. To an algorithm, or a metric, even miserable feeling variable schedule or reward addiction looks like "engagement." So if there's "engagement" and money, why should companies do anything different? [VIDEO] So how is it that games which have "art" don't come along, charge a bit less money, and win in t… — stcredzero, 2019-02
> A workaround would be for EA to simply officially sell the game's "coins" Preventing this kind of workaround is already part of many gambling laws. They usually define the payment/stake/wager as a very generic term like "anything of value". For example, in NV (as a stereotypical representation of a locale allows gambling), the law defines[1]: >> “Representative of value” means any instrumentali… — pdkl95, 2018-09
It was a long time ago and I wish I was less foggy on the details but I read this comment on Reddit by a purported neuroscientist or some such who was talking about how we don't actually enjoy social media. They described basically what you've said. We take the actions and get the tiny reward and our brain gets a little jolt of there you did it but when it comes right down to it we don't actually… — YCode, 2017-03

Related videos