The Skinner Box - How Games Condition People to Play More - Extra Credits
Channel:Extra Credits · Length:6:57 · Published:2012-03-13 · Views:1180182
Summary
An Extra Credits episode on how games use Skinner box operant conditioning and reward schedules to keep players playing and spending. It argues for more immersive design mechanics than simple reward loops.
Why HN recommends it
HN points to it as a short source on operant conditioning in games, loot boxes and engagement loops, with design alternatives.
Extra Credits has a nice overview, which includes a few design suggestions — HN, 2015
Psychology & human behavior · Game design
Subtitles (excerpt)
In the early 1930s a man named Burrhus Frederic Skinner began to study psychology in a radical new way. See, before him we only knew how to condition reactions; we could condition a person to be terrified of pumpkins or hungry at the sight of office supplies. But Skinner theorized that you could go one further. He theorized that you could condition volition—that you could change the way that people make choices So why are we talking about it? Because a vast number of today's games are built upon Skinner's discoveries, and it's starting to become a bad habit. But, before I get ahead of myself, let's take a closer look at what Skinner did. Skinner created a machine: a simple box with a button in it that he would put pigeons in. When the pigeons pecked at the button the machine would give them food. He then hooked the box up to a recording device so he could tell how often the pigeons pecked the button. Seems simple enough, so: why was this so groundbreaking? Because pecking the button is active. This wasn't just an automatic reaction to stimuli, it involved making a decision. So if Skinner could show that he could consistently change how often the pigeons peck the button, he could show that he could condition them to make a specific choice.
On Hacker News
Take a look at this video [1] for explanation, and possibly other Extra Credits videos if you're interested in game design. [1]: [VIDEO] — glogla, 2017-09
> time slips away It doesn't help that many modern games explicitly use Operant Conditioning to keep people playing. MMOs and "free to play" games are notorious, but you will find Skinner Boxes in a lot of modern games. Extra Credits has a nice overview, which includes a few design suggestions which games can use instead of hooking players with a reward schedule. [VIDEO] Also, it's not just games… — pdkl95, 2015-09
These days though, monetization frequently means vastly inferior games make way, way more money. To an algorithm, or a metric, even miserable feeling variable schedule or reward addiction looks like "engagement." So if there's "engagement" and money, why should companies do anything different? [VIDEO] So how is it that games which have "art" don't come along, charge a bit less money, and win in t… — stcredzero, 2019-02
> A workaround would be for EA to simply officially sell the game's "coins" Preventing this kind of workaround is already part of many gambling laws. They usually define the payment/stake/wager as a very generic term like "anything of value". For example, in NV (as a stereotypical representation of a locale allows gambling), the law defines[1]: >> “Representative of value” means any instrumentali… — pdkl95, 2018-09
It was a long time ago and I wish I was less foggy on the details but I read this comment on Reddit by a purported neuroscientist or some such who was talking about how we don't actually enjoy social media. They described basically what you've said. We take the actions and get the tiny reward and our brain gets a little jolt of there you did it but when it comes right down to it we don't actually… — YCode, 2017-03
Related videos
- Gender Neutral Pronouns: They're Here, Get Used To Them · Tom Scott · 3:48
- BlueHat IL 2019 - Andrew "bunnie" Huang - Supply Chain Security: "If I were a Nation State...” · Microsoft Israel R&D Center · 45:37
- But what is the Fourier Transform? A visual introduction. · 3Blue1Brown · 19:41
- Cybersecurity as Realpolitik by Dan Geer presented at Black Hat USA 2014 · Black Hat · 54:35
- Mark Blyth ─ Global Trumpism · Watson School of International and Public Affairs · 1:26:03
- Chernobyl 3828 · TeleconStudio · 26:57
- Flat Earth: A Measured Response · hbomberguy · 45:17
- TasBlock at AGDQ 2017: TASBot · TASVideosChannel · 58:44
- George Lakoff: Moral Politics · University of California Television (UCTV) · 58:57
- Tom Lehrer - Wernher von Braun · The Tom Lehrer Wisdom Channel · 1:46
- Congressional Fundraising: Last Week Tonight with John Oliver (HBO) · LastWeekTonight · 21:25
- DCEmu Reviews - 27C3 - Chaos Communication Congress 2010 - fail0verflow - FULL VIDEO · 1KIND Reviews · 44:39
- They're Made Out of Meat · niccollsdp · 6:16
- Hovering a Helicopter is Hilariously Hard - Smarter Every Day 145 · SmarterEveryDay · 9:45
- Data | Philosophy Tube · Philosophy Tube · 26:14
- The Alt-Right Playbook: Control the Conversation · Innuendo Studios · 10:47
- Super Mario World -- Credits Warp in 5:59.6 (First Time Ever on Console) · SethBling · 9:00
- Deadly Truth of General AI? - Computerphile · Computerphile · 8:30
- Velocity NY 2013: Richard Cook, "Resilience In Complex Adaptive Systems" · O'Reilly · 19:09
- The more general uncertainty principle, regarding Fourier transforms · 3Blue1Brown · 18:06