How We’re Fooled By Statistics
Channel:Veritasium · Length:7:37 · Published:2013-11-23 · Views:3850458
Summary
A short Veritasium video explaining regression to the mean and how ignoring it leads to wrong conclusions about punishment versus reward, medical treatments and sports streaks. It uses the example of flight instructors who believed criticism works better than praise.
Why HN recommends it
HN commenters link it as the clearest short explanation of regression to the mean, especially for how it misleads people about feedback and statistics.
Veritasium explains it better than me. — HN, 2015
Data science & statistics · Psychology & human behavior
Subtitles (excerpt)
Which is most effective for helping people learn: punishment or reward? Well, consider the case of Israeli fighter pilot training, because instructors there found that negative feedback was far superior to positive feedback. If a cadet performed a particularly poor maneuver they would reprimand him. But they noticed that on follow up attempts, his performance invariably improved. In contrast, if they praised a cadet for executing a skillful maneuver, his performance on subsequent attempts typically declined. So naturally they concluded that positive feedback is ineffective or even detrimental whereas negative feedback is what works. The problem is this seems to contradict a body of research that shows positive feedback is actually more effective than negative feedback. For example, in studies involving teachers it was found that if a teacher increase the ratio of positive feedback to negative feedback, that actually increases the percentage of times students spend on task. In another study rugby players were given a video feedback session following a game, except half of them were shown their highlights and they were praised for what they had done and the other half were shown their biggest blunders, their mistakes.
On Hacker News
Or perhaps it's just the old phrase "Lies, damned lies, and statistics" that is appropriate once again? Veritasium explains it better than me. Please watch [VIDEO] — np422, 2015-03
> results are so obviously and immediately measurable Ehm… not really – especially not the "obviously" part :) Controlled or even abusive coaching can sometimes lead to better short-term results, but often at the cost of athletes’ mental health and long-term performance. What’s worse, coaching culture in many countries falls victim to the "regression to the mean" fallacy. I’m sure HN readers are … — divan, 2025-04
>Recognizing people's successes and what they are doing well is a 1000% more effective than harping on what people have messed up Yes, this is (verifiably) true. One must be aware, however, that positive feedback is usually going to be ineffective, thanks to natural "regression to the mean" effects, elucidated wonderfully in this Veritasium video[1]. (The point, in the end though, is that perform… — javajosh, 2014-08
is that actually the case? [are model weights being published less frequently?] It sure feels like it. But it could be survivorship bias: [LINK] or regression to the mean: [VIDEO] . It's possible that StyleGAN and GPT-2 just happened to coincide, and both companies just happened to decide to release their models rather than hoard them, and that the usual case is for companies to rarely (if ever) … — sillysaurusx, 2021-05
Related videos
- Siggraph2019 Geometric Algebra · Bivector · 1:37:21
- Ferguson, MO and Police Militarization: Last Week Tonight with John Oliver (HBO) · LastWeekTonight · 15:10
- (405) Choosing a High Security Lock · Bill Johnson · 14:38
- "Performance Matters" by Emery Berger · Strange Loop Conference · 42:15
- CppCon 2019: Emery Berger “Mesh: Automatically Compacting Your C++ Application's Memory” · CppCon · 36:09
- 1. Introduction to Human Behavioral Biology · Stanford · 57:14
- Essential Ideas for Parents · Jason Salotti · 2:51:43
- A Better Default Colormap for Matplotlib | SciPy 2015 | Nathaniel Smith and Stéfan van der Walt · Enthought · 19:08
- The Century of the Self (Full Adam Curtis Documentary) · David Lessig · 3:54:44
- Randy Pausch's Last Lecture: Achieving Your Childhood Dreams · Carnegie Mellon University · 1:16:27
- Alain de Botton: Status Anxiety · Alain de Botton · 2:23:07
- Controlling Your Dopamine For Motivation, Focus & Satisfaction · Andrew Huberman · 2:16:31
- The Century of the Self - Part 1: "Happiness Machines" · JustAdamCurtis · 58:46
- RSA ANIMATE: Drive: The surprising truth about what motivates us · Royal Society of Arts · 10:48
- Why Being Delusional is a Superpower · Veritasium · 12:04
- Is Most Published Research Wrong? · Veritasium · 12:22