How We’re Fooled By Statistics

Channel:Veritasium · Length:7:37 · Published:2013-11-23 · Views:3850458

Watch on YouTube

Summary

A short Veritasium video explaining regression to the mean and how ignoring it leads to wrong conclusions about punishment versus reward, medical treatments and sports streaks. It uses the example of flight instructors who believed criticism works better than praise.

Why HN recommends it

HN commenters link it as the clearest short explanation of regression to the mean, especially for how it misleads people about feedback and statistics.

Veritasium explains it better than me. — HN, 2015

Data science & statistics · Psychology & human behavior

Subtitles (excerpt)

Which is most effective for helping people learn: punishment or reward? Well, consider the case of Israeli fighter pilot training, because instructors there found that negative feedback was far superior to positive feedback. If a cadet performed a particularly poor maneuver they would reprimand him. But they noticed that on follow up attempts, his performance invariably improved. In contrast, if they praised a cadet for executing a skillful maneuver, his performance on subsequent attempts typically declined. So naturally they concluded that positive feedback is ineffective or even detrimental whereas negative feedback is what works. The problem is this seems to contradict a body of research that shows positive feedback is actually more effective than negative feedback. For example, in studies involving teachers it was found that if a teacher increase the ratio of positive feedback to negative feedback, that actually increases the percentage of times students spend on task. In another study rugby players were given a video feedback session following a game, except half of them were shown their highlights and they were praised for what they had done and the other half were shown their biggest blunders, their mistakes.

On Hacker News

Or perhaps it's just the old phrase "Lies, damned lies, and statistics" that is appropriate once again? Veritasium explains it better than me. Please watch [VIDEO] — np422, 2015-03
> results are so obviously and immediately measurable Ehm… not really – especially not the "obviously" part :) Controlled or even abusive coaching can sometimes lead to better short-term results, but often at the cost of athletes’ mental health and long-term performance. What’s worse, coaching culture in many countries falls victim to the "regression to the mean" fallacy. I’m sure HN readers are … — divan, 2025-04
>Recognizing people's successes and what they are doing well is a 1000% more effective than harping on what people have messed up Yes, this is (verifiably) true. One must be aware, however, that positive feedback is usually going to be ineffective, thanks to natural "regression to the mean" effects, elucidated wonderfully in this Veritasium video[1]. (The point, in the end though, is that perform… — javajosh, 2014-08
is that actually the case? [are model weights being published less frequently?] It sure feels like it. But it could be survivorship bias: [LINK] or regression to the mean: [VIDEO] . It's possible that StyleGAN and GPT-2 just happened to coincide, and both companies just happened to decide to release their models rather than hoard them, and that the usual case is for companies to rarely (if ever) … — sillysaurusx, 2021-05

Related videos