But what are Hamming codes? The origin of error correction

Channel:3Blue1Brown · Length:20:05 · Published:2020-09-04 · Views:3073710

Watch on YouTube

Summary

3Blue1Brown's discovery-oriented introduction to error correction codes, building up Hamming codes from the puzzle of locating a flipped bit. It explains the parity-check idea and why it is so efficient.

Why HN recommends it

HN recommends it as an invaluable, intuitive explanation of Hamming codes that pairs well with hardware-oriented treatments.

I would strongly recommend anyone interested in the topic to check out any of these videos — HN, 2022

Recreational & visual math · Information theory & signal processing

Subtitles (excerpt)

Have you ever wondered how it's possible to scratch a CD or a DVD and still have it play back whatever it's storing? The scratch really does affect the 1s and 0s on the disk, so it reads off different data from what was stored, but unless it's really scratched up, the bits it reads off are decoded into precisely the same file that was encoded onto it, a bit for bit copy, despite all those errors. There is a whole pile of mathematical cleverness that allows us to store data, and just as importantly to transmit data, in a way that's resilient to errors. Well, okay, actually it doesn't take that much cleverness to come up with a way to do this. Any file, whether it's a video or sound or text, some code, an image, whatever, is ultimately some sequence of 1s and 0s. And a simple strategy to correct any bit that gets flipped would be to store three copies of each bit. Then the machine reading this file could compare these three copies and always take the best 2 out of 3 whenever there's a discrepancy. But what that means is using two thirds of your space for redundancy. And even then, for all of that space given up, there's no strong guarantee about what happens if more than one bit gets flipped.

On Hacker News

To understand how error correction works and to learn more about Hamming codes & Reed-Solomon, 3Blue1Brown and Ben Eater were invaluable. 3Blue1Brown and Ben Eater are by far some of the best educational content creators within their fields, mathematics and computer engineering respectively. I would strongly recommend anyone interested in the topic to check out any of these videos: How to send a … — Hanschri, 2022-11
If you want to learn more about Hamming Codes from a mathematical perspective, I recommend 3Blue1Brown's YouTube series: > How to send a self-correcting message (Hamming codes) - [VIDEO] > Hamming codes part 2, the elegance of it all - [LINK] Associated with Ben Eater's video, if you want a perspective regarding low level computer hardware: > What is error correction? Hamming codes in hardware - … — WaffleIronMaker, 2023-08
I'm a big fan of this video from Reducible on Huffman codes: [LINK] , and from 3Blue1Brown on Hamming codes: [VIDEO] — adamisntdead, 2021-09
Nice! pairs well with the 3Blue1Br video on the subject: [VIDEO] Hamming's book The Art of doing Science and Engineer's a solid read. Mixed topics, centered around problem solving techniques, and pitfalls. — the__alchemist, 2020-09

Related videos