But what are Hamming codes? The origin of error correction
Channel:3Blue1Brown · Length:20:05 · Published:2020-09-04 · Views:3073710
Summary
3Blue1Brown's discovery-oriented introduction to error correction codes, building up Hamming codes from the puzzle of locating a flipped bit. It explains the parity-check idea and why it is so efficient.
Why HN recommends it
HN recommends it as an invaluable, intuitive explanation of Hamming codes that pairs well with hardware-oriented treatments.
I would strongly recommend anyone interested in the topic to check out any of these videos — HN, 2022
Recreational & visual math · Information theory & signal processing
Subtitles (excerpt)
Have you ever wondered how it's possible to scratch a CD or a DVD and still have it play back whatever it's storing? The scratch really does affect the 1s and 0s on the disk, so it reads off different data from what was stored, but unless it's really scratched up, the bits it reads off are decoded into precisely the same file that was encoded onto it, a bit for bit copy, despite all those errors. There is a whole pile of mathematical cleverness that allows us to store data, and just as importantly to transmit data, in a way that's resilient to errors. Well, okay, actually it doesn't take that much cleverness to come up with a way to do this. Any file, whether it's a video or sound or text, some code, an image, whatever, is ultimately some sequence of 1s and 0s. And a simple strategy to correct any bit that gets flipped would be to store three copies of each bit. Then the machine reading this file could compare these three copies and always take the best 2 out of 3 whenever there's a discrepancy. But what that means is using two thirds of your space for redundancy. And even then, for all of that space given up, there's no strong guarantee about what happens if more than one bit gets flipped.
On Hacker News
To understand how error correction works and to learn more about Hamming codes & Reed-Solomon, 3Blue1Brown and Ben Eater were invaluable. 3Blue1Brown and Ben Eater are by far some of the best educational content creators within their fields, mathematics and computer engineering respectively. I would strongly recommend anyone interested in the topic to check out any of these videos: How to send a … — Hanschri, 2022-11
If you want to learn more about Hamming Codes from a mathematical perspective, I recommend 3Blue1Brown's YouTube series: > How to send a self-correcting message (Hamming codes) - [VIDEO] > Hamming codes part 2, the elegance of it all - [LINK] Associated with Ben Eater's video, if you want a perspective regarding low level computer hardware: > What is error correction? Hamming codes in hardware - … — WaffleIronMaker, 2023-08
I'm a big fan of this video from Reducible on Huffman codes: [LINK] , and from 3Blue1Brown on Hamming codes: [VIDEO] — adamisntdead, 2021-09
Nice! pairs well with the 3Blue1Br video on the subject: [VIDEO] Hamming's book The Art of doing Science and Engineer's a solid read. Mixed topics, centered around problem solving techniques, and pitfalls. — the__alchemist, 2020-09
Related videos
- Hacking at Quantum Speed with Shor's Algorithm | Infinite Series · PBS Infinite Series · 16:36
- The Mathematics of Quantum Computers | Infinite Series · PBS Infinite Series · 12:35
- Using a 1930 Teletype as a Linux Terminal · CuriousMarc · 16:33
- The Art of Code - Dylan Beattie · NDC Conferences · 1:00:48
- Line Goes Up – The Problem With NFTs · Folding Ideas · 2:18:23
- Talk: Video Games and the Future of Education · Jonathan Blow · 2:44:28
- The Fastest Way to Board a Plane Feels Like the Slowest · CGP Grey · 8:27
- Vectors | Chapter 1, Essence of linear algebra · 3Blue1Brown · 9:51
- But what is the Fourier Transform? A visual introduction. · 3Blue1Brown · 19:41
- But what is a neural network? | Deep learning chapter 1 · 3Blue1Brown · 18:40
- The Beauty of Bézier Curves · Freya Holmér · 24:25
- D/A and A/D | Digital Show and Tell (Monty Montgomery @ xiph.org) · FL Studio · 23:52
- The Continuity of Splines · Freya Holmér · 1:13:50
- Jim Simons (full length interview) - Numberphile · Numberphile2 · 1:00:43
- But how does bitcoin actually work? · 3Blue1Brown · 25:15
- Conway's Game Of Life in APL · Dyalog · 7:47