Future Computers Will Be Radically Different (Analog Computing)
Channel:Veritasium · Length:21:42 · Published:2022-03-01 · Views:13218543
Summary
Veritasium explains why analog computing may suit AI workloads, covering old analog computers, The Analog Thing and Mythic's analog chips that use flash memory for neural network inference. It argues digital hardware is hitting limits.
Why HN recommends it
Treated as the accessible reference on analog computing for neural nets, especially the Mythic AI segment.
Veritasium explains it really well in general here (and demos the device) — HN, 2024
Machine learning & deep learning · Computer architecture & CPUs · Scientific method & science communication
Subtitles (excerpt)
- For hundreds of years, analog computers were the most powerful computers on Earth, predicting eclipses, tides, and guiding anti-aircraft guns. Then, with the advent of solid-state transistors, digital computers took off. Now, virtually every computer we use is digital. But today, a perfect storm of factors is setting the scene for a resurgence of analog technology. This is an analog computer, and by connecting these wires in particular ways, I can program it to solve a whole range of differential equations. For example, this setup allows me to simulate a damped mass oscillating on a spring. So on the oscilloscope, you can actually see the position of the mass over time. And I can vary the damping, or the spring constant, or the mass, and we can see how the amplitude and duration of the oscillations change. Now what makes this an analog computer is that there are no zeros and ones in here. Instead, there's actually a voltage that oscillates up and down exactly like a mass on a spring. The electrical circuitry is an analog for the physical problem, it just takes place much faster. Now, if I change the electrical connections, I can program this computer to solve other differential equations, like the Lorenz system,
On Hacker News
Agreed. I've never really gotten into neural networks, most of the times I start but get distracted or bored/lost and suddenly enough a Vertiasium video pops up and about everything just slots into place, stuff you've glossed over or heard before just make sense. [VIDEO] . Start at minute 4:00. — iKlsR, 2022-03
I think they're saying analog computers could be the future of computing. Veritasium explains it really well in general here (and demos the device) [VIDEO] — sushid, 2024-11
Veritasium has a good video about analog computers. It covers how they work, what they are used for, pros and cons compared to digital, what they look like today, a bit of the history and their possible future. [VIDEO] — sholladay, 2024-08
I found this Veritasium video interesting, about a company that is paring down models so they fit on analog chips, so the chips can be used in self-contained devices. It also appears that quantum computers may be even better for matrix math that transformers rely on. If all these hardware advances pan out... [VIDEO] [LINK] — JieJie, 2023-03
Great Veritasium video on YouTube about analog neuromorphic architectures and their promise for lower-power operations: [VIDEO] — beambot, 2022-06
Related videos
- The Most Powerful Computers You've Never Heard Of · Veritasium · 20:12
- The Best Country in the World for Drivers · Not Just Bikes · 15:48
- The Biggest Misconception in Physics · Veritasium · 27:39
- 28c3: The coming war on general computation · 28c3 · 54:34
- The Ridiculous Engineering Of Jet Engines · Veritasium · 39:34
- Incels | ContraPoints · ContraPoints · 35:04
- The spelled-out intro to neural networks and backpropagation: building micrograd · Andrej Karpathy · 2:25:52
- The Quantum Conspiracy: What Popularizers of QM Don't Want You to Know · Google TechTalks · 1:03:43
- But what is a neural network? | Deep learning chapter 1 · 3Blue1Brown · 18:40
- 8-bit computer update · Ben Eater · 6:53
- Light Years Ahead | The 1969 Apollo Guidance Computer · TNMoC · 1:21:22
- “Hello, world” from scratch on a 6502 — Part 1 · Ben Eater · 27:24
- James Burke Connections, Ep. 1 "The Trigger Effect" · DRS_Education · 49:22
- AlphaGo - The Movie | Full award-winning documentary · Google DeepMind · 1:30:28
- Transformers, the tech behind LLMs | Deep Learning Chapter 5 · 3Blue1Brown · 27:14
- Finding the Missing Memristor - R. Stanley Williams · The Qualcomm Institute · 47:52