Jim Keller - Moore's Law in the age of AI Chips
Channel:Matroid · Length:31:05 · Published:2020-04-20 · Views:33363
Summary
Jim Keller's talk at the 2020 Scaled Machine Learning conference on Moore's Law in the age of AI chips. He compares scalar, vector and GPU-style parallel approaches to computation.
Why HN recommends it
Cited in hardware threads as a Keller talk on the different ways of doing parallel processing.
Jim Keller had an interesting talk recently [1] about ways of doing parallel processing — HN, 2020
Machine learning & deep learning · Computer architecture & CPUs · Tech pioneers & interviews
Subtitles (excerpt)
they actually didn't tell me I was talking about AI chips until I was news to me that's gonna be fun and I didn't tell them the title so I got told yesterday they printed it up as TBD and I thought that was a really good title and then it's morning I found out it was to be announced so I'm catching up here I got I'll do the best I can but everybody knows what TBD means right to be determined right and I've been talking about Moore's law and read the Tesla's with me she gave a talk on technical technology optimism because a lots of people think for for complicated reasons that there's a complexity wall Moore's laws dead we can't scale and I gave a talk at Berkeley and the professor's all asked me can you convince people that there's future and computer science and transistors so they'll stop wasting all their time on AI software and because well if somebody says by the way Moore's law is dead and computer architecture innovation is over and you're a college student you're gonna go into that like it's not gonna happen but it's really a funny space so when we tell you a little story and then at some point I hope to make fun of everybody so everybody ready for that I did know I was the slot after the slide of lunch but I found out on the first one so I'm the
On Hacker News
Jim Keller had an interesting talk recently [1] about ways of doing parallel processing to better us the billions of transistors we have - assuming the task is parallelizable. There's the scalar core (i.e the basic CPU) which is easy to program realtively. Then a scalar core with vector instructions - difficult to program efficiently. Then there are arrays of scalar cores, i.e. GPUs, so relativel… — tails4e, 2020-07
The pattern of holes technique in that link (MURA) is also used in UV lithography for IC fabrication (example: [VIDEO] ). — metrognome, 2020-12
Jim Keller giving a talk on Moore's Law at Berkeley, [LINK] And another [VIDEO] And another [LINK] DEC, PA Semi, Apple, AMD, Tesla, Intel. He's been everywhere. [LINK] The internal announcement memo: [LINK] — CalChris, 2020-06
What makes this more bizarre than Keller’s typical short stints at previous companies is that he has done a ton of media in the last year. He’s probably given more time to journalists/interviewers in 2020 than in the previous 3 decades of his career combined. A Fortune piece from May of this year gave some insights into his plans (as well as provided a nice overview of his career) ( [LINK] ). > K… — cepth, 2020-06
Related videos
- Imaginary Numbers Are Real [Part 1: Introduction] · Welch Labs · 5:47
- The spelled-out intro to neural networks and backpropagation: building micrograd · Andrej Karpathy · 2:25:52
- But what is a neural network? | Deep learning chapter 1 · 3Blue1Brown · 18:40
- 8-bit computer update · Ben Eater · 6:53
- Jim Simons (full length interview) - Numberphile · Numberphile2 · 1:00:43
- Light Years Ahead | The 1969 Apollo Guidance Computer · TNMoC · 1:21:22
- Steve Jobs Stanford Commencement Speech 2005 · JoshuaG · 14:34
- “Hello, world” from scratch on a 6502 — Part 1 · Ben Eater · 27:24
- AlphaGo - The Movie | Full award-winning documentary · Google DeepMind · 1:30:28
- Transformers, the tech behind LLMs | Deep Learning Chapter 5 · 3Blue1Brown · 27:14
- Finding the Missing Memristor - R. Stanley Williams · The Qualcomm Institute · 47:52
- Alan Kay - Normal Considered Harmful · powerfuloutlet · 1:07:26
- The Ultimate Game Boy Talk (33c3) · media.ccc.de · 1:01:06
- Growing a Language, by Guy Steele · Bill Pugh · 53:31
- USENIX Security '18-Q: Why Do Keynote Speakers Keep Suggesting That Improving Security Is Possible? · USENIX · 51:22
- A Philosophy of Software Design | John Ousterhout | Talks at Google · Talks at Google · 1:01:40