Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGI | Lex Fridman Podcast #333

Channel:Lex Fridman · Length:3:28:47 · Published:2022-10-29 · Views:3970003

Watch on YouTube

Summary

Lex Fridman's long conversation with Andrej Karpathy on Tesla's self-driving approach, Optimus, neural networks, transformers, AGI and more. It also touches on his OpenAI work and working with Elon Musk.

Why HN recommends it

Cited for Karpathy's first-hand explanations of camera-only self-driving, transformers and ML trends.

Anyone seriously interested in this question should listen to the Lex Friedman interview of Andrej Karpathy — HN, 2023

Machine learning & deep learning · AI safety, AGI & impact · Self-driving & autonomous vehicles

Subtitles (excerpt)

- I think it's possible that physics has exploits and we should be trying to find them. Arranging some kind of a crazy quantum mechanical system that somehow gives you buffer overflow, somehow gives you a rounding error in the floating point. Synthetic intelligence is kind of like the next stage of development. And I dunno where it leads to, at some point I suspect the universe is some kind of a puzzle. These synthetic AIs will uncover that puzzle and solve it. - The following is a conversation with Andrej Karpathy, previously the director of AI at Tesla. And before that, at OpenAi and Stanford. He is one of the greatest scientists, engineers, and educators in the history of artificial intelligence. This is the Lex Fridman Podcast. To support it, please check out our sponsors. And now, dear friends, here's Andrej Karpathy. What is a neural network and why does it seem to do such a surprisingly good job of learning? - What is a neural network? It's a mathematical abstraction of the brain. I would say that's how it was originally developed. At the end of the day, it's a mathematical expression and it's a fairly simple mathematical expression when you get down to it. It's basically a sequence of meter multipliers,

On Hacker News

Anyone seriously interested in this question should listen to the Lex Friedman interview of Andrej Karpathy: [VIDEO] — tdalaa, 2023-01
My understanding is the transformer layer in the LLM is basically doing something akin to message passing, it’s like a mini computer. In predicting the next word, it has to understand a lot about a lot of different kinds of topics My understanding is kinda fuzzy because I haven’t coded it up myself, but this was the takeaway I got from this explanation (starts at 36:21) [VIDEO] — meken, 2022-12
Andrej Karpathy was recently on Lex Fridman's podcast and covered this to some extent. He has the same perspective on this topic and expanded on it quite a bit. Great listen overall IMHO - [VIDEO] I like his idea of finding 0-days in physics. :) — jcims, 2022-11
The part that I always found difficult to square was not that Elon Musk towed this “no need for LiDAR” line so hard, but that Andrej Karpathy, who I generally consider a very reliable voice in this space, was also in strong agreement that cameras were all that was needed. Does anyone know if he still believes cameras is all you need? Edit: Here is a link to Karpathy discussing the trade-offs: [VI… — kamranjon, 2025-07
This, obviously, is one of the ongoing efforts and goals of Tesla AI, and the reason they collect so much data. There's some talk about it in the Lex Friedman podcast(s)[1]. [1] [VIDEO] — nomel, 2025-02

Related videos