Andrej Karpathy - AI for Full-Self Driving at Tesla
Channel:Matroid · Length:30:08 · Published:2020-04-20 · Views:374189
Summary
Andrej Karpathy, then Tesla's head of AI, presents at ScaledML 2020 on how Tesla builds full self-driving using vision-based neural nets and fleet data collection. He covers training custom detectors and neural nets gradually replacing traditional code.
Why HN recommends it
HN repeatedly points to it as the best public technical overview of Tesla's FSD approach, used both to defend and to critique Tesla's progress.
I highly recommend watching head of AI at Tesla Andrej Karpathy's talk on their self driving architecture. — HN, 2021
Machine learning & deep learning · Self-driving & autonomous vehicles · Computer vision, speech & NLP
Subtitles (excerpt)
So, I'm very excited to be here to tell you a bit more about how we're scaling machine learning models, data, algorithms, and infrastructure at Tesla and what that looks like. Uh, so the rough outline of my talk is here. I'd like to first tell you a little bit about Tesla, Tesla Autopilot, what the feature set is, really what the problem statement is, what we're trying to address here. And then I'll tell you a bit about neural networks and what it takes to actually deploy them into production at scale and what that looks like for the team. And then I'll tell you a little bit more about some of the more recent neural networks that we have developed for the purposes of full self-driving. So, I'll go into that at the end. So, first a little bit about Tesla and Tesla Autopilot. So, as you may know, Tesla manufactures and sells electric vehicles. We have an a whole array of electric vehicles. Some of them are in the hands of customers or imminently to be in the hands of customers and some of them have only been announced. So, for example, we have the Model S, the Model 3, X, and Y. And then we've also announced the Cybertruck, the ATV, somewhat jokingly, the Roadster, and the Semi. And we have quite a few of these.
On Hacker News
You can learn about their systems by watching talks by Andrej Karpathy. As a robotics engineer interested in vision, their architecture is inspiring. This talk [1] is a good overview but each talk he gives is a little different so search for more if you want to know as much as possible. But the big thing is that their autonomy computer can be programmed to look for odd scenarios and send them bac… — TaylorAlexander, 2021-07
Removing the cameras may be a good idea, but note that their extensive fleet of camera-equipped vehicles is an important part of their potentially VERY lucrative self driving software development. EDIT: I highly recommend watching head of AI at Tesla Andrej Karpathy's talk on their self driving architecture. "The Fleet" as a source of data is a vital functional part of their self driving software… — TaylorAlexander, 2021-01
If you actually believe that Tesla will fail to deliver full self-driving in the coming years, I have two questions. 1. have you watched this entire technical presentation made by Andrej Karpathy, Senior Director of AI at Tesla? [VIDEO] 2. if you understand what you've seen in that video, why do you think Tesla will fail? — maxharris, 2020-07
This is anti-Tesla astroturfing, so I flagged it. If you'd like a high-level technical overview of Tesla's FSD efforts, check out this talk by Andrej Karpathy from February 2020: [VIDEO] There are literally thousands of videos of people filming the FSD beta doing amazing things. They are making great progress very, very quickly: [LINK] As you can see from videos like the one above, real-world dat… — maxharris, 2021-02
It's not the same: [VIDEO] You can watch that talk and see the approach they're taking. Maybe you're more skeptical than they are about the near term possibility, but you can see that the work and progress is real. The AGI risk is real too. What Milton said doesn't make semantic sense, it's not a question of timelines. [LINK] — fossuser, 2020-09
Related videos
- Breakthrough in Nuclear Fusion? - Prof. Dennis Whyte · MIT Club of Northern California · 1:38:48
- Why This Channel Exists (and why I hate Houston) · Not Just Bikes · 17:02
- Dr. Michael Greger | How Not To Die | Talks at Google · Talks at Google · 1:21:13
- Contrepreneurs: The Mikkelsen Twins · Folding Ideas · 1:15:37
- Evidence-Based Weight Loss: Live Presentation · NutritionFacts.org · 1:00:16
- Longer-lasting light bulbs: it was complicated · Technology Connections · 33:33
- FoodGate: The Break-in, the Cover-up, & the Aftermath · University of California Television (UCTV) · 1:28:31
- ADHD: Essential Ideas for Parents - Dr. Russell Barkely · ADHDtips · 2:51:43
- Veritasium: A Story of YouTube Propaganda · Tom Nicholas · 51:36
- Why Grocery Shopping is Better in Amsterdam · Not Just Bikes · 3:46
- How close is nuclear fusion power? · Sabine Hossenfelder · 12:49
- Noam Chomsky - Manufacturing Consent · Chomsky's Philosophy · 9:04
- Keynote by John Carmack at Oculus Connect 2014 · kungfl · 1:36:59
- Susan Crawford on Captive Audience: The Telecom Industry & Monopoly Power in the New Gilded Age · Berkman Klein Center for Internet & Society · 1:05:24
- Hacking at Quantum Speed with Shor's Algorithm | Infinite Series · PBS Infinite Series · 16:36
- The effects of DBS on the motor symptoms of Parkinson's Disease · Andrew Johnson · 4:03
- Pranks Destroy Scam Callers- GlitterBomb Payback · Mark Rober · 26:40
- Tesla Autonomy Day · Tesla · 3:52:20
- Bret Victor - Inventing on Principle · Rui Oliveira · 54:20
- Alexander Pope Wrote a 35-Page Takedown of a Historian · CGP Grey · 21:32