Andrej Karpathy - AI for Full-Self Driving at Tesla

Channel:Matroid · Length:30:08 · Published:2020-04-20 · Views:374189

Watch on YouTube

Summary

Andrej Karpathy, then Tesla's head of AI, presents at ScaledML 2020 on how Tesla builds full self-driving using vision-based neural nets and fleet data collection. He covers training custom detectors and neural nets gradually replacing traditional code.

Why HN recommends it

HN repeatedly points to it as the best public technical overview of Tesla's FSD approach, used both to defend and to critique Tesla's progress.

I highly recommend watching head of AI at Tesla Andrej Karpathy's talk on their self driving architecture. — HN, 2021

Machine learning & deep learning · Self-driving & autonomous vehicles · Computer vision, speech & NLP

Subtitles (excerpt)

So, I'm very excited to be here to tell you a bit more about how we're scaling machine learning models, data, algorithms, and infrastructure at Tesla and what that looks like. Uh, so the rough outline of my talk is here. I'd like to first tell you a little bit about Tesla, Tesla Autopilot, what the feature set is, really what the problem statement is, what we're trying to address here. And then I'll tell you a bit about neural networks and what it takes to actually deploy them into production at scale and what that looks like for the team. And then I'll tell you a little bit more about some of the more recent neural networks that we have developed for the purposes of full self-driving. So, I'll go into that at the end. So, first a little bit about Tesla and Tesla Autopilot. So, as you may know, Tesla manufactures and sells electric vehicles. We have an a whole array of electric vehicles. Some of them are in the hands of customers or imminently to be in the hands of customers and some of them have only been announced. So, for example, we have the Model S, the Model 3, X, and Y. And then we've also announced the Cybertruck, the ATV, somewhat jokingly, the Roadster, and the Semi. And we have quite a few of these.

On Hacker News

You can learn about their systems by watching talks by Andrej Karpathy. As a robotics engineer interested in vision, their architecture is inspiring. This talk [1] is a good overview but each talk he gives is a little different so search for more if you want to know as much as possible. But the big thing is that their autonomy computer can be programmed to look for odd scenarios and send them bac… — TaylorAlexander, 2021-07
Removing the cameras may be a good idea, but note that their extensive fleet of camera-equipped vehicles is an important part of their potentially VERY lucrative self driving software development. EDIT: I highly recommend watching head of AI at Tesla Andrej Karpathy's talk on their self driving architecture. "The Fleet" as a source of data is a vital functional part of their self driving software… — TaylorAlexander, 2021-01
If you actually believe that Tesla will fail to deliver full self-driving in the coming years, I have two questions. 1. have you watched this entire technical presentation made by Andrej Karpathy, Senior Director of AI at Tesla? [VIDEO] 2. if you understand what you've seen in that video, why do you think Tesla will fail? — maxharris, 2020-07
This is anti-Tesla astroturfing, so I flagged it. If you'd like a high-level technical overview of Tesla's FSD efforts, check out this talk by Andrej Karpathy from February 2020: [VIDEO] There are literally thousands of videos of people filming the FSD beta doing amazing things. They are making great progress very, very quickly: [LINK] As you can see from videos like the one above, real-world dat… — maxharris, 2021-02
It's not the same: [VIDEO] You can watch that talk and see the approach they're taking. Maybe you're more skeptical than they are about the near term possibility, but you can see that the work and progress is real. The AGI risk is real too. What Milton said doesn't make semantic sense, it's not a question of timelines. [LINK] — fossuser, 2020-09

Related videos