Tesla AI Day 2021
Channel:Tesla · Length:3:03:20 · Published:2021-08-20 · Views:2582362
Summary
Tesla's 2021 AI Day presentation covering vision, planning and control, auto-labeling, simulation, the Dojo training hardware and the Tesla Bot announcement, followed by a Q&A.
Why HN recommends it
Treated as a primary source on how Tesla builds its self-driving stack, cited by timestamp for transformers, synthetic data, Dojo and the humanoid bot.
Here's Tesla's AI day presentation on how they are going to use AI in their planning system — HN, 2021
Machine learning & deep learning · Robotics · Self-driving & autonomous vehicles
Subtitles (excerpt)
[Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Applause] [Music] [Applause] [Music] [Music] [Music] so [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] i'm not the man you want you've made a mistake i'm in touch with technological advances pretty well everywhere and i can tell you that no one has produced anything like this [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] so [Music] [Music] [Music] oh [Music] so [Music] wow [Music] [Music] armed do [Music] [Music] i'm um armed [Music] [Music] so [Music] [Music] [Music] [Music] [Music] [Music] so [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Applause] [Music] so [Music] so [Music] [Applause] [Music] [Applause] [Music] [Music] so [Music] [Music] so [Music] [Music] so [Music] so [Music] [Music] [Music] [Music] so [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] i'm not the man you want you've made a i'm in touch with mistake advisors pretty well everywhere and i can tell you that no one has produced anything like this
On Hacker News
I spent time working with Andrej and the rest of the FSD team back in 2020/2021, and we had plenty of conversations on how human visual processing maps onto our neural network architectures. Our approach—transformer-based attention blocks, multi-scale feature extraction, and temporal fusion—mirrors elements of the biological visual cortex (retina → LGN → V1 → V2 → V4 → IT) which break down raw in… — gzer0, 2025-01
I believe Tesla uses synthetic data for FSD/Autopilot training as well. Not sure what's the ratio between synthetic data and real videos, but it seems that they plan to rely more onto the first group in the future. [VIDEO] — yreg, 2023-04
Machine Learning and Neural Networks are not applicable for solving all kinds of problems. In fact, in Tesla AI Day Elon Musk remarked that "I discourage the use of machine learning... unless you have to use machine learning, don't do it" [1]. Getting machine learning to work right is hard. If it can be avoided it should be. So to cast this as Software 1.0 vs 2.0 doesn't make sense. There is a cl… — petilon, 2023-02
The Tesla AI day videos [1] go into some detail about this. They use multiple networks that are dedicated to specific tasks. [1] [VIDEO] (2021), [LINK] (2022) — 113245, 2022-10
[LINK] This is a rather intuitive mathematical proof that neural nets can emulate all functions in many dimensions. Knowing integrals (Calc 102) would help. With this information it’s either that self-driving is eventually possible or human brains are not mathematically representable (i.e. something akin to a soul). Meanwhile, the data collection/storage is getting better (all Teslas are continua… — yazaddaruvala, 2022-03
Related videos
- The spelled-out intro to neural networks and backpropagation: building micrograd · Andrej Karpathy · 2:25:52
- But what is a neural network? | Deep learning chapter 1 · 3Blue1Brown · 18:40
- How Self-Driving Cars will Destroy Cities (and what to do about it) · Not Just Bikes · 54:37
- What Happened to Horses Is Happening to Us · CGP Grey · 15:00
- AlphaGo - The Movie | Full award-winning documentary · Google DeepMind · 1:30:28
- Transformers, the tech behind LLMs | Deep Learning Chapter 5 · 3Blue1Brown · 27:14
- USENIX Security '18-Q: Why Do Keynote Speakers Keep Suggesting That Improving Security Is Possible? · USENIX · 51:22
- Lecture 1 | Machine Learning (Stanford) · Stanford · 1:08:40
- MarI/O - Machine Learning for Video Games · SethBling · 5:57
- Deep Dive into LLMs like ChatGPT · Andrej Karpathy · 3:31:23
- Computer program that learns to play classic NES games · suckerpinch · 16:17
- RL Course by David Silver - Lecture 1: Introduction to Reinforcement Learning · Google DeepMind · 1:28:12
- Let's build GPT: from scratch, in code, spelled out. · Andrej Karpathy · 1:56:20
- Bay Area Vision Meeting: Unsupervised Feature Learning and Deep Learning · Google TechTalks · 48:10
- A Hackers' Guide to Language Models · Jeremy Howard · 1:31:13
- Google Self-Driving Car Project | SXSW Interactive 2016 · SXSW · 52:21