Autonomous Car - what goes into sensing for autonomous driving?
Channel:Mobileye · Length:35:30 · Published:2016-04-17 · Views:40041
Summary
Mobileye co-founder and CTO Amnon Shashua explains what goes into sensing for autonomous driving and whether end-to-end deep learning can work for it. He argues for decomposing the problem.
Why HN recommends it
Recommended as an accessible technical explanation of Mobileye's approach, and also cited in disputes over Tesla Autopilot.
Here is a great, very accessible video where the CTO of MobileEye — HN, 2016
Self-driving & autonomous vehicles · Computer vision, speech & NLP
Subtitles (excerpt)
I'll talk a bit about sensing today especially geared toward the autonomous driving but before I start I I put here on the slide kind of three pillars that are necessary to go from where we are today to a vehicle that can drive on its own safely and in an unlimited type of scenario including City traffic so the first is sensing talking about 360° awareness of sensors cameras around the cars Radars um and and laders all the information going into Computing devices and building an environmental model environmental model means tell me where all the moving objects are all the obstacles all the path Del limitors like barriers guardrails curbs all the drivable paths and the semantic meaning associated with each path for example this path is a Highway path that's one is going straight left or right all the pavement markings traffic signs traffic lights all the detailed the rich amount of information that we human drivers are used to absorb when we do uh driving so this is sensing the next element is is mapping the ability to provide redundant information to sensing about the driveable paths so once you locate yourself accurately inside the map you know where the drivable paths are and the camera tells you where the drivable paths are as well so you get redundancy second
On Hacker News
Here is a great, very accessible video where the CTO of MobileEye (which provides some of the components for Tesla's "autopilot") explains his views on the challenges of end-to-end learning for autonomous vehicles, and why it's preferable to decompose the problem instead (still using deep learning for the decomposed modules). [VIDEO] I'm inclined to agree, especially because it helps in 1) provid… — brianchu, 2016-05
Those are good points. Here's some backup. Here's Mobileeye's CTO talking in detail about their technology.[1] They use a a deep neural network that recognizes cars. Just cars. Look at this point in the video.[2] There's a stationary obstacle on the left, and it doesn't recognize that. Maybe this is why Tesla, using Mobileye hardware, plowed into three different stationary vehicles at the left of… — Animats, 2016-10
ugh, more ME noise. so ME has a lot of evidence that they are lying through their teeth, if they were so worried why let all the other brands do the hands free thing? [LINK] * ME boasting about their tech making hands free possible [VIDEO] — zeroecco, 2016-09
/r/TeslaMotors dug up this video[1] of MobilEye CEO talking about the Autopilot, so if they really disagreed with the usage of Autopilot, shouldn't they have brought that up prior, and not included it in promotional material. From all indications on their end, I believe that they said that the Tesla Autopilot shouldn't be driven hands-free. I have no qualms with that, but why then use the Autopil… — TheShadowRunner, 2016-09
Related videos
- How Self-Driving Cars will Destroy Cities (and what to do about it) · Not Just Bikes · 54:37
- Bay Area Vision Meeting: Unsupervised Feature Learning and Deep Learning · Google TechTalks · 48:10
- Google Self-Driving Car Project | SXSW Interactive 2016 · SXSW · 52:21
- "Voice Driven Development: Who needs a keyboard anyway?" by Emily Shea · Strange Loop Conference · 41:17
- Andrej Karpathy - AI for Full-Self Driving at Tesla · Matroid · 30:08
- Tensorflow and deep learning - without a PhD by Martin Görner · Devoxx · 2:35:53
- JPEG DCT, Discrete Cosine Transform (JPEG Pt2)- Computerphile · Computerphile · 15:11
- Fourier Optics used for Optical Pattern Recognition · Huygens Optics · 18:30
- George Hotz: Comma.ai, OpenPilot, and Autonomous Vehicles | Lex Fridman Podcast #31 · Lex Fridman · 1:59:36
- Traffic Has a Perfect Solution. Humans Are the Problem. · CGP Grey · 4:30
- Let's build the GPT Tokenizer · Andrej Karpathy · 2:13:34
- Massive-scale online collaboration | Luis von Ahn · TED · 16:40
- Breaking The Creepy AI in Police Cameras · Benn Jordan · 35:49
- !!Con 2017: HDR Photography in Microsoft Excel?! by Kevin Chen · Confreaks · 11:46
- Dasher: information-efficient text entry · Google TechTalks · 53:45
- LSTM is dead. Long Live Transformers! · Seattle Applied Deep Learning · 28:48