Why Can't AI Make Its Own Discoveries? — With Yann LeCun
Channel:Alex Kantrowitz · Length:59:23 · Published:2025-03-19 · Views:223521
Summary
Yann LeCun on the Big Technology Podcast discusses why current AI models cannot make discoveries despite their knowledge. He argues systems need abstract world models and also covers limits of AI research, investor expectations, and open source after DeepSeek.
Why HN recommends it
Pointed to as LeCun's argument for the limits of LLMs and the need for world models.
It's quite eye opening. — HN, 2026
Machine learning & deep learning · LLMs & generative AI · Tech pioneers & interviews
Subtitles (excerpt)
why has generative AI ingested all the world's knowledge but not been able to come up with scientific discoveries of its own and has it finally starting to understand the physical world we'll discuss it with meta Chief AI scientist and touring Award winner Yan laon welcome to Big technology podcast a show for cool-headed nuance conversation of the tech world and Beyond I'm Alex cans and I am thrilled to welcome Yan laon the chief AI scientist touring Award winner and a man known as The Godfather of AI to Big technology podcast Yan great to see you again welcome to the show pleasure to be here let's start with a question about scientific discovery and why AI has not been able to come up with it until this point this is coming from dwares Patel he asked it a couple months ago why do you make of the fact that AIS generative AI basically have the entire Corpus of human knowledge memorized and they haven't been able to make a single new connection that has led to Discovery whereas if even a moderately intelligent person had this much stuff memorized uh they would notice oh this thing causes this symptom this other thing causes this symptom there might be a medical cure here so shouldn't we be expecting that type that type of
On Hacker News
This is not an appeal to authority, but this video probably contains the answers to your questions if you are open minded about it [VIDEO] — qsera, 2026-04
In this podcast episode[0] he does talk about this kind of model and how it "learns about physics" through experience instead of just ingesting theorical material. It's quite eye opening. 0. [VIDEO] — Xunjin, 2026-03
What? The "article" is from anthropic, so I think they would know what they write about. Also, RL is an additional training process that does not negate that GPT / transformers are left-right autoencoders that are effectively next token predictors. [Why Can't AI Make Its Own Discoveries? — With Yann LeCun] ( [VIDEO] ) — mentalgear, 2025-03
Related videos
- Functional architecture - The pits of success - Mark Seemann · NDC Conferences · 1:00:10
- The spelled-out intro to neural networks and backpropagation: building micrograd · Andrej Karpathy · 2:25:52
- But what is a neural network? | Deep learning chapter 1 · 3Blue1Brown · 18:40
- Jim Simons (full length interview) - Numberphile · Numberphile2 · 1:00:43
- Steve Jobs Stanford Commencement Speech 2005 · JoshuaG · 14:34
- AlphaGo - The Movie | Full award-winning documentary · Google DeepMind · 1:30:28
- Transformers, the tech behind LLMs | Deep Learning Chapter 5 · 3Blue1Brown · 27:14
- Alan Kay - Normal Considered Harmful · powerfuloutlet · 1:07:26
- Growing a Language, by Guy Steele · Bill Pugh · 53:31
- USENIX Security '18-Q: Why Do Keynote Speakers Keep Suggesting That Improving Security Is Possible? · USENIX · 51:22
- A Philosophy of Software Design | John Ousterhout | Talks at Google · Talks at Google · 1:01:40
- "Uncle" Bob Martin - "The Future of Programming" · Paul Stringer's Mobile Tech · 1:18:21
- VCF East: Ken Thompson interviewed by Brian Kernighan · Vintage Computer Federation · 1:03:51
- Lecture 1 | Machine Learning (Stanford) · Stanford · 1:08:40
- Hamming, "You and Your Research" (June 6, 1995) · securitylectures · 44:02
- MarI/O - Machine Learning for Video Games · SethBling · 5:57