Richard Sutton – Father of RL thinks LLMs are a dead end
Channel:Dwarkesh Patel · Length:1:07:09 · Published:2025-09-26 · Views:810088
Summary
Dwarkesh Patel interviews Richard Sutton, reinforcement learning pioneer, Turing Award winner and author of The Bitter Lesson. Sutton argues LLMs are a dead end because they cannot learn on the job, and that continual learning from experience will require a new architecture.
Why HN recommends it
HN commenters cite it as the serious skeptic's case against LLMs reaching general intelligence, usually in debates about whether scaling is enough.
Richard Sutton takes a different view in an interview with Dwarkesh Patel[2] — HN, 2025
Machine learning & deep learning · LLMs & generative AI · AI safety, AGI & impact
Subtitles (excerpt)
Today I'm chatting with Richard Sutton, who is one of the founding fathers of reinforcement learning and inventor of many of the main techniques used there, like TD learning and policy gradient methods. For that, he received this year's Turing Award which, if you don’t know, is the Nobel Prize for computer science. Richard, congratulations. Thank you, Dwarkesh. Thanks for coming on the podcast. It's my pleasure. First question. My audience and I are familiar with the LLM way of thinking about AI. Conceptually, what are we missing in terms of thinking about AI from the RL perspective? It's really quite a different point of view. It can easily get separated and lose the ability to talk to each other. Large language models have become such a big thing, generative AI in general a big thing. Our field is subject to bandwagons and fashions, so we lose track of the basic things. I consider reinforcement learning to be basic AI. What is intelligence? The problem is to understand your world. Reinforcement learning is about understanding your world, whereas large language models are about mimicking people, doing what people say you should do. They're not about figuring out what to do. You would think that to emulate the trillions
On Hacker News
Google's definition is sufficient[0]. I'd also go so far as to say that LLMs aren't even AI, but that can be a bit pedantic. I align with Richard Sutton's reasoning, in that LLMs (and GPT models more generally) aren't "intelligent" in the same way that RL models are[1]. [0] - [LINK] [1] - [VIDEO] — solumos, 2026-07
This is basically the entire argument by Richard Sutton happening in real time: [VIDEO] Right now, we keep creating new models with larger and larger weights and throwing hardware at it. His argument is that this is a dead end and ultimately we'll eventually go back to purpose fit algorithms like we've always done in the history of AI development. — mbesto, 2026-07
I think they are not actually intelligent. Fix all random seeds and other sources of randomness, and try the same prompt twice, and check how intelligent that looks, as a first approximation. On a more technical level very serious people have voiced doubts, for example Richard Sutton in an interview with Dwarkash Patel [1]. [1] [VIDEO] — kbrkbr, 2026-05
Geoffrey Hinton's recent lecture at the Royal Institute[1] is a fascinating watch. His assertion that human use of language being exactly analogous to neural networks with back-propagation really made me think about what LLMs might be able to do, and indeed, what happens in me when I "think". A common objection to LLM "intelligence" is that "they don't know anything". But in turn... what do biolo… — j1mr10rd4n, 2025-11
Rich Sutton, the guy behind both "reinforcement learning" & "the Bitter Lesson", muses that Tech needs to understand the Bitter Lesson better: [LINK] Longer analysis: [VIDEO] To (try and) summarize those in the context of TFA: builders need to distinguish between policy optimisations and program optimisations I guess a related question to ask (important for both startups and Big Tech) might be: "… — gsf_emergency_4, 2025-10
Related videos
- The spelled-out intro to neural networks and backpropagation: building micrograd · Andrej Karpathy · 2:25:52
- But what is a neural network? | Deep learning chapter 1 · 3Blue1Brown · 18:40
- What Happened to Horses Is Happening to Us · CGP Grey · 15:00
- AlphaGo - The Movie | Full award-winning documentary · Google DeepMind · 1:30:28
- Transformers, the tech behind LLMs | Deep Learning Chapter 5 · 3Blue1Brown · 27:14
- USENIX Security '18-Q: Why Do Keynote Speakers Keep Suggesting That Improving Security Is Possible? · USENIX · 51:22
- Lecture 1 | Machine Learning (Stanford) · Stanford · 1:08:40
- MarI/O - Machine Learning for Video Games · SethBling · 5:57
- Deep Dive into LLMs like ChatGPT · Andrej Karpathy · 3:31:23
- Computer program that learns to play classic NES games · suckerpinch · 16:17
- RL Course by David Silver - Lecture 1: Introduction to Reinforcement Learning · Google DeepMind · 1:28:12
- Let's build GPT: from scratch, in code, spelled out. · Andrej Karpathy · 1:56:20
- Bay Area Vision Meeting: Unsupervised Feature Learning and Deep Learning · Google TechTalks · 48:10
- A Hackers' Guide to Language Models · Jeremy Howard · 1:31:13
- Why Would AI Want to do Bad Things? Instrumental Convergence · Robert Miles AI Safety · 10:35
- Andrej Karpathy - AI for Full-Self Driving at Tesla · Matroid · 30:08