Richard Sutton – Father of RL thinks LLMs are a dead end

Channel:Dwarkesh Patel · Length:1:07:09 · Published:2025-09-26 · Views:810088

Watch on YouTube

Summary

Dwarkesh Patel interviews Richard Sutton, reinforcement learning pioneer, Turing Award winner and author of The Bitter Lesson. Sutton argues LLMs are a dead end because they cannot learn on the job, and that continual learning from experience will require a new architecture.

Why HN recommends it

HN commenters cite it as the serious skeptic's case against LLMs reaching general intelligence, usually in debates about whether scaling is enough.

Richard Sutton takes a different view in an interview with Dwarkesh Patel[2] — HN, 2025

Machine learning & deep learning · LLMs & generative AI · AI safety, AGI & impact

Subtitles (excerpt)

Today I'm chatting with Richard Sutton, who is one of the founding fathers of reinforcement learning and inventor of many of the main techniques used there, like TD learning and policy gradient methods. For that, he received this year's Turing Award which, if you don’t know, is the Nobel Prize for computer science. Richard, congratulations. Thank you, Dwarkesh. Thanks for coming on the podcast. It's my pleasure. First question. My audience and I are familiar with the LLM way of thinking about AI. Conceptually, what are we missing in terms of thinking about AI from the RL perspective? It's really quite a different point of view. It can easily get separated and lose the ability to talk to each other. Large language models have become such a big thing, generative AI in general a big thing. Our field is subject to bandwagons and fashions, so we lose track of the basic things. I consider reinforcement learning to be basic AI. What is intelligence? The problem is to understand your world. Reinforcement learning is about understanding your world, whereas large language models are about mimicking people, doing what people say you should do. They're not about figuring out what to do. You would think that to emulate the trillions

On Hacker News

Google's definition is sufficient[0]. I'd also go so far as to say that LLMs aren't even AI, but that can be a bit pedantic. I align with Richard Sutton's reasoning, in that LLMs (and GPT models more generally) aren't "intelligent" in the same way that RL models are[1]. [0] - [LINK] [1] - [VIDEO] — solumos, 2026-07
This is basically the entire argument by Richard Sutton happening in real time: [VIDEO] Right now, we keep creating new models with larger and larger weights and throwing hardware at it. His argument is that this is a dead end and ultimately we'll eventually go back to purpose fit algorithms like we've always done in the history of AI development. — mbesto, 2026-07
I think they are not actually intelligent. Fix all random seeds and other sources of randomness, and try the same prompt twice, and check how intelligent that looks, as a first approximation. On a more technical level very serious people have voiced doubts, for example Richard Sutton in an interview with Dwarkash Patel [1]. [1] [VIDEO] — kbrkbr, 2026-05
Geoffrey Hinton's recent lecture at the Royal Institute[1] is a fascinating watch. His assertion that human use of language being exactly analogous to neural networks with back-propagation really made me think about what LLMs might be able to do, and indeed, what happens in me when I "think". A common objection to LLM "intelligence" is that "they don't know anything". But in turn... what do biolo… — j1mr10rd4n, 2025-11
Rich Sutton, the guy behind both "reinforcement learning" & "the Bitter Lesson", muses that Tech needs to understand the Bitter Lesson better: [LINK] Longer analysis: [VIDEO] To (try and) summarize those in the context of TFA: builders need to distinguish between policy optimisations and program optimisations I guess a related question to ask (important for both startups and Big Tech) might be: "… — gsf_emergency_4, 2025-10

Related videos