AI Succession
Channel:Rich Sutton · Length:17:52 · Published:2023-09-09 · Views:13450
Summary
A short pre-recorded talk by Rich Sutton for the World AI Conference in Shanghai arguing that succession from humanity to AI is inevitable. He lays out his view of that transition.
Why HN recommends it
Cited critically, as evidence of the unsettling perspective of a prominent AI researcher who seems to accept humanity being replaced.
Subtitles (excerpt)
good morning Shanghai it's my great honor distinct pleasure to address you all attendees of the world artificial intelligence conference in Shanghai the broad topic of this part of the conference is artificial general intelligence directions and risks in the era of large language models I have much to say on this but first let's look back to better understand where we are field of artificial intelligence is roughly 70 years old in this Century it has undergone great changes in particular in the last decade AI has become economically important and enormous amounts of new money has flowed into the development AI products and research in the last decade of the field has grown enormously the number of people involved in AI research development was increased by a factor of 10 even a factor of 100 by some ways of counting men most recently with the release of openai's chat GTP less than a year ago AI has exploded into the public consciousness along with increasing excitement there's also increasing fear of AI there are calls for pause or Halt and AI development their claims that AI poses an existential risk a risk of Extinction comparable to that of pandemics and nuclear war I've always said you should not fear
On Hacker News
Good time to remind everyone that Sutton is a human successionist and doesn't care if humans all die. He is not to be trusted nor celebrated: [VIDEO] — vonneumannstan, 2025-03
He is not really convinced you can align an AI that is intelligent past some threshold with aims of a single entity. His risk calculations derive primarily from the AI itself, not weaponization of AI by others. Rich Sutton seems to agree with this take and embraces our extinction: [VIDEO] — johnthewise, 2023-11
Richard Sutton has done fascinating RL research in the past. Lately, though, he has been advocating for ending humanity, which is a bit more chilling[1]. [1]: [VIDEO] — espadrine, 2023-10
Clearly Rich Sutton is a giant in AI for his contributions in RL, but his recent brief talk "AI Succession" ( [VIDEO] ) made me worry a bit about the sort of perspective he has on what the "good" outcome here looks like. I say this as someone who is generally optimistic about the promise of AGI. I have no love for the machines as a "species", and by Rich's definition here, yeah, I am "specist" in… — md2020, 2023-09
Related videos
- What Happened to Horses Is Happening to Us · CGP Grey · 15:00
- Why Would AI Want to do Bad Things? Instrumental Convergence · Robert Miles AI Safety · 10:35
- Veritasium: What Everyone Gets Wrong About AI and Learning – Derek Muller Explains · Perimeter Institute for Theoretical Physics · 1:15:10
- Intelligence and Stupidity: The Orthogonality Thesis · Robert Miles AI Safety · 13:02
- We're building a dystopia just to make people click on ads | Zeynep Tufekci · TED · 22:55
- Intro to AI Safety, Remastered · Robert Miles AI Safety · 18:04
- Sparks of AGI: early experiments with GPT-4 · Sebastien Bubeck · 48:32
- Why Not Just: Think of AGI Like a Corporation? · Robert Miles AI Safety · 15:27
- The A.I. Dilemma - March 9, 2023 · Center for Humane Technology · 1:07:31
- Slaughterbots · Stop Autonomous Weapons · 7:48
- 34C3 - Dude, you broke the Future! · media.ccc.de · 57:58
- Is AI Safety a Pascal's Mugging? · Robert Miles AI Safety · 13:41
- Sci-Fi Short Film “Slaughterbots” | DUST · DUST · 7:58
- Training AI Without Writing A Reward Function, with Reward Modelling · Robert Miles AI Safety · 17:51
- Will AI outsmart human intelligence? - with 'Godfather of AI' Geoffrey Hinton · The Royal Institution · 47:15
- Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGI | Lex Fridman Podcast #333 · Lex Fridman · 3:28:47