Eliezer Yudkowsky: Dangers of AI and the End of Human Civilization | Lex Fridman Podcast #368
Channel:Lex Fridman · Length:3:17:51 · Published:2023-03-30 · Views:2170645
Summary
A three-hour Lex Fridman podcast conversation with AI researcher Eliezer Yudkowsky about the dangers of superintelligent AI and his argument that it could end human civilization. It covers AI alignment, why he thinks LLM capabilities are poorly understood, and the case for extreme caution.
Why HN recommends it
Mostly cited as the canonical statement of AI doomer views, with some recommending it and many criticizing it as irresponsible or wrong.
I would recommend listening to Eliezer Yudkowsky on the subject — HN, 2023
LLMs & generative AI · AI safety, AGI & impact
Subtitles (excerpt)
- The problem is that we do not get 50 years to try and try again and observe that we were wrong and come up with a different theory and realize that the entire thing is going to be like way more difficult than realized at the start, because the first time you fail at aligning something much smarter than you are, you die. - The following is a conversation with Eliezer Yudkowsky, a legendary researcher, writer and philosopher on the topic of artificial intelligence, especially super intelligent AGI and its threat to human civilization. This is the Lex Friedman podcast to support it. Please check out our sponsors in the description. And now, dear friends, here's Eliezer Yudkowsky. What do you think about GPT-4? How intelligent is it? - It is a bit smarter than I thought this technology was going to scale to, and I'm a bit worried about what the next one will be like. Like this particular one I think, I hope there's nobody inside there 'cause you know, it'd sucked to be stuck inside there. But we don't even know the architecture at this point 'cause OpenAI is very properly not telling us. And yeah, like giant inscrutable matrices of floating point numbers, I don't know what's going on in there.
On Hacker News
There's no real acknowledgement in this conversation of the existential threat. I would recommend listening to Eliezer Yudkowsky on the subject [1] [2]: > If somebody builds a too-powerful AI, under present conditions, I expect that every single member of the human species and all biological life on Earth dies shortly thereafter. > There’s no proposed plan for how we could do any such thing and s… — gregwebs, 2023-04
i feel the same way api but I did watch this entire thing [VIDEO] and now I can't stop thinking about Eliezer is so smart, smarter than me, should I listen? — andrewfromx, 2023-11
No I don't think so. Not because of the content but rather the lack of it. The people that already have some idea of the missing content are not the general audience that would benefit from this. In my opinion a TED talk is not an appropriate format. TED barely gave him enough time to tell us the sky is going to be falling. People will need more depth to see what that might look like and how it m… — LinuxBender, 2023-07
I'll add to the points made in this article that we still don't completely know how LLM AI works and can't explain the leaps in capability made after a providing a certain amount of training data. Sam Altman has talked about this and Eliezer Yudkowsky shares some thoughts with Lex Fridman: [VIDEO] — m348e912, 2023-04
tl;dr it's the same feature he's talking about, but also he's wrong in a very Yudkowsky way. I was curious about this so I hunted it down: [VIDEO] He speculates that Wikipedia got the idea from Arbital. Insofar as I can tell, that seems to be a wiki-like website that started around 2015 -- I had never heard of it, so it might be older? That does predate this specific implementation of popups on W… — kemayo, 2024-12
Related videos
- Dr. Gabor Maté — Trauma, Addiction, Ayahuasca, and More · Tim Ferriss · 2:23:44
- What Happened to Horses Is Happening to Us · CGP Grey · 15:00
- Transformers, the tech behind LLMs | Deep Learning Chapter 5 · 3Blue1Brown · 27:14
- Deep Dive into LLMs like ChatGPT · Andrej Karpathy · 3:31:23
- Let's build GPT: from scratch, in code, spelled out. · Andrej Karpathy · 1:56:20
- A Hackers' Guide to Language Models · Jeremy Howard · 1:31:13
- Why Would AI Want to do Bad Things? Instrumental Convergence · Robert Miles AI Safety · 10:35
- [1hr Talk] Intro to Large Language Models · Andrej Karpathy · 59:48
- Veritasium: What Everyone Gets Wrong About AI and Learning – Derek Muller Explains · Perimeter Institute for Theoretical Physics · 1:15:10
- Intelligence and Stupidity: The Orthogonality Thesis · Robert Miles AI Safety · 13:02
- We're building a dystopia just to make people click on ads | Zeynep Tufekci · TED · 22:55
- Intro to AI Safety, Remastered · Robert Miles AI Safety · 18:04
- Sparks of AGI: early experiments with GPT-4 · Sebastien Bubeck · 48:32
- Let's build the GPT Tokenizer · Andrej Karpathy · 2:13:34
- Why Not Just: Think of AGI Like a Corporation? · Robert Miles AI Safety · 15:27
- Attention in transformers, step-by-step | Deep Learning Chapter 6 · 3Blue1Brown · 26:09