Eliezer Yudkowsky: Dangers of AI and the End of Human Civilization | Lex Fridman Podcast #368

Channel:Lex Fridman · Length:3:17:51 · Published:2023-03-30 · Views:2170645

Watch on YouTube

Summary

A three-hour Lex Fridman podcast conversation with AI researcher Eliezer Yudkowsky about the dangers of superintelligent AI and his argument that it could end human civilization. It covers AI alignment, why he thinks LLM capabilities are poorly understood, and the case for extreme caution.

Why HN recommends it

Mostly cited as the canonical statement of AI doomer views, with some recommending it and many criticizing it as irresponsible or wrong.

I would recommend listening to Eliezer Yudkowsky on the subject — HN, 2023

LLMs & generative AI · AI safety, AGI & impact

Subtitles (excerpt)

- The problem is that we do not get 50 years to try and try again and observe that we were wrong and come up with a different theory and realize that the entire thing is going to be like way more difficult than realized at the start, because the first time you fail at aligning something much smarter than you are, you die. - The following is a conversation with Eliezer Yudkowsky, a legendary researcher, writer and philosopher on the topic of artificial intelligence, especially super intelligent AGI and its threat to human civilization. This is the Lex Friedman podcast to support it. Please check out our sponsors in the description. And now, dear friends, here's Eliezer Yudkowsky. What do you think about GPT-4? How intelligent is it? - It is a bit smarter than I thought this technology was going to scale to, and I'm a bit worried about what the next one will be like. Like this particular one I think, I hope there's nobody inside there 'cause you know, it'd sucked to be stuck inside there. But we don't even know the architecture at this point 'cause OpenAI is very properly not telling us. And yeah, like giant inscrutable matrices of floating point numbers, I don't know what's going on in there.

On Hacker News

There's no real acknowledgement in this conversation of the existential threat. I would recommend listening to Eliezer Yudkowsky on the subject [1] [2]: > If somebody builds a too-powerful AI, under present conditions, I expect that every single member of the human species and all biological life on Earth dies shortly thereafter. > There’s no proposed plan for how we could do any such thing and s… — gregwebs, 2023-04
i feel the same way api but I did watch this entire thing [VIDEO] and now I can't stop thinking about Eliezer is so smart, smarter than me, should I listen? — andrewfromx, 2023-11
No I don't think so. Not because of the content but rather the lack of it. The people that already have some idea of the missing content are not the general audience that would benefit from this. In my opinion a TED talk is not an appropriate format. TED barely gave him enough time to tell us the sky is going to be falling. People will need more depth to see what that might look like and how it m… — LinuxBender, 2023-07
I'll add to the points made in this article that we still don't completely know how LLM AI works and can't explain the leaps in capability made after a providing a certain amount of training data. Sam Altman has talked about this and Eliezer Yudkowsky shares some thoughts with Lex Fridman: [VIDEO] — m348e912, 2023-04
tl;dr it's the same feature he's talking about, but also he's wrong in a very Yudkowsky way. I was curious about this so I hunted it down: [VIDEO] He speculates that Wikipedia got the idea from Arbital. Insofar as I can tell, that seems to be a wiki-like website that started around 2015 -- I had never heard of it, so it might be older? That does predate this specific implementation of popups on W… — kemayo, 2024-12

Related videos