Ilya Sutskever (OpenAI Chief Scientist) — Why next-token prediction could surpass human intelligence
Channel:Dwarkesh Patel · Length:47:41 · Published:2023-03-27 · Views:791685
Summary
Dwarkesh Patel interviews OpenAI chief scientist Ilya Sutskever on time to AGI, what comes after generative models, data limits, alignment, and competing with Google. The title centers on whether next-token prediction could surpass human intelligence.
Why HN recommends it
HN commenters cite it mainly for Sutskever's statements that training data is far from exhausted.
Ilya Sutskever from OpenAI saying that the data situation is good and there's more data to train on — HN, 2023
LLMs & generative AI · AI safety, AGI & impact · Tech pioneers & interviews
Subtitles (excerpt)
Today I have the pleasure of interviewing Ilya Sutskever, who is the Co-founder and Chief Scientist of OpenAI. Ilya, welcome to The Lunar Society. Thank you, happy to be here. First question and no humility allowed. There are not that many scientists who will make a big breakthrough in their field, there are far fewer scientists who will make multiple independent breakthroughs that define their field throughout their career, what is the difference? What distinguishes you from other researchers? Why have you been able to make multiple breakthroughs in your field? Thank you for the kind words. It's hard to answer that question. I try really hard, I give it everything I've got and that has worked so far. I think that's all there is to it. Got it. What's the explanation for why there aren't more illicit uses of GPT? Why aren't more foreign governments using it to spread propaganda or scam grandmothers? Maybe they haven't really gotten to do it a lot. But it also wouldn't surprise me if some of it was going on right now. I can certainly imagine they would be taking some of the open source models and trying to use them for that purpose. For sure I would expect this to be something they'd be interested in the future. It's technically possible they just
On Hacker News
Thanks for that good summary. > I see how Ilya was right There are still some things Ilya[0] (and Hinton[1]). The parts I'm quoting here are an example of "that reddit comment" that sounds right but is very wrong, and something we know is wrong (and have known it is wrong for hundreds of years!). Yet, it is also something we keep having to learn. It's both obvious and not obvious, but you can mak… — godelski, 2025-08
> What does it mean for computation to have a direction? Actually, all computation has a directionality! This is actually a subject that I get really excited about ^__^ Think about this, we have a function f, with input x, and output y. f(x) -> y We'd even use that notation! This is our direction. Now, the reverse actually gets a bit tricky. If the reverse is straightforward, our function has an … — godelski, 2025-06
I think many people are missing the core of what Chomsky is saying. It is often easy to miscommunicate and I think this is primarily what is happening. I think the analogy he gives here really helps emphasize what he's trying to say. If you're only going to read one part, I think it is this: | I mentioned insect navigation, which is an astonishing achievement. Insect scientists have made much pro… — godelski, 2025-05
In this interview [1] with Ilya Sutskever, he indicates that they aren't even close to tapping out of data. [1] [VIDEO] — lexandstuff, 2023-04
Ilya Sutskever (OpenAI Chief Scientist): "Yeah, I would say the data situation is still quite good. There's still lots to go" - [VIDEO] There was a rumor that they were going to use Whisper to transcribe YouTube videos and use that for training. Since it's multimodal, incorporating video frames alongside the transcriptions could significantly enhance its performance. — machdiamonds, 2023-04
Related videos
- Jim Simons (full length interview) - Numberphile · Numberphile2 · 1:00:43
- Steve Jobs Stanford Commencement Speech 2005 · JoshuaG · 14:34
- What Happened to Horses Is Happening to Us · CGP Grey · 15:00
- Transformers, the tech behind LLMs | Deep Learning Chapter 5 · 3Blue1Brown · 27:14
- Alan Kay - Normal Considered Harmful · powerfuloutlet · 1:07:26
- Growing a Language, by Guy Steele · Bill Pugh · 53:31
- A Philosophy of Software Design | John Ousterhout | Talks at Google · Talks at Google · 1:01:40
- "Uncle" Bob Martin - "The Future of Programming" · Paul Stringer's Mobile Tech · 1:18:21
- VCF East: Ken Thompson interviewed by Brian Kernighan · Vintage Computer Federation · 1:03:51
- Hamming, "You and Your Research" (June 6, 1995) · securitylectures · 44:02
- Tech Talk: Linus Torvalds on git · Google · 1:10:15
- Deep Dive into LLMs like ChatGPT · Andrej Karpathy · 3:31:23
- Alan Kay's tribute to Ted Nelson at "Intertwingled" Festival · TheTedNelson · 17:33
- Joe Rogan Experience #1035 - Paul Stamets · PowerfulJRE · 2:13:48
- "Money doesn't interest me" - Ton Roosendaal 2017 Interview · Blender Guru · 1:46:51
- The Mother of All Demos, presented by Douglas Engelbart (1968) · Marcel · 1:40:52