Jeff Dean & Noam Shazeer — 25 years at Google: from PageRank to AGI

Channel:Dwarkesh Patel · Length:2:15:35 · Published:2025-02-12 · Views:351782

Watch on YouTube

Summary

Dwarkesh Patel interviews Google's Jeff Dean and Noam Shazeer about 25 years at the company, from PageRank and MapReduce to the Transformer, mixture of experts and Gemini. They also discuss where AI is heading.

Why HN recommends it

HN cites it for insight into Google researchers' views on AI progress and publishing, though one commenter finds the interview weak.

Recommend if you want a taste of what’s Google’s folks take on things. — HN, 2026

Distributed systems · LLMs & generative AI · Tech pioneers & interviews

Subtitles (excerpt)

Today I have the honor of chatting with Jeff Dean and Noam Shazeer. Jeff is Google's Chief Scientist, and through his 25 years at the company, he has worked on basically the most transformative systems in modern computing: from MapReduce, BigTable, Tensorflow, AlphaChip – genuinely, the list doesn't end – Gemini now. And Noam is the single person most responsible for the current AI revolution. He has been the inventor or co-inventor of all the main architectures and techniques that are used for modern LLMs: from the Transformer itself, to Mixture of Experts, to Mesh Tensorflow, to many other things. And they are two of the three co-leads of Gemini at Google DeepMind. Awesome. Thanks so much for coming on. Thank you. Super excited to be here. Okay, first question. Both of you have been at Google for 25, or close to 25, years. At some point early on in the company, you probably understood how everything worked. When did that stop being the case? Do you feel like there was a clear moment that happened? I joined, this was like, end of 2000, and they had this thing: everybody gets a mentor. I knew nothing. I would just ask my mentor everything, and my mentor knew everything. It turned out my mentor was Jeff.

On Hacker News

I first saw Noam on Dwarkesh’s podcast together with Jeff Dean. Recommend if you want a taste of what’s Google’s folks take on things. [VIDEO] — paulmist, 2026-06
Here's some insight from Jeff Dean and Noam Shazeer's interview with Dwarkesh Patel [VIDEO] > When you think about divulging this information that has been helpful to your competitors, in retrospect is it like, "Yeah, we'd still do it," or would you be like, "Ah, we didn't realize how big a deal transformer was. We should have kept it indoors." How do you think about that? > Some things we think … — sosodev, 2025-11
The context is that rwaksmunski implied that people have been saying "AGI is 10 years away" for ages, and I was pointing out that the sort of people who say "AGI is X years away" have not in fact been setting X=10 until very recently. I wasn't claiming that the people on that list are the smartest or best-informed people thinking about artificial intelligence. But, FWIW, from about 13:20 in [LINK… — gjm11, 2025-10
Noam Shazeer says it at some point in the Dwarkesh Patel podcast. Edit : Saw multiple people comment by the time I hit sent. Was it also memorable for you guys? I think it was just the way he said it or something. [VIDEO] — itchyjunk, 2025-05
Yeah I also don't understand how he is able to get such high profile guests. His interview with Jeff Dean and Noam Shazeer last year[1] is so hilariously bad. Jeff and Noam kept trying to give really insightful answers on how they see AI development shaping in coming years and he was just steering the conversation to shallow and silly tabloid gossip (why don't you "just" let AI improve the next v… — DarkCrusader2, 2026-02

Related videos