Yann Lecun: Meta AI, Open Source, Limits of LLMs, AGI & the Future of AI | Lex Fridman Podcast #416

Channel:Lex Fridman · Length:2:47:17 · Published:2024-03-07 · Views:1289275

Watch on YouTube

Summary

Lex Fridman's long podcast interview with Yann LeCun on Meta AI, open source, the limits of LLMs, AGI and the future of AI.

Why HN recommends it

Cited for LeCun's views on LLM limits and alternative approaches to intelligence.

I think you might find Lex Fridmans interview with Yann LeCun interesting[1]. — HN, 2024

LLMs & generative AI · AI safety, AGI & impact · Tech pioneers & interviews

Subtitles (excerpt)

- I see the danger of this concentration of power through proprietary AI systems as a much bigger danger than everything else. What works against this is people who think that for reasons of security, we should keep AI systems under lock and key because it's too dangerous to put it in the hands of everybody. That would lead to a very bad future in which all of our information diet is controlled by a small number of companies through proprietary systems. - I believe that people are fundamentally good and so if AI, especially open source AI can make them smarter, it just empowers the goodness in humans. - So I share that feeling. Okay? I think people are fundamentally good. (laughing) And in fact a lot of doomers are doomers because they don't think that people are fundamentally good. - The following is a conversation with Yann LeCun, his third time on this podcast. He is the chief AI scientist at Meta, professor at NYU, Turing Award winner and one of the seminal figures in the history of artificial intelligence. He and Meta AI have been big proponents of open sourcing AI development, and have been walking the walk by open sourcing many of their biggest models, including LLaMA 2 and eventually LLaMA 3.

On Hacker News

I think you might find Lex Fridmans interview with Yann LeCun interesting[1]. It discusses exactly this, how LLMs just mimmick intelligent behaviour but have no understanding of the world at all. It also discusses other approaches we should look at instead of current LLMs. [1] [VIDEO] — jtietema, 2024-05
>The findings reveal that even slight changes in the phrasing of questions can cause major discrepancies in model performance that can undermine their reliability in scenarios requiring logical consistency. Relevant conversation with Yann Lecun: [VIDEO] — zero-sharp, 2024-10
These are all facts coming from publicly available information, such as the Llama 3 paper and recent interviews. I'd dig up the specific timestamps, but I'm working at the moment and can't spend the next hour scrolling through long interviews. The interviews are: "Mark Zuckerberg - Llama 3, $10B Models, Caesar Augustus, & 1 GW Datacenters": [LINK] "Yann Lecun: Meta AI, Open Source, Limits of LLMs… — jiggawatts, 2024-05
The Unitree is what made me think we are headed for a bubble. The machines themselves will become commodity hardware. Tesla bot will push the hype side. I just don’t believe current AI systems have what it takes to operate in the real world. It doesn’t have to be AGI at all, but it needs a bunch of capabilities not present in existing models, some of which cannot be created by training on large c… — TaylorAlexander, 2024-05
> A 4 year old child has 16k wake hours x 3600 s/hour x 1^6 optical nerve fibers x 2 eyes x 10 bytes/s = 1^15 bytes (approximation by Yann LeCun). Unfortunate typo. You meant 10^15 bytes at the end. Thanks to your citation I was able to find a podcast transcript [1] with Yann LeCun's explanation: > If you talk to developmental psychologists and they tell you a four-year-old has been awake for 16,… — hn_acker, 2024-03

Related videos