Edward Gibson: Human Language, Psycholinguistics, Syntax, Grammar & LLMs | Lex Fridman Podcast #426
Channel:Lex Fridman · Length:2:50:44 · Published:2024-04-17 · Views:472140
Summary
Lex Fridman interviews MIT psycholinguist Edward Gibson on human language, syntax, grammar and how large language models relate to them. The conversation runs nearly three hours.
Why HN recommends it
HN cites it for the argument that LLMs capture language form but not meaning, and for how the brain's language network works.
I highly recommend listening to this Lex Friedman podcast episode — HN, 2024
LLMs & generative AI · Neuroscience & the brain · Language & linguistics
Subtitles (excerpt)
- Naively, I certainly thought that all humans would have words for exact counting, and the Piraha don't, okay? So they don't have any words for even one. There's not a word for one in their language. And so there's certainly not a word for two, three, or four, and so that kind of blows people's minds off. - Yeah, that is blowing my mind. - [Edward] That's pretty weird, isn't it? - How are you gonna ask, "I want two of those"? - You just don't, and so that's just not a thing you can possibly ask in the Piraha. It's not possible. That is, there's no words for that. - The following is a conversation with Edward Gibson, or Ted, as everybody calls him. He is a psycholinguistics professor at MIT. He heads the MIT Language Lab that investigates why human languages look the way they do, the relationship between cultural language and how people represent, process, and learn language. Also, he should have a book titled "Syntax, a Cognitive Approach," published by MIT Press, coming out this fall. So look out for that. This is "Lex Fridman Podcast." To support it, please check out our sponsors in the description. And now, dear friends, here's Edward Gibson. When did you first become fascinated with human language?
On Hacker News
'It's impossible to plan without an internal monologue.' - Sorry, but I disagree with this. I have no 'internal voice' or monologue - whenever I see a problem, my brain actually and fully models it using images. I believe 25% of the population doesn't have the internal monologue which you're referring to and this has been tested and confirmed. I highly recommend listening to this Lex Friedman pod… — photon_lines, 2024-06
If you are interested in this topic, I suggest watching the conversation between Edward Gibson and Lex Fridman. In the middle of the conversation [1] Edward talks about how there is a "human language comprehension network" within human brain, which gets activated only when we read or speak in any human languages, but nothing else. For example for those speaking multiple languages, reading or writ… — hashemian, 2024-05
I find that explaining errors and factual mistakes in LLMs or AI in general as hallucinations to be counter-productive. I don't know if the field has landed on a specific definition of what hallucination is, but I mostly associate it with garbled output from tokens like 'SolidGoldMagicKarp'[0] and 'davidjl'[1]. My understanding is that AI models like GPT have been able to convincingly convey the … — Hanschri, 2024-04
Related videos
- 1. Introduction to Human Behavioral Biology · Stanford · 57:14
- George Lakoff: Moral Politics · University of California Television (UCTV) · 58:57
- Stanford's Sapolsky On Depression in U.S. (Full Lecture) · Stanford · 52:28
- What Bodies Think About: Bioelectric Computation Outside the Nervous System - NeurIPS 2018 · The Artificial Intelligence Channel · 52:06
- The great porn experiment | Gary Wilson | TEDxGlasgow · TEDx Talks · 16:29
- Transformers, the tech behind LLMs | Deep Learning Chapter 5 · 3Blue1Brown · 27:14
- Controlling Your Dopamine For Motivation, Focus & Satisfaction · Andrew Huberman · 2:16:31
- Deep Dive into LLMs like ChatGPT · Andrej Karpathy · 3:31:23
- Personal Growth Series: Dr. William Dement on Healthy Sleep and Optimal Perfo... · Google TechTalks · 59:57
- Let's build GPT: from scratch, in code, spelled out. · Andrej Karpathy · 1:56:20
- Joe Rogan Experience #1109 - Matthew Walker · PowerfulJRE · 1:55:32
- A Hackers' Guide to Language Models · Jeremy Howard · 1:31:13
- Master Your Sleep & Be More Alert When Awake · Andrew Huberman · 1:22:05
- What Alcohol Does to Your Body, Brain & Health · Andrew Huberman · 2:01:02
- Stephen Fry Kinetic Typography - Language · Built By Matt · 6:34
- You Actually Share Your Brain With a Silent Stranger · CGP Grey · 4:57