Google Developers Day US - Theorizing from Data
Channel:GoogleDeveloperDay · Length:52:51 · Published:2007-06-05 · Views:26920
Summary
Peter Norvig's 2007 Google talk on theorizing from data, covering what huge datasets can do for language understanding, translation, information extraction and inference. It argues that more data often beats cleverer models.
Why HN recommends it
HN recommends it as the clear explanation of why Google's statistical, data-first approach works.
You should definitely watch it if you haven't seen it before. — HN, 2008
Machine learning & deep learning · Computer vision, speech & NLP · Data science & statistics
Subtitles (excerpt)
Ladies and gentlemen, would you please welcome Peter [Applause] Norvig. Okay. Uh, good afternoon everybody. Thank you for coming. It's, uh, the end of a long day, so congratulations for making it all the way through and still being awake. Uh, I'm going to tell you a little bit today about uh, data and why it's good. And as a as a bit of an introduction, I want to talk about how I first came to Google. That was in 2001, quite quite some time ago now. And previously, I had been working at uh NASA as I was running the computer science and robotics group there. So, it was a pretty exciting job. You know, we got to work on software that goes on the Mars rovers that have been roaming around so successfully now. And people asked me, uh, well, Peter, why would you want to give up that and go to this tiny little startup company that might or might not succeed? And I said, well, you know, I was struck by a guy named Willie Sutton who was a bank robber from the 1940s. And when they caught him, they said, Willie, why do you rob banks? And he said, because that's where the money is. And so they asked me, Peter, why do you want to go to Google? And I said, that's where the data is. And as somebody who's had worked in computer science and particularly in artificial
On Hacker News
One talk in particular in which he focuses on this idea, including with facts and figures from research literature, is a talk he gave a while ago called "Theorizing from Data": [VIDEO] . You should definitely watch it if you haven't seen it before. Norvig states his opinion slightly differently: of course being smart about algorithms is good. But until you get a lot of it, you often can't even fa… — henning, 2008-03
If you really think that's all they're doing then you have very little understanding in just how subtly awesome some of the stuff they're doing is. Peter Norvig does a better job explaining some of it than I ever could. [VIDEO] — timcederman, 2009-08
[ [VIDEO] ] Its a good talk, though maybe should be called "theorizing from massive amounts of data". Makes you wonder what Google are keeping under wraps for now, and how the powerset approach can compete, except maybe for domain-specific stuff. — dood, 2007-12
I like that they show you the source pages, confidence, and alternative sources for the data. However, it suffers the classic Google app problem; it does interesting stuff, but just looks ugly, and is generally unappealing. Hard for me to explain why, but despite my interest in the technology I just didn't enjoy using it at all. But it is interesting stuff, I'd been wondering when something like … — dood, 2009-06
Humans resolve a lot of the complexity intuitively and unconsciously. It is not an inherently bad way to handle it, just incompatible with current programming paradigms. This is not to discount the value of clear explicit thinking in humans, it is just to say that programming would benefit a lot from ability to apply common sense to mundane things. For some dramatic evidence that imprecise is bet… — ntoshev, 2008-03
Related videos
- NeXTSTEP Release 3 Demo · blatherskyte · 35:09
- The Thirty Million Line Problem · Molly Rocket · 1:48:55
- The spelled-out intro to neural networks and backpropagation: building micrograd · Andrej Karpathy · 2:25:52
- But what is a neural network? | Deep learning chapter 1 · 3Blue1Brown · 18:40
- A Better Default Colormap for Matplotlib | SciPy 2015 | Nathaniel Smith and Stéfan van der Walt · Enthought · 19:08
- AlphaGo - The Movie | Full award-winning documentary · Google DeepMind · 1:30:28
- Transformers, the tech behind LLMs | Deep Learning Chapter 5 · 3Blue1Brown · 27:14
- USENIX Security '18-Q: Why Do Keynote Speakers Keep Suggesting That Improving Security Is Possible? · USENIX · 51:22
- Lecture 1 | Machine Learning (Stanford) · Stanford · 1:08:40
- MarI/O - Machine Learning for Video Games · SethBling · 5:57
- Deep Dive into LLMs like ChatGPT · Andrej Karpathy · 3:31:23
- Computer program that learns to play classic NES games · suckerpinch · 16:17
- RL Course by David Silver - Lecture 1: Introduction to Reinforcement Learning · Google DeepMind · 1:28:12
- Is Most Published Research Wrong? · Veritasium · 12:22
- Let's build GPT: from scratch, in code, spelled out. · Andrej Karpathy · 1:56:20
- Bay Area Vision Meeting: Unsupervised Feature Learning and Deep Learning · Google TechTalks · 48:10