Recent Developments in Deep Learning
Channel:Google TechTalks · Length:1:05:17 · Published:2010-03-22 · Views:84764
Summary
Geoff Hinton's 2010 Google Tech Talk on deep belief networks, learning layers of representation one at a time from unlabeled data, and extending them with multiplicative interactions.
Why HN recommends it
Cited as a watchable early introduction to deep learning from its pioneer, and remembered as a mind-blowing moment in the field.
There's a great Google Tech Talk by Geoff Hinton that serves as a slightly technical introduction to Deep Learning if anyone's interested — HN, 2014
Machine learning & deep learning · University lectures & courses
Subtitles (excerpt)
>> So it's my pleasure to introduce to you Geoff Hinton, who is a pioneer in machine learning and neural nets, and more recently [INDISTINCT] architectures. And then, I think that's going to be topic of today. So take it over. >> HINTON: Okay. So I gave it to Okeer a couple of years ago. And the first 10 minutes or so will be an overview of what I said there, and then I'll talk about the new stuff. The new stuff consists of a better learning module. It allows you to learn better in all sorts of different things, like, learning how images transform, learning how people walk, and learning object recognition. So the basic learning module consists of some variables that represent things like pixels, and these will be binary variables for that. Some variables that represent--these are latent variables, they're also going to be binary. And there's a bipartite connectivity, so these guys are connected to each other. And that makes it very easy if I give you the states of the visible variables to infer the states of the hidden variables. They're all independent given the visible variables because it's a non-directed graph. And the input procedure just says, the probability of turning on hidden unit "hj" given this visible vector "v" is the logistic function
On Hacker News
There's a great Google Tech Talk by Geoff Hinton that serves as a slightly technical introduction to Deep Learning if anyone's interested: [VIDEO] — markovbling, 2014-03
Have you seen the online courses? [LINK] (From one of the authors of this paper!) [LINK] [LINK] Prof. Hinton's videos are very watchable: [LINK] [VIDEO] — Devilboy, 2012-06
There's a very good Google Tech Talk by Geoff Hinton (who has worked closely with Dahl on a lot of this research and developed some of the key algorithms in this field) that explains how to build deep belief networks using layers of RBMs: [LINK] That video focuses on handwritten digit recognition, but it's great for understanding the basics. There's a second Google Tech Talk video from a few year… — tylerhobbs, 2012-06
That must have been a long time back. Having lived through the time when web pages were served through CGI and mobile phones only existed in movies, when SVMs where the new hotness in ML and people would write about how weird NNs were, I feel like I've seen a lot more concrete progress in the last few decades than this year. This year honestly feels quite stagnant. LLMs are literally technology t… — crystal_revenge, 2026-01
I think the top priority should be how a hierarchy of weak AI agents can form strong AI with the ability to rewrite its own notions and not become unstable. I've seen very little about this, except for a video where (as I recall) a multilayer neural network can be trained while holding certain connections at a constant value. That way the network can be trained to do different tasks and then put … — zackmorris, 2015-01
Related videos
- How to Speak · MIT OpenCourseWare · 1:03:42
- The spelled-out intro to neural networks and backpropagation: building micrograd · Andrej Karpathy · 2:25:52
- 1. Introduction to Human Behavioral Biology · Stanford · 57:14
- LEADERSHIP LAB: The Craft of Writing Effectively · UChicago Social Sciences · 1:21:51
- But what is a neural network? | Deep learning chapter 1 · 3Blue1Brown · 18:40
- MIT's Pathway to Fusion Energy (IAP 2017) - Zach Hartwig · MIT Plasma Science and Fusion Center · 1:11:39
- Stanford's Sapolsky On Depression in U.S. (Full Lecture) · Stanford · 52:28
- Justice: What's The Right Thing To Do? Episode 01 "THE MORAL SIDE OF MURDER" · Harvard University · 54:56
- Lec 1 | MIT 18.06 Linear Algebra, Spring 2005 · MIT OpenCourseWare · 39:49
- AlphaGo - The Movie | Full award-winning documentary · Google DeepMind · 1:30:28
- Randy Pausch's Last Lecture: Achieving Your Childhood Dreams · Carnegie Mellon University · 1:16:27
- Transformers, the tech behind LLMs | Deep Learning Chapter 5 · 3Blue1Brown · 27:14
- Lecture 1A: Overview and Introduction to Lisp · MIT OpenCourseWare · 1:12:55
- Lecture 1A | MIT 6.001 Structure and Interpretation, 1986 · MIT OpenCourseWare · 1:12:55
- The Most IMPORTANT Video You'll Ever See (part 1 of 8) · wonderingmind42 · 9:17
- USENIX Security '18-Q: Why Do Keynote Speakers Keep Suggesting That Improving Security Is Possible? · USENIX · 51:22