NIPS 2017 Test of Time Award "Machine learning has become alchemy.” | Ali Rahimi, Google
Channel:Preserve Knowledge · Length:22:50 · Published:2018-03-07 · Views:26363
Summary
Ali Rahimi accepts the NIPS 2017 Test of Time Award and argues that machine learning has become alchemy, with practice running ahead of understanding.
Why HN recommends it
Cited when HN discusses the lack of rigor and theory in deep learning, often with a pointer to the key moment of the talk.
Skip to 13:36 to get to the point — HN, 2024
Machine learning & deep learning · Scientific method & science communication
Subtitles (excerpt)
good morning I think we are ready for the next talk if this this actually works so not every nips has a test of time award so it's a test of time even to get a test a time award this year has one and the criteria that we decided the program decided on for for awarding it was ten year back nips papers so we formed a little committee and I must say that it was not easy all the ones that did not get their test of time award don't feel too bad this was not an easy decision but we did arrive we did arrive at a paper that we definitely felt was was service really really good and we're happy about it so just let me introduce it in the author's own word random features I trick to speed up supervised learning algorithms so they can operate on big that as millions of data points data says traditional learning algorithms work too hard because they optimized parameters that don't actually need to be optimized instead one can randomize over some of the parameters and quickly optimize over the rest thanks to the concentration of measure of phenomenon this still provides excellent accuracy this recipe makes for accurate learning algorithms but one extremely fast and are very easy to implement so the paper introduced random
On Hacker News
> It’s logically obvious. You can recreate any linear regression using a neural network. So a neural network approach will always be at least as good as linear regression. Well, maybe it's logically obvious, but it's also empirically false: [VIDEO] (Skip to 13:36 to get to the point) > But a neural network can model non-linear relationships as well. Now ask yourself, what is the likelihood of the… — Calavar, 2024-02
"There is no such thing as not worshipping. Everybody worships. The only choice we get is what to worship. And the compelling reason for maybe choosing some sort of god or spiritual-type thing to worship–be it JC or Allah, be it YHWH or the Wiccan Mother Goddess, or the Four Noble Truths, or some inviolable set of ethical principles–is that pretty much anything else you worship will eat you alive… — psychomugs, 2023-01
Machine Learning is Alchemy [VIDEO] . We need to understand optimization to advance this field not train thousands of monkeys to press play and hope for a nice result. Also, why did they not decide to teach 1% of the population basic coding. Now that could transform a society. — Mortiffer, 2019-01
Related videos
- The spelled-out intro to neural networks and backpropagation: building micrograd · Andrej Karpathy · 2:25:52
- The Quantum Conspiracy: What Popularizers of QM Don't Want You to Know · Google TechTalks · 1:03:43
- But what is a neural network? | Deep learning chapter 1 · 3Blue1Brown · 18:40
- James Burke Connections, Ep. 1 "The Trigger Effect" · DRS_Education · 49:22
- AlphaGo - The Movie | Full award-winning documentary · Google DeepMind · 1:30:28
- Transformers, the tech behind LLMs | Deep Learning Chapter 5 · 3Blue1Brown · 27:14
- USENIX Security '18-Q: Why Do Keynote Speakers Keep Suggesting That Improving Security Is Possible? · USENIX · 51:22
- Lecture 1 | Machine Learning (Stanford) · Stanford · 1:08:40
- Hamming, "You and Your Research" (June 6, 1995) · securitylectures · 44:02
- MarI/O - Machine Learning for Video Games · SethBling · 5:57
- Deep Dive into LLMs like ChatGPT · Andrej Karpathy · 3:31:23
- Computer program that learns to play classic NES games · suckerpinch · 16:17
- Why Being Delusional is a Superpower · Veritasium · 12:04
- RL Course by David Silver - Lecture 1: Introduction to Reinforcement Learning · Google DeepMind · 1:28:12
- Is Most Published Research Wrong? · Veritasium · 12:22
- Richard Feynman Fire · nebulajr · 4:43