NIPS 2017 Test of Time Award "Machine learning has become alchemy.” | Ali Rahimi, Google

Channel:Preserve Knowledge · Length:22:50 · Published:2018-03-07 · Views:26363

Watch on YouTube

Summary

Ali Rahimi accepts the NIPS 2017 Test of Time Award and argues that machine learning has become alchemy, with practice running ahead of understanding.

Why HN recommends it

Cited when HN discusses the lack of rigor and theory in deep learning, often with a pointer to the key moment of the talk.

Skip to 13:36 to get to the point — HN, 2024

Machine learning & deep learning · Scientific method & science communication

Subtitles (excerpt)

good morning I think we are ready for the next talk if this this actually works so not every nips has a test of time award so it's a test of time even to get a test a time award this year has one and the criteria that we decided the program decided on for for awarding it was ten year back nips papers so we formed a little committee and I must say that it was not easy all the ones that did not get their test of time award don't feel too bad this was not an easy decision but we did arrive we did arrive at a paper that we definitely felt was was service really really good and we're happy about it so just let me introduce it in the author's own word random features I trick to speed up supervised learning algorithms so they can operate on big that as millions of data points data says traditional learning algorithms work too hard because they optimized parameters that don't actually need to be optimized instead one can randomize over some of the parameters and quickly optimize over the rest thanks to the concentration of measure of phenomenon this still provides excellent accuracy this recipe makes for accurate learning algorithms but one extremely fast and are very easy to implement so the paper introduced random

On Hacker News

> It’s logically obvious. You can recreate any linear regression using a neural network. So a neural network approach will always be at least as good as linear regression. Well, maybe it's logically obvious, but it's also empirically false: [VIDEO] (Skip to 13:36 to get to the point) > But a neural network can model non-linear relationships as well. Now ask yourself, what is the likelihood of the… — Calavar, 2024-02
"There is no such thing as not worshipping. Everybody worships. The only choice we get is what to worship. And the compelling reason for maybe choosing some sort of god or spiritual-type thing to worship–be it JC or Allah, be it YHWH or the Wiccan Mother Goddess, or the Four Noble Truths, or some inviolable set of ethical principles–is that pretty much anything else you worship will eat you alive… — psychomugs, 2023-01
Machine Learning is Alchemy [VIDEO] . We need to understand optimization to advance this field not train thousands of monkeys to press play and hope for a nice result. Also, why did they not decide to teach 1% of the population basic coding. Now that could transform a society. — Mortiffer, 2019-01

Related videos