But what is a neural network? | Deep learning chapter 1

Channel:3Blue1Brown · Length:18:40 · Published:2017-10-05 · Views:25352725

Watch on YouTube

Summary

3Blue1Brown's first chapter on deep learning explains what neurons and layers are and the math underlying a basic neural network, using handwritten digit recognition with visual animations.

Why HN recommends it

HN treats it as the standard first stop for learning neural networks, praised for making the math intuitive.

the visualisations and explanations of the math/concepts are so amazing — HN, 2017

Machine learning & deep learning · Recreational & visual math

Subtitles (excerpt)

This is a 3. It's sloppily written and rendered at an extremely low resolution of 28x28 pixels, but your brain has no trouble recognizing it as a 3. And I want you to take a moment to appreciate how crazy it is that brains can do this so effortlessly. I mean, this, this and this are also recognizable as 3s, even though the specific values of each pixel is very different from one image to the next. The particular light-sensitive cells in your eye that are firing when you see this 3 are very different from the ones firing when you see this 3. But something in that crazy-smart visual cortex of yours resolves these as representing the same idea, while at the same time recognizing other images as their own distinct ideas. But if I told you, hey, sit down and write for me a program that takes in a grid of 28x28 pixels like this and outputs a single number between 0 and 10, telling you what it thinks the digit is, well the task goes from comically trivial to dauntingly difficult. Unless you've been living under a rock, I think I hardly need to motivate the relevance and importance of machine learning and neural networks to the present and to the future. But what I want to do here is show you what a neural network actually is,

On Hacker News

For me 3brown1blue series: [VIDEO] was an excellent introduction that made Andrej's videos understandable. Then I did 3 first chapters of fastai book, but found it too high level, while I was interested in how things works under the hood. Going through Andrej's makemore tutorials required quite a lot of time but it's definitely worth it. I used free tier of Google Colab until the last one. Pausin… — 6mian, 2024-04
Essentially a computer neural network is just a lot of addition (and matrix multiplication) of floating point numbers. The parameters are the "strength" or "weights" of the connections between neurons on different layers and the "bias" of each neuron. If neuron Alice is connected to neuron Bob and Alice has a value of 0.7, and the weight of Alice's connection to bob is 0.5, then the value sent fr… — superkuh, 2023-04
3blue1brown videos are probably the best equivalent. Maybe a little basic? But really, all his math videos are just ridiculously good quality. [VIDEO] — spandexcajun, 2019-05
[VIDEO] 3Blue1Brown’s playlist on neural networks. Like other 3Blue1Brown videos, the visualisations and explanations of the math/concepts are so amazing, they give you the intuition behind the neural networks naturally. — mandliya, 2017-12
I'm in the same boat. For long time, I was interested in AI but at the same time intimidated by math. I'm relatively comfortable with discrete mathematics and classical algorithms and at the same time calculus and linear algebra is completely foreign to me. Also, I do not accept way to learn ML without good understanding of core principles behind it. So math is a must. A few months ago, I stumble… — hal9000xp, 2017-11

Related videos