Neural Networks Demystified [Part 1: Data and Architecture]
Channel:Welch Labs · Length:3:07 · Published:2014-11-04 · Views:840004
Summary
The first of a short series by Welch Labs on building a complete neural network in Python. It introduces the data and the architecture of a simple network before later parts cover forward propagation, gradient descent, and backpropagation.
Why HN recommends it
HN commenters point beginners to this series as one of the clearest short walkthroughs of how neural networks and backpropagation work.
One of the clearest walkthroughs I've seen online is a short series of very short videos by Stephen C Welch [2] [3]. — HN, 2015
Machine learning & deep learning
Subtitles (excerpt)
let's say you want to predict some output value y given some input value x. For example maybe you want to predict your score on test based on how many hours you sleep and how many hours you study the night before. To use a machine learning approach we first need some data. Let's say for the last three tests you recorded your number of hours studying, you number of hours sleeping, and your score on the test. We'll use the programming language Python to store data in two-dimensional "numpy" arrays. Now that we have some data we're going to use it to train a model to predict how well you'll do on your next test, based on how many hours you sleep and how many hours you study. This is called a supervised regression problem. It's supervised because our examples have inputs and outputs. It's a regression problem because we're predicting your test score, which is a continuous output. If, we were predicting your letter grade this would be called a classification problem and not a regression problem. There are an overwhelming number of models within machine learning here we're going to use a particularly interesting one called an artificial neural network these guys are loosely based on how the
On Hacker News
The gist of this is really the Backpropagation algorithm [1]. It appears as though everything else is a means to detect when to stop. One of the clearest walkthroughs I've seen online is a short series of very short videos by Stephen C Welch [2] [3]. If you're interested in this space, start with him. [1]: [LINK] [2]: [VIDEO] [3]: [LINK] — film42, 2015-02
Hello, my background is just like yours. Assuming you are a total noob I learned that AI is not like programming, where anyone with basic knowledge of computation can dive in. You can NOT just learn AI by reading other people's code. Its like Physics, there are solid principles you need to understand before you get in. The point: AI does not come with the "batteries included". If you are in deed … — max_, 2016-06
I also recommend Welch Labs’ Neural Network Demystified-series[0]. It is a combination of the Coursera course and the YouTube videos. It get’s into some of the math, while still keeping it basic. [0]: [VIDEO] — josso, 2016-04
Good post. I want to add several great resources. - Grokking Deep Learning [LINK] This is a fantastic book that assumes no prerequisites other than knowing python, and takes you through the fundamentals of DL. It has very intuitive and easy to follow explanations, and doesn't use any libraries other than NumPy, so you're building the whole thing yourself, from scratch. - Deep Learning With Python… — rayalez, 2018-02
Related videos
- Hello World - Machine Learning Recipes #1 · Google for Developers · 6:52
- Anton: A Special-Purpose Machine That Achieves a Hundred-Fold Speedup in Biomolecular Simulations · NC State · 1:20:34
- Netflix JavaScript Talks - Async JavaScript with Reactive Extensions · Matt Marenghi · 28:38
- The spelled-out intro to neural networks and backpropagation: building micrograd · Andrej Karpathy · 2:25:52
- But what is a neural network? | Deep learning chapter 1 · 3Blue1Brown · 18:40
- AlphaGo - The Movie | Full award-winning documentary · Google DeepMind · 1:30:28
- Transformers, the tech behind LLMs | Deep Learning Chapter 5 · 3Blue1Brown · 27:14
- USENIX Security '18-Q: Why Do Keynote Speakers Keep Suggesting That Improving Security Is Possible? · USENIX · 51:22
- Lecture 1 | Machine Learning (Stanford) · Stanford · 1:08:40
- MarI/O - Machine Learning for Video Games · SethBling · 5:57
- Deep Dive into LLMs like ChatGPT · Andrej Karpathy · 3:31:23
- Computer program that learns to play classic NES games · suckerpinch · 16:17
- RL Course by David Silver - Lecture 1: Introduction to Reinforcement Learning · Google DeepMind · 1:28:12
- Let's build GPT: from scratch, in code, spelled out. · Andrej Karpathy · 1:56:20
- Bay Area Vision Meeting: Unsupervised Feature Learning and Deep Learning · Google TechTalks · 48:10
- A Hackers' Guide to Language Models · Jeremy Howard · 1:31:13