Deep Visualization Toolbox
Channel:Jason Yosinski · Length:3:53 · Published:2015-07-07 · Views:269911
Summary
A short demo of the Deep Visualization Toolbox, which shows the activations inside a convolutional neural network as it processes live camera input. Viewers see individual units responding to edges, faces and text.
Why HN recommends it
HN points to it as an intuitive way to see what hidden layers of a convnet learn, and as a reference for hierarchical feature learning.
Highly recommend this video on the Deep Visualization Toolbox — HN, 2016
Machine learning & deep learning · Computer vision, speech & NLP · Data visualization & information design
Subtitles (excerpt)
recent advances in neural networks have enabled computers to better see and understand the world they can recognize school buses and zebras and can tell the difference between mtis Terriers and Yorkshire Terriers we now know what it takes to train these neural networks well but we don't know so much about how they're actually Computing their final answers we developed this interactive deep visualization toolbox to shine light into these black boxes showing what happens inside of neural Nets in the top left corner we show the input to the network which can be a still image or video from a webcam these black squares in the middle show the activations on a single layer of a network in this case the popular deep neural network called Alex net running in Cafe by interacting with the network we can see what some of the neurons are doing for example on this first layer a unit in the center responds strongly to light to dark edges its neighbor one neuron over responds to edges in the opposite direction dark to light using optimization we can synthetically produce images that light up each neuron on this layer to see what each neuron is looking for we can scroll through every layer in the network to see
On Hacker News
Highly recommend this video on the Deep Visualization Toolbox to anyone interesting in understanding more about how convnets work through visualization: [VIDEO] — rkaplan, 2016-04
Why not? It takes models of a certain size to contain xyz neuron/feature. [VIDEO] That's not a mirage, it's clearly capability that a smaller model cannot demonstrate. A model with less parameters and less hidden layers cannot have a neuron that lights up when it detects a face. — jychang, 2025-08
And it also suffers from the tired assumption that GPT-3 (or any language models) should, or are designed to in any way, give reasonable answers[1]. All GPT-3 does is give likely continuations , given the training corpus. The prompts here are too short, and it could likely just be writing mediocre fiction continuations. Fiction tends to not be reasonable much of the time (to create story conflict… — gnramires, 2020-08
This toolbox allows you to visualize what neural networks "see" at each layer, and what image patterns activate what sorts of neurons (and how). For example, in this video [1] you can see neurons that detect edges, faces, and text. [1] [VIDEO] — rasmi, 2016-12
Related videos
- The spelled-out intro to neural networks and backpropagation: building micrograd · Andrej Karpathy · 2:25:52
- But what is a neural network? | Deep learning chapter 1 · 3Blue1Brown · 18:40
- A Better Default Colormap for Matplotlib | SciPy 2015 | Nathaniel Smith and Stéfan van der Walt · Enthought · 19:08
- Hans Rosling's 200 Countries, 200 Years, 4 Minutes - The Joy of Stats - BBC · BBC · 4:47
- AlphaGo - The Movie | Full award-winning documentary · Google DeepMind · 1:30:28
- Transformers, the tech behind LLMs | Deep Learning Chapter 5 · 3Blue1Brown · 27:14
- USENIX Security '18-Q: Why Do Keynote Speakers Keep Suggesting That Improving Security Is Possible? · USENIX · 51:22
- Lecture 1 | Machine Learning (Stanford) · Stanford · 1:08:40
- MarI/O - Machine Learning for Video Games · SethBling · 5:57
- Deep Dive into LLMs like ChatGPT · Andrej Karpathy · 3:31:23
- Computer program that learns to play classic NES games · suckerpinch · 16:17
- RL Course by David Silver - Lecture 1: Introduction to Reinforcement Learning · Google DeepMind · 1:28:12
- Let's build GPT: from scratch, in code, spelled out. · Andrej Karpathy · 1:56:20
- Bay Area Vision Meeting: Unsupervised Feature Learning and Deep Learning · Google TechTalks · 48:10
- A Hackers' Guide to Language Models · Jeremy Howard · 1:31:13
- Wealth Inequality in America · politizane · 6:23