AI Learns Noise Filtering For Photorealistic Videos | Two Minute Papers #215
Channel:Two Minute Papers · Length:4:16 · Published:2017-12-17 · Views:64639
Summary
A Two Minute Papers episode on NVIDIA's recurrent denoising autoencoder, which cleans up noisy Monte Carlo path-traced image sequences. It shows how a neural network can produce usable renders from very few samples.
Why HN recommends it
Cited as an accessible explanation of AI denoising, which underpins real-time ray tracing on RTX hardware.
Two Minute Papers did a nice explanation of it — HN, 2019
Machine learning & deep learning · Computer graphics & rendering
Subtitles (excerpt)
Dear Fellow Scholars, this is Two Minute Papers with Károly Zsolnai-Fehér. This is another one of those amazing papers that I am really excited about. And the reason for that is that this is in the intersection of computer graphics and machine learning, which, as you know, is already enough to make me happy, but when I've first seen the quality of the results, I was delighted to see that it delivered exactly what I was hoping for. Light simulation programs are an important subfield of computer graphics where we try to create a photorealistic image of a 3D digital scene by simulating the path of millions and millions of light rays. First, we start out with a noisy image, and as we compute more paths, it slowly clears up. However, it takes a very long time to get a perfectly clear image, and depending on the scene and the algorithm, it can take from minutes to hours. In an earlier work, we had a beautiful but pathological scene that took weeks to render on several machines, if you would like to hear more about that, the link is available in the video description. So in order to alleviate this problem, many noise filtering algorithms surfaced over the years. The goal of these algorithms is that instead
On Hacker News
It's only briefly mentioned, but NVIDIA's recurrent denoising autoencoder is pretty amazing. [LINK] Two Minute Papers did a nice explanation of it: [VIDEO] — jonas21, 2019-09
Disney actually does a lot of research combining the world of graphics with deep learning. Some examples that you might appreciate (from the excellent channel "Two Minute Papers"): . "Disney's AI Learns To Render Clouds" [0] . "AI Learns Noise Filtering For Photorealistic Videos" [1] [0] [LINK] [1] [VIDEO] — halflings, 2018-06
Deep learning denoiser. I don't know if NVIDIA came up with some marketing term for it. It's what allows RTX to produce meaningful images at all despite the renderer running at 0.5-2 samples per pixel which looks little better than random noise. I kind of assumed they'd call it DLDN because they called their deep learning supersampling DLSS. I guess not, go figure. [VIDEO] — kuzehanka, 2019-03
This uses a neural network [VIDEO] video results start around 1:15 This one does not use a neural network: [LINK] — blooop, 2018-12
I don't think your estimations take into account the massive gains from AI denoising techniques such as [VIDEO] — scrumption, 2018-08
Related videos
- The Backwards Brain Bicycle - Smarter Every Day 133 · SmarterEveryDay · 7:58
- Project Starline: Feel like you're there, together · Google · 1:51
- How Crash Bandicoot Hacked The Original Playstation | War Stories | Ars Technica · Ars Technica · 31:37
- The Road to PS5 · PlayStation · 52:44
- Tensorflow and deep learning - without a PhD by Martin Görner · Devoxx · 2:35:53
- The spelled-out intro to neural networks and backpropagation: building micrograd · Andrej Karpathy · 2:25:52
- But what is a neural network? | Deep learning chapter 1 · 3Blue1Brown · 18:40
- The Beauty of Bézier Curves · Freya Holmér · 24:25
- The Continuity of Splines · Freya Holmér · 1:13:50
- elevated by Rgba & TBC | 4k intro (FullHD 1080p demoscene demo) · Demoscene High-Quality Videos (Annikras) · 3:36
- AlphaGo - The Movie | Full award-winning documentary · Google DeepMind · 1:30:28
- Transformers, the tech behind LLMs | Deep Learning Chapter 5 · 3Blue1Brown · 27:14
- Painting a Character with Maths · Inigo Quilez · 24:46
- USENIX Security '18-Q: Why Do Keynote Speakers Keep Suggesting That Improving Security Is Possible? · USENIX · 51:22
- The Real Story Behind Wayland and X - Daniel Stone (linux.conf.au 2013) · Mladen Mijatov · 45:35
- Lecture 1 | Machine Learning (Stanford) · Stanford · 1:08:40