AI Learns Noise Filtering For Photorealistic Videos | Two Minute Papers #215

Channel:Two Minute Papers · Length:4:16 · Published:2017-12-17 · Views:64639

Watch on YouTube

Summary

A Two Minute Papers episode on NVIDIA's recurrent denoising autoencoder, which cleans up noisy Monte Carlo path-traced image sequences. It shows how a neural network can produce usable renders from very few samples.

Why HN recommends it

Cited as an accessible explanation of AI denoising, which underpins real-time ray tracing on RTX hardware.

Two Minute Papers did a nice explanation of it — HN, 2019

Machine learning & deep learning · Computer graphics & rendering

Subtitles (excerpt)

Dear Fellow Scholars, this is Two Minute Papers with Károly Zsolnai-Fehér. This is another one of those amazing papers that I am really excited about. And the reason for that is that this is in the intersection of computer graphics and machine learning, which, as you know, is already enough to make me happy, but when I've first seen the quality of the results, I was delighted to see that it delivered exactly what I was hoping for. Light simulation programs are an important subfield of computer graphics where we try to create a photorealistic image of a 3D digital scene by simulating the path of millions and millions of light rays. First, we start out with a noisy image, and as we compute more paths, it slowly clears up. However, it takes a very long time to get a perfectly clear image, and depending on the scene and the algorithm, it can take from minutes to hours. In an earlier work, we had a beautiful but pathological scene that took weeks to render on several machines, if you would like to hear more about that, the link is available in the video description. So in order to alleviate this problem, many noise filtering algorithms surfaced over the years. The goal of these algorithms is that instead

On Hacker News

It's only briefly mentioned, but NVIDIA's recurrent denoising autoencoder is pretty amazing. [LINK] Two Minute Papers did a nice explanation of it: [VIDEO] — jonas21, 2019-09
Disney actually does a lot of research combining the world of graphics with deep learning. Some examples that you might appreciate (from the excellent channel "Two Minute Papers"): . "Disney's AI Learns To Render Clouds" [0] . "AI Learns Noise Filtering For Photorealistic Videos" [1] [0] [LINK] [1] [VIDEO] — halflings, 2018-06
Deep learning denoiser. I don't know if NVIDIA came up with some marketing term for it. It's what allows RTX to produce meaningful images at all despite the renderer running at 0.5-2 samples per pixel which looks little better than random noise. I kind of assumed they'd call it DLDN because they called their deep learning supersampling DLSS. I guess not, go figure. [VIDEO] — kuzehanka, 2019-03
This uses a neural network [VIDEO] video results start around 1:15 This one does not use a neural network: [LINK] — blooop, 2018-12
I don't think your estimations take into account the massive gains from AI denoising techniques such as [VIDEO] — scrumption, 2018-08

Related videos