3D Gaussian Splatting - Why Graphics Will Never Be The Same

Channel:IndividualKex · Length:2:12 · Published:2023-08-31 · Views:2038411

Watch on YouTube

Summary

A two-minute explainer of 3D Gaussian Splatting, the rendering technique from a 2023 research paper. It outlines why it could change how 3D graphics are made.

Why HN recommends it

HN uses it as a quick, non-expert primer whenever Gaussian splatting comes up.

I really enjoyed this succinct YouTube video on the topic, for those interested in a primer — HN, 2023

Computer graphics & rendering

Subtitles (excerpt)

gaussian splatting it's a way to render stuff really high fidelity really fast it's a big deal because it's totally different from any existing Graphics Pipeline and is capable of rendering scenes that look like this at 144 FPS the original research paper is 3D gaussian spotting for real-time Radiance field rendering what does that mean I'll explain how it works step one take a bunch of pictures of stuff from different angles then use an old algorithm called structure for motion to estimate a point cloud from the pictures at different angles step two take every point in the point cloud and say you're a gaussian now a distribution that looks like this but in 3D and also can be skewed which is what I like to call multivariate everyone calls that we also assign a color and an alpha now we can put all these gaussians into one giant Matrix with 16 columns and rows one for every gaussian this is all the data we need to represent the scene so are we done no step three rasterization meaning turn all these gaussians into an image the simplified version is according to your camera perspective project the gaussians into 2D then sort them by depth then for every pixel iterate over every gaussian front to back calculate their contribution to that

On Hacker News

This 2-minute video is a great intro to the topic [VIDEO] I think this tech has become "production-ready" recently due to a combination of research progress (the seminal paper was published in 2023 [LINK] ) and improvements to differentiable programming libraries (e.g. PyTorch) and GPU hardware. — KerrickStaley, 2026-01
I am a complete layman in the world of complex computer graphics programming and research, but I have an interest in it as someone who enjoys playing computer games. I really enjoyed this succinct YouTube video on the topic, for those interested in a primer: [VIDEO] — spsesk117, 2023-12
This week I saw a YouTube video which left me impressed regarding Gaussian Splatting. [LINK] I got it recommended because I watched the following video: [VIDEO] Both are worth watching if one didn't know it exists. — qwertox, 2023-10
Youtube recommended this video to me, which concisely explains splatting. Information necessary for trade is there but the trade is left to the viewer. The key drawback that isn't highlighted is that you need a physical space to be a close approximation of what you want to render. So if you want to make a few counter strike maps based off of your workplace (not recommended) then this would be a g… — willis936, 2023-10
> [1] 2 min intro to 3D Gaussian splatting: [VIDEO] I don't know what the hell a "gaussian splat" is and I have to say this video did not help at all. — ghostly_s, 2024-05

Related videos