Real-Time In-Camera VFX for Next-Gen Filmmaking | Project Spotlight | Unreal Engine
Channel:Unreal Engine · Length:2:14 · Published:2019-08-01 · Views:1128480
Summary
Epic Games shows how LED walls can provide both virtual backgrounds and real lighting, letting scenes be captured in camera in a single pass with Unreal Engine.
Why HN recommends it
Cited as an example of LED volume virtual production, as used for Star Wars shows, in threads about VFX.
Animation & visual effects · Filmmaking & video production · Game programming & engines
Subtitles (excerpt)
[Footsteps in gravel] [Motorcycle engine revs] >> Great! Let's cut and reset. >> No matter what the project is, creatives always want to see the closest representation to the final product, as early on in the creative process. >> When I first walked on the set and the wall was up and we started to look through the camera, it really started to feel like I was just filming in this actual location. >> We can track a camera's position in space in real-time and render its perspective so that we can compellingly convince a camera that something else is happening in front of it that really isn't there. >> The thing to keep in mind is that the 3D world that you see on the wall, is also a 3D scene that you can manipulate in Unreal Engine, so this gives the filmmakers full flexibility to make any change they want to the scene live. >> It's really exciting to see that we can use the real-time lighting to not only change the environments virtually, but also have it affect the on-set lighting as well. This opens up kind of like a virtual playground to shoot in. >> We've tried to expand the Engine to be a very collaborative platform, so the director of photography the director, they can all go into the scene
On Hacker News
This is a “solved problem” now with technologies like this: [VIDEO] The backgrounds are “real” and can be captured in-camera, so there is no need for special effects to blend hair. Similarly, reflective surfaces aren’t a problem either. This was used to good effect for the Mandalorian series where the protagonist wears shiny metal armour. — jiggawatts, 2022-08
For Netflix, I know what he means, but the article has a hard time describing it. It's kinda like you know what a tiktok video looks like, even when the logo is absent. But here is a better phenomenon. Star wars tv series are all shot in a circular room. Everything is arranged in a virtual circle even when they are outdoors. When you see it, you can't unsee it. Ps: having a hard time finding imag… — firefoxd, 2022-08
Now it seems like Disney is doing the innovating with the way they film stuff for Disney+. [LINK] [VIDEO] Though how much of that is Disney and how much is the companies they worked with is unknown to me. — Kye, 2022-07
Although you mean well, this sounds a lot like "why does<X poor country> launch satellites or do science when their population is starving". Doing one doesn't contradict the other. Can't afford to just keep narrowing down on existing customer base. They need to keep expanding and competing, for e.g. with Unreal [VIDEO] — rdsubhas, 2022-03
> This is a “solved problem” now with technologies like this: [VIDEO] The backgrounds are “real” and can be captured in-camera, so there is no need for special effects to blend hair. Similarly, reflective surfaces aren’t a problem either. While at the same time, when seeing that initial shot I could immediately tell the background was fake. Like in any fake-ass marvel-movie. And I’m not into VFX … — josteink, 2022-08
Related videos
- The Beauty of Bézier Curves · Freya Holmér · 24:25
- Overwatch Gameplay Architecture and Netcode · GDC Festival of Gaming · 1:04:03
- Ed Catmull, Pixar: Keep Your Crises Small · Stanford Graduate School of Business · 54:11
- RustConf 2018 - Closing Keynote - Using Rust For Game Development by Catherine West · Rust Programming Language · 42:29
- A Deep Dive into Nanite Virtualized Geometry · SIGGRAPH Advances in Real-Time Rendering · 1:09:59
- How Crash Bandicoot Hacked The Original Playstation | War Stories | Ars Technica · Ars Technica · 31:37
- Jonathan Blow - How to program independent games - CSUA Speech · Alexandre Franco · 1:15:50
- Ideas about a new programming language for games. · Jonathan Blow · 1:55:24
- "Money doesn't interest me" - Ton Roosendaal 2017 Interview · Blender Guru · 1:46:51
- Jackie Chan - How to Do Action Comedy · Every Frame a Painting · 9:04
- DNA animation (2002-2014) by Drew Berry and Etsuko Uno wehi.tv #ScienceArt · WEHImovies · 7:19
- Exploring the Tech and Design of Noita · GDC Festival of Gaming · 31:00
- Casey Muratori – The Big OOPs: Anatomy of a Thirty-five-year Mistake – BSC 2025 · Better Software Conference · 2:27:33
- Miguel de Icaza: Swift Godot: Fixing the Multi-million dollar mistake #GodotCon2023 · Godot Engine · 54:52
- QuakeCon 2012 - John Carmack Keynote · QuakeCon Official · 3:36:38
- "NO CGI" is really just INVISIBLE CGI - 1 · The Movie Rabbit Hole · 16:30