Real-Time In-Camera VFX for Next-Gen Filmmaking | Project Spotlight | Unreal Engine

Channel:Unreal Engine · Length:2:14 · Published:2019-08-01 · Views:1128480

Watch on YouTube

Summary

Epic Games shows how LED walls can provide both virtual backgrounds and real lighting, letting scenes be captured in camera in a single pass with Unreal Engine.

Why HN recommends it

Cited as an example of LED volume virtual production, as used for Star Wars shows, in threads about VFX.

Animation & visual effects · Filmmaking & video production · Game programming & engines

Subtitles (excerpt)

[Footsteps in gravel] [Motorcycle engine revs] >> Great! Let's cut and reset. >> No matter what the project is, creatives always want to see the closest representation to the final product, as early on in the creative process. >> When I first walked on the set and the wall was up and we started to look through the camera, it really started to feel like I was just filming in this actual location. >> We can track a camera's position in space in real-time and render its perspective so that we can compellingly convince a camera that something else is happening in front of it that really isn't there. >> The thing to keep in mind is that the 3D world that you see on the wall, is also a 3D scene that you can manipulate in Unreal Engine, so this gives the filmmakers full flexibility to make any change they want to the scene live. >> It's really exciting to see that we can use the real-time lighting to not only change the environments virtually, but also have it affect the on-set lighting as well. This opens up kind of like a virtual playground to shoot in. >> We've tried to expand the Engine to be a very collaborative platform, so the director of photography the director, they can all go into the scene

On Hacker News

This is a “solved problem” now with technologies like this: [VIDEO] The backgrounds are “real” and can be captured in-camera, so there is no need for special effects to blend hair. Similarly, reflective surfaces aren’t a problem either. This was used to good effect for the Mandalorian series where the protagonist wears shiny metal armour. — jiggawatts, 2022-08
For Netflix, I know what he means, but the article has a hard time describing it. It's kinda like you know what a tiktok video looks like, even when the logo is absent. But here is a better phenomenon. Star wars tv series are all shot in a circular room. Everything is arranged in a virtual circle even when they are outdoors. When you see it, you can't unsee it. Ps: having a hard time finding imag… — firefoxd, 2022-08
Now it seems like Disney is doing the innovating with the way they film stuff for Disney+. [LINK] [VIDEO] Though how much of that is Disney and how much is the companies they worked with is unknown to me. — Kye, 2022-07
Although you mean well, this sounds a lot like "why does<X poor country> launch satellites or do science when their population is starving". Doing one doesn't contradict the other. Can't afford to just keep narrowing down on existing customer base. They need to keep expanding and competing, for e.g. with Unreal [VIDEO] — rdsubhas, 2022-03
> This is a “solved problem” now with technologies like this: [VIDEO] The backgrounds are “real” and can be captured in-camera, so there is no need for special effects to blend hair. Similarly, reflective surfaces aren’t a problem either. While at the same time, when seeing that initial shot I could immediately tell the background was fake. Like in any fake-ass marvel-movie. And I’m not into VFX … — josteink, 2022-08

Related videos