Did We Just Change Animation Forever?

Channel:Corridor Crew · Length:23:02 · Published:2023-02-26 · Views:3499988

Watch on YouTube

Summary

Corridor Crew explain how they made an anime short by filming themselves and running the footage through custom-trained Stable Diffusion models. The video walks through the technique and its open-source foundations.

Why HN recommends it

HN cites it as an example of temporally stable AI video stylization built from ordinary production gear.

let the results speak for themselves — HN, 2023

LLMs & generative AI · Animation & visual effects

Subtitles (excerpt)

wouldn't it be cool if you could film yourself and easily turn into anything you want like a cartoon character like what is this could just be a means of capturing performance and you can visualize whatever your imagination wants afterwards there's kind of No Limits creativity is only accessible to films or animations with multi-million dollar budgets but it's part of our Humanity to try to visualize things that don't exist like let's talk about traditional 2D animation cartoons the most creatively liberated medium is also the least democratized it takes incredibly skilled people drawing every single frame of your movie to make it happen but I think we came up with a new way to animate a way to turn reality into a cartoon it's one more step towards true creative freedom where we can easily create anything we want so how do we do this how do we turn a video into a cartoon well we've been making a series of videos where we experiment with AI image processing this is similar to AI image generation but in our case we are transforming images rather than generating them from scratch so one of the newest pieces of technology is a machine learning process known as diffusion at its core the diffusion process lets computer generate an image from noise much like how we

On Hacker News

I thought Midjourney was better as well, until I saw some recent videos from Corridor Crew on Youtube. For those who don't know, this is a VFX studio in LA that tries to keep at the cutting-edge of video production techniques and posts content to their Youtube channel, and they have a massive number of followers and several viral videos. They recently created a full 7-minute anime using Stable Di… — samspenc, 2023-03
> There was a video of some guys doing this (sorry can’t find it) to make an anime type animation. With consistent characters. They used videos of themselves running through their own models to make the characters. That was Corridor Crew: [VIDEO] — someperson, 2024-02
The characters here are processed with Stable Diffusion. This is an impressive progress in the field of video generation with help of AI, considering how consistent the generated characters look like across frames, in my opinion. Also here is another video [VIDEO] "Did We Just Change Animation Forever?" where they demonstrated how it came to be. — Kelamir, 2023-03
This reminds me alot of this techniquefor turning live action into animation: [VIDEO] It unsurprisingly received alot of pushback from people in the industry but I think it's really impressive. — yummypaint, 2023-03
The issues you mention with Stable Diffusion are teething issues. Here's an example of a current technique to get temporally stable animations with Stable Diffusion - [LINK] Corridor digital show off a similar technique here - [VIDEO] GPT4 with its new plugin architecture is rapidly becoming more capable. I think you're absolutely correct in the tendency of all LLMs to hallucinate is a major issu… — dbspin, 2023-03

Related videos