Viridian's Runway Gen3 AI Animations

[Viridian]

An updated AI render of Crossfire, with new AI images made with EpicRealism V5, animated with RunwayML Gen-3 Alpha and KlingAI. Fully voiced and lip-synced.

Well done. There's some real progress. I couldn't tell what was rendered with what but I'm guessing the actual sinking parts were handled by Runway? Were the voices from Runway as well? Very cool.

Images made with Mage Space (Stable Diffusion, EpicRealism V5). Environments, walking animations with RunwayML. Sinking animations with KlingAI. Voices with D-iD. Lip-sync with Runway.

[pucipal]

An updated AI render of Crossfire, with new AI images made with EpicRealism V5, animated with RunwayML Gen-3 Alpha and KlingAI. Fully voiced and lip-synced.

Awesome!

[Viridian]

Hey Viridian, I've been playing around with Kling with some success some not success. What have you been using for your prompts and negative prompts? Sometimes the women will not sink at all, other times they'll literally float out of the sand lol

For starters, I only use image-to-video. I greatly prefer my style of AI imagery over what it produces on its own, as it is more reliable and controllable. Without it, it will generally create water. The key is therefore to have a very good source image. Thankfully, KlingAI is very good at interpreting mud textures, while most AI can't. The more it resembles sand or soil, the easier it is to render the right interaction.

I tend to use "sinking in sandy mud" or "stuck in sandy mud", which you can see with this source image. This generally works fine, though I also tend to put "water" in negative prompts to be safe, though this usually doesn't do much.

[MDLambert]

I have been tinkering with Kling using the daily free credits but if i do image to video it takes a full 24 hours to get a result, and often it gives me a process failed. Text video generation is much faster but lousy quality.

[MDLambert]

lol I am so tired of getting good looking quicksand only for the character to rise up out of it, for the life of me Its so hard to get them to sink.

[Boggy Man]

lol I am so tired of getting good looking quicksand only for the character to rise up out of it, for the life of me Its so hard to get them to sink.

How about putting the video in reverse?

[MDLambert]

I thought about it but I cant find a free video editor that will do it

[Chimerix]

I thought about it but I cant find a free video editor that will do it

DaVinci Resolve.

While there is a paid version, the free version has 95% of the functionality, missing only a few high-end options. And, yes, it can play video backwards!

[MDLambert]

I'll give that a look! Heres something i made today.

BeachQS.mov

[MDLambert]

A decent result, a QS scene in the Pixar style, an adult female trapped deep.

Pixquicks.mp4