Runway Gen-3 Alpha Image-to-Video (First/Last Frame Update)

Well frens, if you don’t feel like looking at the crypto charts right now, you might want to try some of the recently announced features from Runway (it’s probably better for your mental well-being).

Last month, Runway announced an image-to-video update for its revolutionary Gen-3 Alpha model. The results were incredible as AI artists posted their creations on X.

On August 5th, Runway announced a brand new feature for Gen-3 Alpha where you can use an image as the first or last frame of a generated video. Again, some of the creations posted on X are out of this world. It’s like having a VFX (visual effects) studio in the palm of your hand. So, I wanted to give it a try for myself.

Method

As per the announcement, the new feature can be used independently or combined with a text prompt. So that gives us 4 new combinations to test:

• An image with no prompt as the last frame
• An image with no prompt as the first frame
• An image with a prompt as the last frame
• An image with a prompt as the first frame

No Prompt, Last Frame

I created this image of a troll under a bridge a long time ago for a video that I never started. So I thought I would try to bring him to life. I figured this image was dynamic enough that it didn’t need a prompt.

Results

It’s amazing how the generation has almost zero distortion of such a detailed image, especially as the video clip zooms in on the image. An older version of Runway would have distorted the image, so this is a huge improvement. You can see how the last second of the clip is the same image as the image used for the input.

No Prompt, First Frame

I’m not sure where my head was at when I created this image, but it’s creepy, to say the least. I might have been thinking about how man never really lost his wild side and how we’ve remained the ultimate predator throughout time.

Results

 

I think the main result when using no prompt with the new first/last feature is how little distortion there is. Previous versions would distort most images and could be very frustrating (and costly) if you were aiming for a coherent video clip.

Prompt, Last Frame

I’m a bit of a space nerd, so I wanted to pay homage to the iconic Challenger days. I remember watching multiple Challenger missions as a kid, including the tragic disaster in 1986. But this is my tribute to the engineers and astronauts who sacrificed their time, energy, and lives.

Prompt: Complex mathematical equations swirl around time and space surrounded by bending space and time.

Results

This is by far my favorite result. It honestly reminds me of a professional studio visual effects clip from a movie. I could see this scene being used as an introduction clip to the beginning of a shuttle launch, or some type of time-lapse scene highlighting all the math and calculations that went into the preparation for launch. This is a truly remarkable result – well done Runway!

Prompt, First Frame

For this one, I wanted to test the VFX capability of the new feature. I decided to see if I could make a mural come to life. I love tigers, so why not bring a mural of a tiger to life in the heart of the city?

Prompt: The tiger leaps off of the wall and onto the street.

Results

The composition might not be perfect, but the visual effects are pretty amazing. The first frame stays true to the source image, and then the tiger comes to life, leaps out of the mural, runs along the wall, and lands on the street. It’s striking how Runway creates a new scene as the shot unfolds. Impressive!

Final Thoughts

The new update from Runway represents a significant leap forward in AI-generated content. With its ability to seamlessly integrate images as first or last frames in video creation, it empowers users to unleash their creativity like never before. This tool not only enhances visual storytelling but also bridges the gap between static art and dynamic media. As technology continues to evolve, we can only anticipate even more innovative features and refinements from Runway, making it an essential asset for artists and creators alike. The potential for creating immersive and engaging visuals will undoubtedly expand, positioning Runway as a leader in the industry.