Home » Subsequent Degree Text-To-Video AI Is Here — Runway Gen-2 | by Jim Clyde Monge | Jun, 2023

Subsequent Degree Text-To-Video AI Is Here — Runway Gen-2 | by Jim Clyde Monge | Jun, 2023

by Narnia
0 comment

Of course, as at all times, I will probably be testing it myself to get a way of what the brand new mannequin can do, and I’ll share the outcomes with you. Let’s dive in.

How it really works

Under the Generate Videos tab, choose “Gen-2: Text to Video”.

Runway Gen-2: Text to Video. Generate video screen
Runway Gen-2: Text to Video

A brand new window will open, that includes a big textual content field the place you may describe the video you want to create.

Runway Gen-2: Text to Video. Generate video screen enter your text here
Runway Gen-2: Text to Video

Let’s do that instance:

Prompt: lovely creatures swimming underneath the ocean

Runway ML Gen2 Prompt: beautiful creatures swimming under the sea
GIF by Jim Clyde Monge

The video technology took round 5 minutes with my free account on Runway. It’s spectacular — there’s minimal flickering, the styling is constant throughout frames, and the body interpolation may be very clean.

You wouldn’t imagine it was AI-generated.

Let’s strive one other instance:

Prompt: An astronaut floating in house

Runway ML Text-to-video Gen 2: Prompt: An astronaut floating in space
GIF by Jim Clyde Monge

This time, there are some points. The astronaut’s legs look odd, and an undesirable asteroid appears to be floating too near the topic. I’m not impressed.

For a remaining take a look at, I’ll give it a fancy immediate.

Prompt: A teddy bear washing the dishes carrying a inexperienced apron and standing on a wood chair

Runway ML Text-to-video Gen 2: Prompt: A teddy bear washing the dishes wearing a green apron and standing on a wooden chair
GIF by Jim Clyde Monge

The AI clearly didn’t correctly render the proper video right here. It’s neither washing the dishes nor standing on a wood chair. Again, not spectacular.

Use your personal picture

You can even add your personal picture to offer inspiration to the AI.

Runway ML Text-to-video Gen 2. Use your own image
Runway Gen-2

Here’s how my enter picture and the output video look facet by facet.

You may also like

Leave a Comment