As an AI fanatic, I’ve been carefully following the progress of AI-generated movies in current months. It’s been one of many hardest issues to unravel, and never a variety of instruments have been developed but.
I used to be significantly excited to see the current launch of AnimateDiff, a brand new text-to-video AI instrument that’s free and open-source. Until now, the one different viable possibility was Runway ML, however it’s not free and requires a month-to-month subscription.
What is AnimateDiff?
AnimateDiff is a framework designed to increase customized text-to-image fashions into an animation generator with out the necessity for model-specific tuning. After studying movement priors from giant video datasets, AnimateDiff might be included into customized text-to-image fashions, whether or not these fashions are educated by the consumer or downloaded from platforms like CivitAI or Huggingface.
Here’s the way it works:
Step 1: Open AnimateDiff on HuggingFace
Create a free account on HuggingFace and open the AnimateDiff house.
You don’t must, however it’s advisable to duplicate the house to keep away from the queue.
Step 2: Select the DreamBooth mannequin and add textual content prompts
You have loads of choices obtainable for the DreamBooth mannequin. Refer to every mannequin’s webpage on CivitAI to learn to write prompts for them.
For the movement module, you may choose both mm_sd_v14.ckpt and mm_sd_v15.ckpt however it’s really useful to attempt each fashions.
