AI-generated videos have arrived, and they’re evolving fast

By

Alan Truly

March 27, 2023 4:10PM

In a few short months, the world of generative AI has evolved from chatbots like ChatGPT to photorealistic images created by Midjourney. In case you thought things were slowing down any time soon, AI-generated videos might be about to have their big moment in the spotlight.

As highlighted by a tweet from Philipp Tsipman, the founder of a marketing platform for such videos, there have been five new AI video generators launched in just the last seven days. The quality varies, but it’s clear that the technology is moving at a relentless pace. So, let’s break down the five AI video generators, which range from janky to seriously impressive.

If you’re having trouble keeping up with Video AI😅, there have been 5 state-of-the-art generative video models released *in last 7 days*: 🤯😎🧵 pic.twitter.com/cki9SMfozr

— Philipp Tsipman (@ptsi) March 26, 2023

Runway

Runway has been leading the pack in publicly available AI editing. Masking, motion-tracking, super slow-motion, and color grading all benefit from AI assistance. This is a subscription-based service, so it has extra incentive to push the limits.

In February, Runway started testing generative video with its Gen-1 update, which lets you restyle a video with words. A video of a walk down the street becomes an animated short that appears to be made with hand-sculpted and posed Claymation characters.

Runway released Gen-1 publicly today and is already testing Gen-2, eliminating the need for a reference video. Soon, Runway will let you create a video with a simple text prompt.

Picsart

You might recognize Picsart as a free photo editor, but it also offers video editing. Text2Video-Zero is a Picsart research tool that uses the Stable Diffusion AI image generator to create multiple frames with enough in common to look cohesive.

This is significant progress. as early experiments at assembling AI images as video frames produced chaotic scenes where every detail constantly shifted. The effect was eye-catching, but distracted from the content.

Video-P2P
Video-P2P is an open-source project similar to Runway Gen-1. It takes video input and uses Stable Diffusion to style it with text prompts. The examples shown look good, with steady backgrounds and consistency in the altered elements.

TemporalNet
TemporalNet is based on ControlNet, an advanced AI image generator that allows more control of the poses of figures that appear in pictures.

The videos have some flicker, but the results are promising. ControlNet took a big step toward producing predictable scenes, and TemporalNet might provide a nice alternative method of creating videos.

Text-to-video
Text-to-video is an AI model created by Alibaba. It’s clear that this model needs a bit more work, but having more options to explore is always a good thing.

fast & longer text-to-video with 🧨 diffusers

you maybe saw fun junky text-to-video from the ModelScope’s research model lately

with diffusers you can control how long the video is – and fit it on smol VRAM GPUs, including free colab. Try out here:https://t.co/uPVd9hEOtr pic.twitter.com/mIFkGnGT5V

— poli from multimodal art (@multimodalart) March 22, 2023

Fast-paced innovation
The rapid pace of AI innovation is phenomenal. Just months ago, we were teased with glimpses of the potential of similar videos created in AI labs. In 2022, one of the first public AI video generators simply superimposed tiny AI images over stock footage.

Those “old school” methods, from a few months ago, are laughable when you see how far AI has progressed in such a short amount of time.

Editors’ Recommendations

How to use Bing Image Creator to generate AI images for free

The best AI image generators to create art from text

AI image generators appear to propagate gender and race stereotypes

Resident Evil 4 Remake PC: best settings, ray tracing, FSR, and more

Resident Evil 4 Remake is undoubtedly one of the most visually impressive PC releases we’ve seen in the past few years. Leveraging the highly scalable RE Engine, the game looks great while accommodating a wide range of hardware. In this guide, we’re going to help you find the best settings.

In addition to the flexible engine, Resident Evil 4 Remake includes upscaling options and ray tracing to push high-end rigs to their limit. I’ve spent a few hours testing the game to dig into how ray tracing performs, what the best settings are, and what you can expect out of upscaling.

Best settings for Resident Evil 4 Remake

Read more

This Lenovo 2-in-1 laptop just had its price cut to $630

If you want a laptop but also love the convenience and flexibility of a tablet, consider buying a 2-in-1. These are great combo devices that work exactly like both devices, saving you the money and hassle of buying both. You can save even more money if you shop Lenovo’s 2-in-1 laptop deals. Right now the Lenovo IdeaPad Flex 5 is $298 off. You can grab it for only $632 instead of its usual $930. Let us tell you why we love it.

Why you should buy the Lenovo IdeaPad Flex 5

Lenovo’s IdeaPad line of laptops offers budget and midrange devices, according to our explainer on the different Lenovo brands, and the Lenovo IdeaPad Flex 5 builds upon it by adding various forms to use in different situations. The device features 360-degree hinges connecting its 14-inch Full HD touchscreen to its body, so you can switch from laptop mode to tablet mode by folding the display all the way back. You can also use it in tent mode, where the screen is propped up by the body, and in stand mode, where the keyboard is facing down and flat on your desk so you can focus on what’s on the screen.

Read more

Best Buy is having a clearance sale on gaming laptops — from $580

Best Buy is having a ton of great gaming laptop deals this weekend. Everything from budget HP laptops to high-end Alienware devices are getting big price cuts. We’ve picked out our favorites below. Don’t expect these deals to stick around all weekend though — grab them while they’re still available.

HP Victus Gaming Laptop — $580, was $800

The HP Victus gaming laptop appears in our list of the best gaming laptops as a great budget option, because you’ll be able to play the best PC games with its 12th-generation Intel Core i5 processor, Nvidia GeForce GTX 1650 graphics card, and 8GB of RAM — though you may have to choose the lowest settings for some of the more demanding titles. The gaming laptop features a 15.6-inch screen with Full HD resolution and a 144Hz refresh rate, and a 512GB SSD with Windows 11 Home pre-installed.

Read more

Source: Digital Trends | Read More