12.4 C
London
Friday, October 7, 2022

This AI movie is a glimpse into the future of text-to-film generators

Must read

Man gets 4 years for conspiring against Michigan Gov. to kidnap Whitmer

A Michigan man who conspired with others to kidnap Michigan Governor Gretchen Whitmer in 2020 was sentenced Thursday to four years in prison, federal...

Tesla Semi-Production Begins with Pepsi Getting First Deliveries • londonbusinessblog.com

Tesla CEO Elon Musk tweeted Thursday that production of its long-delayed all-electric semi-truck has begun with first deliveries beginning in December. The automaker introduced an...

SaaS platform Klikit saves restaurant kitchens from “tablet hell” • londonbusinessblog.com

The proliferation of delivery services gives customers many options, but spells chaos for busy restaurants that need to manage orders across multiple apps and...

Limit reached – Join the EU Startups CLUB

€147/quarter This option is ideal for companies and investors who want to keep up to date with Europe's most promising startups, have full access...
Shreya Christinahttps://londonbusinessblog.com
Shreya has been with londonbusinessblog.com for 3 years, writing copy for client websites, blog posts, EDMs and other mediums to engage readers and encourage action. By collaborating with clients, our SEO manager and the wider londonbusinessblog.com team, Shreya seeks to understand an audience before creating memorable, persuasive copy.

If you are impressed by the recent wave of text-to-image generators, get ready for the next step in AI art: text-to-video.

While the enormous computational costs and scarcity of text-to-video datasets have hindered the growth of the technology, recent research has brought the promise closer to reality.

A computer artist named Glenn Marshall has given a glimpse of its potential.

Greetings, Humanoids

Sign up for our newsletter now for a weekly roundup of our favorite AI stories delivered to your inbox.

The Belfast-based composer recently won the Jury Award at the Cannes Short Film Festival for his AI film The crow.

Marshall had previously received praise for an AI-generated Daft Punk video, but he took a different approach: The crow.

While his earlier technique changed text to random visual mutations, The crow uses an underlying movie as an image reference.

“I was heavily into the idea of ​​AI-style transmission using video as a source,” Marshall told TNW.

“So every day I was looking for something on YouTube or stock video sites and trying to make an interesting video by abstracting it or turning it into something else with my techniques.

“It was at this time that I discovered Painted on YouTube — a short live-action dance film — that would become the basis of The crow.”

Marshall fed the video frames from Painted until CLAMPa neural network created by OpenAI.

He then asked the system to generate a video of “a painting of a crow in a desolate landscape.”

Marshall says the output required little cherry picking. He attributes this to the similarity between the prompt and the underlying video, in which a dancer in a black scarf mimics the movements of a crow.

“It’s this that makes the movie work so well, as the AI ​​tries to make every live action frame look like a painting with a crow in it, so I meet it halfway through, and the movie becomes sort of a battle between man and man. the AI ​​– with all the suggestive symbolism.”

In the future, Marshall plans to add 3D animation to his AI creations. He is also exploring CLIP-guided video generation, which can add detailed text-based cues, such as specific camera movements.

That could lead to entire feature films being produced by text-to-video systems. But Marshall believes even his current techniques could gain mainstream recognition.

He says The crow is now eligible for submission to the prestigious BAFTA Awards.

“I have not prepared a speech, but I fantasize about collecting a prize, in the role of an AI herald, and proclaiming to the star-studded audience that [for] all of you, actor, director, set designer, costume designer, artist, composer… AI is coming and you’ll soon have a very different job – or no job at all.”


More articles

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Latest article

Man gets 4 years for conspiring against Michigan Gov. to kidnap Whitmer

A Michigan man who conspired with others to kidnap Michigan Governor Gretchen Whitmer in 2020 was sentenced Thursday to four years in prison, federal...

Tesla Semi-Production Begins with Pepsi Getting First Deliveries • londonbusinessblog.com

Tesla CEO Elon Musk tweeted Thursday that production of its long-delayed all-electric semi-truck has begun with first deliveries beginning in December. The automaker introduced an...

SaaS platform Klikit saves restaurant kitchens from “tablet hell” • londonbusinessblog.com

The proliferation of delivery services gives customers many options, but spells chaos for busy restaurants that need to manage orders across multiple apps and...

Limit reached – Join the EU Startups CLUB

€147/quarter This option is ideal for companies and investors who want to keep up to date with Europe's most promising startups, have full access...

Meta’s Horizon VR Platform Is Too Buggy and Employees Don’t Use It Enough, Says Exec

Meta's VR social network Horizon Worlds - the company's flagship "metaverse" app - suffers from too many quality issues and even the team building...