This startup uses AI to automatically trim videos—even where there’s no dialogue

Plenty of people and organizations are producing online video, but editing it for posting to different social media platforms can be a laborious task.

A startup called OpusClip offers AI-powered tools that can automatically turn longer videos into short form, vertical video clips designed for social media, and even post them directly to popular platforms like TikTok, Instagram, LinkedIn, and X. Since its launch last June, OpusClip has been used by customers including billboard.com, Telefónica, Univision, and roughly six million other users. 

OpusClip, which first launched last June, lets users specify the format of video they want to generate, including how long videos should be, how the screen should be split for discussions between multiple speakers, and what fonts should be used for auto-generated captions. Users can make tweaks to the generated clips within the tool, or export them for heavier duty edits in a third-party platform like Adobe Premiere, but cofounder and CEO Young Zhao says a big part of the product’s appeal is that it’s essentially fully automated, with minimal learning curve.

[Photo: Opus Clip]

“It’s not a video editor,” says Zhao, who previously operated a talent agency operating in Shanghai and Singapore. “It’s your autonomous video editing agent that actually does the work for you.”

A free plan lets users process up to 60 minutes of video per month, while paid plans at $15 or $29 per month add additional processing time and features like enhanced social media scheduling, access to AI-generated B-roll material, and silence removal.  

Now, a new feature called ClipAnything, currently in beta, will give users more flexibility to control how the AI clips videos. Users will be able to indicate the type of material they’re editing, such as sports or interview content, enter a freeform text prompt specifying what they’re looking for—like all the shots of a particular athlete scoring, scenes where a food reviewer reacts to a particular dish, or even the parts most likely to go viral on social media.

And unlike other tools on the market that use AI to edit video based solely around transcribed dialogue, ClipAnything also analyzes visual elements and audio beyond voice to understand actions, emotions, and events taking place in videos. The tool can even detect funny bits of a video, Zhao says.

The company, which announced Tuesday it’s received a total of $30 million in funding, including a Series A round led by venture capital firm Millennium New Horizons, continually trains its models based on user feedback and based on how generated videos perform on platforms like YouTube, says cofounder and CTO Jay Wu. That can help the algorithm get better over time at understanding particular kinds of content, like music videos or videos of particular video games.

“These data help us actually train our models to understand what clips are good, and how to find better and better highlight moments,” he says. “So that is how we gain better and better results based on the data we have.” 

[Photo: Opus Clip]

Already, the product can save hours of work manually editing long videos down to short ones—and enable video creators who previously didn’t have the time, skills, or software to create short clips. “People just don’t have resources, or it wastes so much time to do this before,” says Grace Wang, OpusClip’s cofounder and chief marketing officer.

ClipAnything is slated to emerge from beta within a few months after some more refinements, Zhao says. And in the future, users can expect more features to easily enhance video material without having to master a full-fledged editing tool, he says.

“The automation of the workflow is something we invest the majority of our resources on,” he says.

https://www.fastcompany.com/91178960/opusclip-ai-videos-social-media?partner=rss&utm_source=rss&utm_medium=feed&utm_campaign=rss+fastcompany&utm_content=rss

Creato 8mo | 27 ago 2024, 17:10:04


Accedi per aggiungere un commento

Altri post in questo gruppo

AI tools from Google, LinkedIn, and Salesforce could help you find your next job

Sometimes, you need to shake things up in your career. Maybe the job isn’t as fulfilling anymore. Maybe changing circumstances are pushing you toward a new path. Either way, figuring out what to d

4 mag 2025, 05:50:02 | Fast company - tech
How Zipline’s Keller Cliffton built the world’s largest drone delivery network

Zipline’s cofounder and CEO Keller Cliffton charts the company’s recent expansion from transporting blood for lifesaving transfusions in Rwanda to retail deliveries across eight countries—includin

3 mag 2025, 13:30:10 | Fast company - tech
Skype is shutting down. If you still use it, like I do, here are some alternatives

When Skype debuted in 2003, it was the first time I remember feeling that an individual app—and not just the broader internet—was radically disrupting communications.

Thanks to its imple

3 mag 2025, 11:20:04 | Fast company - tech
This free app is like Shazam for bird calls

It’s spring, and nature is pulling me away from my computer as I write this. The sun is shining, the world is warming up, and the birds are chirping away.

And that got me thinking: What

3 mag 2025, 11:20:03 | Fast company - tech
‘Read the room, girl’: Running influencer Kate Mackz faces backlash over her White House interview

Wake up, the running influencers are fighting again. 

In the hot seat this week is popular running influencer Kate Mackz, who faces heavy backlash over the latest guest on her runni

2 mag 2025, 21:20:07 | Fast company - tech
Half of Airbnb users in the U.S. are now interacting with its AI customer service agent

Half of Airbnb users in the U.S. are now using the company’s AI-powered customer service agent, CEO Brian Chesky said Thursday

2 mag 2025, 21:20:05 | Fast company - tech
What your emoji use says about your personality

Are you guilty of overusing the monkey covering its eyes emoji? Do you find it impossible to send a text without tacking on a laughing-crying face?

Much like choosing between a full stop

2 mag 2025, 16:40:07 | Fast company - tech