Adobe has previewed some exciting new generative AI features coming to Adobe Premiere Pro later this year. These nw capabilities, powered by Adobe's Firefly AI model and integrations with third-party models, could significantly change video creation and production workflows.
It is no secret that Adobe has been working on a foundation text-to-video AI model, with the company even paying creators to submit video clips to be used for training. Today, the company has shared a preview of what those capabilties could look like in upcoming releases of its Premiere Pro video editing application.
In addition to its own AI model, Adobe is exploring the integration of third-party generative AI models Like Sora, Runway and Pika directly into Premiere Pro. The generative AI workflows previewed for Premiere Pro include:
- Generative Extend: Seamlessly add frames to make clips longer, so it’s easier to perfectly time edits and add smooth transitions. This technology solves a common problem professional editors run into every day, allowing them to create extra media for fine-tuning edits, to hold on a shot for an extra beat or to better cover a transition.
- Object Addition & Removal: Simply select and track objects, then replace them. Remove unwanted items, change an actor’s wardrobe or quickly add set dressings such as a painting or photorealistic flowers on a desk.
- Text to Video: Generate entirely new footage directly within Premiere Pro. Simply type text into a prompt or upload reference images. These clips can be used to ideate and create storyboards, or to create B-roll for augmenting live action footage.
"Adobe is reimagining every step of video creation and production workflow to give creators new power and flexibility to realize their vision," said Ashley Still, senior vice president, Creative Product Group at Adobe. "By bringing generative AI innovations deep into core Premiere Pro workflows, we are solving real pain points that video editors experience every day, while giving them more space to focus on their craft."
The company has also reiterated that content credentials will be attach to any asset produced within its applications providing transparency on how content was created and which AI models were used.
Chris McKay
In addition to the generative AI video tools, Adobe has announced the general availability of AI-powered audio workflows in Premiere Pro. These features, including interactive fade handles, AI-based audio category tagging, effect badges, and redesigned waveforms, will be available to customers in May.