Coinciding with the start of IBC 2023, Adobe has announced many new features and optimizations to several of their Creative Cloud applications.  Based on extensive user feedback, these innovations, which are largely made possible via the integration of AI technology, are included in new beta releases across Premiere Pro, After Effects and Frame.io,  The idea is to allow AI-powered features to automate time-intensive tasks so editors and motion designers can concentrate on the creative aspect of their work while improving productivity.

Premier Pro:  The new Premiere Pro beta release adds features including Enhance Speech for quicker dialog cleanup, filler word detection and removal in Text-Based Editing, and improved Auto Tone Mapping for more consistent color output. The timeline is said to now be five times faster making all functions smoother and more responsive.  The “Enhance Speech” function helps correct sound recording scenarios like a poorly placed mic, excessive background noise or, low-quality archive footage which was previously very difficult to clean up. The use of the mix slider allows for incorporating some of the background noise to make it sound more natural.  A new Audio Category Tagging feature uses AI to determine which clips contain dialogue, which contain music, and which are sound effects or ambient noise. When each audio clip is selected, the most relevant tools are automatically displayed. Both of these features process in the background allowing the editor to keep working on other tasks. Text-Based Editing now includes filler word detection to automatically identify “ums” and “uhs” in dialogue. This allows for quick removal of those filler words, pauses or any other unwanted dialogue in one step using bulk delete.

After Effects:  New AI rotoscoping abilities streamline After Effects workflows by removing objects faster and more accurately while a new, true 3D workspace integrates 3D models for VFX composites and motion graphics. The new “True 3D Workspace” is said to open the door to an entirely new way to design in motion adding depth and dimension to compositions in a unified space with native import of 3D models. Image-Based Lighting realistically places models into a scene with complementary lighting and shadows using any image as a light source, making objects appear as though they naturally belong in the image. 3D motion graphics are generated using an advanced 3D renderer, with fast performance, high-quality antialiasing, and fantastic transparency. A unique way to combine 2D and 3D in a composition has also been added. Effects that reference another layer, such as Displacement Map, Vector Blur, or Calculations, can use a 3D model layer as a source to create highly stylized renders.  Another new feature is “AI-Powered Roto Brush” which helps deal with hard-to-isolate objects such as overlapping limbs, hair, and transparencies to separate from their background.  This addition is said to allow editors, motion designers, and VFX artists to shave off hours of tedious rotoscoping work to focus on the more creative aspects of their projects.