Coinciding with the start of IBC 2023, Adobe has announced many new features and optimizations to several of their Creative Cloud applications. Based on extensive user feedback, these innovations, which are largely made possible via the integration of AI technology, are included in new beta releases across Premiere Pro, After Effects and Frame.io, The idea is to allow AI-powered features to automate time-intensive tasks so editors and motion designers can concentrate on the creative aspect of their work while improving productivity.
Premier Pro: The new Premiere Pro beta release adds features including Enhance Speech for quicker dialog cleanup, filler word detection and removal in Text-Based Editing, and improved Auto Tone Mapping for more consistent color output. The timeline is said to now be five times faster making all functions smoother and more responsive. The “Enhance Speech” function helps correct sound recording scenarios like a poorly placed mic, excessive background noise or, low-quality archive footage which was previously very difficult to clean up. The use of the mix slider allows for incorporating some of the background noise to make it sound more natural. A new Audio Category Tagging feature uses AI to determine which clips contain dialogue, which contain music, and which are sound effects or ambient noise. When each audio clip is selected, the most relevant tools are automatically displayed. Both of these features process in the background allowing the editor to keep working on other tasks. Text-Based Editing now includes filler word detection to automatically identify “ums” and “uhs” in dialogue. This allows for quick removal of those filler words, pauses or any other unwanted dialogue in one step using bulk delete.
After Effects: New AI rotoscoping abilities streamline After Effects workflows by removing objects faster and more accurately while a new, true 3D workspace integrates 3D models for VFX composites and motion graphics. The new “True 3D Workspace” is said to open the door to an entirely new way to design in motion adding depth and dimension to compositions in a unified space with native import of 3D models. Image-Based Lighting realistically places models into a scene with complementary lighting and shadows using any image as a light source, making objects appear as though they naturally belong in the image. 3D motion graphics are generated using an advanced 3D renderer, with fast performance, high-quality antialiasing, and fantastic transparency. A unique way to combine 2D and 3D in a composition has also been added. Effects that reference another layer, such as Displacement Map, Vector Blur, or Calculations, can use a 3D model layer as a source to create highly stylized renders. Another new feature is “AI-Powered Roto Brush” which helps deal with hard-to-isolate objects such as overlapping limbs, hair, and transparencies to separate from their background. This addition is said to allow editors, motion designers, and VFX artists to shave off hours of tedious rotoscoping work to focus on the more creative aspects of their projects.
New in Frame.io: A combination of AI and new partnerships are designed to help teams customize their workflows to accommodate the ever-increasing demands. “Frame.io Storage Connect” accelerates collaboration and cuts costs for Enterprise customers needing solutions to scale, while maintaining full control of their assets via direct connection to AWS S3 storage with lightweight proxies available in Frame.io. Storage Connect will be available later this year for Frame.io Enterprise customers. “Comparison Viewer” allows users to quickly compare work over a wide range of assets and versions. The comparison viewer now supports viewing video, audio, photo, design file, and PDF assets side-by-side without leaving Frame.io and users can compare any two matching asset types with access to commenting and annotations to carefully consider two different assets, or many versions of an asset or draft. Meanwhile, Frame.io Camera-to-Cloud continues to build momentum, now supporting over over 200+ camera systems through a vast network of integrations. New collaborations with companies such as Atomos and Fujifilm are allowing easy capture and automatic upload of high-quality 10bit 4K H.265 assets to Frame.io after each take. Fujifilm’s new large-format mirrorless GFX-100-II allows photography and video teams to capture and upload 102MP RAW photos and up to 10bit 8K video clips remotely to Frame.io from the 55mm CMOS II HS sensor (11648 x 8736 pixel). This camera boasts a native integration, requiring no additional hardware for camera-to-cloud. Additionally, Accsoon will unveil the SeeMo and SeeMo Pro devices allowing the use of iPhones and iPads as professional video monitoring devices with features similar to those offered by Atomos, Blackmagic Design, or SmallHD. The SeeMo, ideal for mirrorless cameras, attaches to cameras via HDMI. The heavier-duty SeeMo Pro attaches via HDMI or SDI and is perfect for ENG and mid-range cine cameras. With the new C2C integrations, both allow you to monitor, record, and upload lightweight HD H.264 video clips from your connected iPhone or iPad directly to Frame.io.
All these features are available now in beta and are planned to be generally available later this fall. For more information on how to access the beta apps, please visit the Premiere Pro (beta) (https://helpx.adobe.com/premiere-pro/using/premiere-pro-beta.html) and After Effects (beta) (https://helpx.adobe.com/after-effects/using/after-effects-beta.html) pages.