Adobe teases AI tools for animating text and removing distractions

Adobe is previewing some experimental AI tools for animation, image generation, and cleaning up video and photographs that could eventually be added to its Creative Cloud apps.

While the tools apply to vastly different mediums, all three have a similar aim — to automate most of the boring, complex tasks required for content creation, and provide creatives more control over the results than simply plugging a prompt into an AI generator. The idea is to enable people to create animations and images, or make complex video edits, without requiring a great deal of time or experience.

The first tool, called “Project Scenic,” gives users more control over the images generated by Adobe’s Firefly model. Instead of relying solely on text descriptions, Scenic actually generates an entire 3D scene that allows you to add, move, and resize specific objects. The final results are then used as a reference to generate a 2D image that matches the 3D plan.

Next up is “Project Motion,” a two-step tool that can be used to easily make animated graphics in a variety of styles. The first stage is a simple animation builder which allows creatives to add motion effects to text and basic images, without prior experience in animating. The second stage then takes this animated video and transforms it using text descriptions and reference images — adding color, texture, and background sequences.

“Project Clean Machine” is an editing tool that automatically removes annoying distractions in images and videos, like camera flashes and people walking into frames. It’s almost like an automated content-aware fill, only better as this also corrects any unwanted effects caused by the visuals you’re trying to remove. For example, if a background firework causes a few seconds of the shot to be overexposed, Clean Machine will ensure the color and lighting are still consistent throughout the video when the flash itself is removed.

These tools are being announced at Adobe’s MAX conference as “Sneaks” — what the company refers to as in-development projects that aim to showcase new technology and gauge public interest. There’s no guarantee that a Sneak will get a full release, but many features like Photoshop’s Distraction Removal and Content-Aware Fill in After Effects have roots in these projects.

We got an early glimpse of these sneaks ahead of their announcements, so we’ll get a better look when they’re demonstrated later today. None of these tools are available for the public to try out yet, but that may change over the coming months.