# US 2026/0087715 A1 · Automatic animation of visual content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0087715 A1
- Document ID: US20260087715A1
- Status: Published application
- Kind: A1
- Application number: 19/004,073
- Filed: 2024-12-27
- Published: 2026-03-26
- Earliest claimed: 2024-09-26
- Assignees: Adobe Inc.
- Applicants: Adobe Inc.
- Inventors: Cuong NGUYEN; Wilmot Wei-Mau LI; Vickramaditya DHAWAL; Stephen Joseph DIVERDI; Seth WALKER; Nicole LAM; Matthew FISHER; Lily KHONG; Kurt HESTON; Kathryn NASH; Joaquin Cruz BLAS, JR.; Jacob GOLDSTEIN; Christina COX; Anirudh SASIKUMAR; Romero ALVES
- Web page: https://patentgrep.com/patent/US20260087715A1

## CPC

- G06T 13/80: Two-dimensional [2D] animation, e.g. using sprites
- G06T 13/00: Animation
- G06T 13/20: Three-dimensional [3D] animation
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Various disclosed embodiments are directed to the automatic animation of visual content. Specifically, some embodiments first receiving a design document. Some embodiments then generate a rendered image of the design document. Some embodiments then generate a mask that indicates one or more regions of visual importance in the image. Some embodiments further generate, from the design document, a scene graph. Some embodiments detect one or more hero elements based at least in part on the mask, the filtering of the scene graph, clustering, and/or one or more hero element rules. Some embodiments additionally or alternatively determine one or more animation rules based on saliency data and/or hero element detection in order to generate an animation sequence or output.

## Claims

### Claim 1

A method comprising:
receiving a design document;
generating a rendered image of the design document;
generating, via a machine learning model, a saliency mask by providing a representation of the rendered image as input to the machine learning model, the saliency mask indicates one or more regions of visual importance within the rendered image;
determining one or more animation parameters; and
based at least in part on the saliency mask, generating an animated output by at least applying the one or more animation parameters to the design document, the generating of the animated output transforms the design document into an animated design document.

### Claim 2 (depends on 1)

The method of claim 1, wherein the one or more animation parameters include at least one of, one or more characteristics associated with the animated output or one or more animation rules that dictate how the animation output should be applied to different elements within a design document.

### Claim 3 (depends on 1)

The method of claim 1, wherein the generation of the animation output is further based on a single user input representative of a request to convert the design document into the animation output.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
generating, from the design document, a scene graph that represents each element in the design document in a hierarchical structure where each node in the scene graph corresponds to an element or group of elements in the design document.

### Claim 5 (depends on 4)

The method of claim 4, wherein the generation of the animation output is further based on filtering the scene graph by selecting or discarding specific elements from the scene graph based on predefined criteria.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
converting the saliency mask into a binary image using a threshold value; and
combine elements of a scene graph that are within a threshold distance to each other into one or more clusters based on using the binary image, and wherein the generating of the animation output is further based on the converting and the combining.

### Claim 7 (depends on 1)

The method of claim 1, wherein the generating of the saliency mask is based on training the machine learning model on a dataset of images with labeled regions of visual importance.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
detecting one or more hero elements in a scene graph based analyzing overlap between one or more design elements in the scene graph and one or more regions of high saliency in the saliency mask, and wherein the generation of the animation output is further based on the detecting of the one or more hero elements.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
determining animation presets that include a set of predefined animation styles that are selectable by a user, and wherein the determining of the one or more animation parameters include determining how the animation presets are applied or changed, and wherein the generating of the animation output is based on the determining how the animation presets are applied or changed.

### Claim 10

A system comprising:
A memory component; and
A processing device coupled to the memory component, the processing device to perform operations comprising:
receiving an image or file that includes one or more elements;
generating a mask that indicates one or more regions of visual importance in the image or file;
based at least in part on the mask, determining one or more animation rules; and
generating an animation sequence of the one or more elements of the image or file by at least applying the one or more animation rules.

### Claim 11 (depends on 10)

The system of claim 10, wherein the mask is a saliency mask, and wherein the automatic generation of the mask includes automatically generating, via a saliency model, the saliency mask, and wherein the saliency mask is a greyscale image or a heat map that indicates which pixels of the one or more regions are likely to attract human attention.

### Claim 12 (depends on 10)

The system of claim 10, wherein the generation of the animation sequence is further based on a single user input representative of a request to convert the image or file into the animation sequence.

### Claim 13 (depends on 10)

The system of claim 10, wherein the image is representative of a rendered document image, the rendered document image being a visual representation of a design document, the design document being the file created in graphic design or layout software, and wherein the operations further comprising:
generating, from the design document, a scene graph that represents each element in the design document in a hierarchical structure where each node in the scene graph corresponds to an element or group of elements in the design document.

### Claim 14 (depends on 13)

The system of claim 13, wherein the generation of the animation sequence of the one or more elements is further based on filtering the scene graph by selecting or discarding specific elements from the scene graph based on predefined criteria.

### Claim 15 (depends on 10)

The system of claim 10, wherein the operations further comprising:
converting the mask into a binary image using a threshold value; and
combine elements of a scene graph that are within a threshold distance to each other into one or more clusters based on using the binary image, and wherein the generating of the animation sequence is further based on the converting and the combining.

### Claim 16 (depends on 10)

The system of claim 10, wherein the generating of the mask is based on providing a representation of the image to a machine learning model as input and training the machine learning model on a dataset of images with labeled regions of visual importance.

### Claim 17 (depends on 10)

The system of claim 10, wherein the operations further comprising:
detecting one or more hero elements in a scene graph based analyzing overlap between one or more design elements in the scene graph and one or more regions of high saliency in the mask, and wherein the generation of the animation sequence is further based on the detecting of the one or more hero elements.

### Claim 18 (depends on 10)

The system of claim 10, wherein the operations further comprising:
determining animation presets that include a set of predefined animation styles that are selectable by a user, and wherein the determining of the one or more animation rules include determining how the animation presets are applied or changed, and wherein the generating of the animation sequence is based on the determining how the animation presets are applied or changed.

### Claim 19

A non-transitory computer-readable medium storing executable instructions, which when executed by a processing device, cause the processing device to perform operations comprising:
generating, via a machine learning model, a mask that indicates one or more portions of an image that are likely to attract human attention, the image including one or more design elements;
filtering a representation of the one or more design elements of the image based on predetermined criteria;
detecting one or more hero elements from the filtered representation of the one or more design elements based at least in part on the mask and the filtering, the one or more hero elements indicate one or more regions of visual importance; and
generating an animated output associated with the image based at least in part on the detecting of the one or more hero elements.

### Claim 20 (depends on 19)

The computer-readable medium of claim 19, wherein the operations further comprising:
grouping the filtered representation of the one or more design elements into one or more clusters based for the detecting of the one or more hero elements, wherein the generating of the animated output is further based on the grouping of the filtered representation of the one or more design elements into one or more clusters.
