# US 2026/0073603 A1 · Context-Based Animated Image Generation from a Video

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0073603 A1
- Document ID: US20260073603A1
- Status: Published application
- Kind: A1
- Application number: 18/826,948
- Filed: 2024-09-06
- Published: 2026-03-12
- Earliest claimed: 2024-09-06
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Vishu Goyal; Rosemond Gerold Dorleans
- Web page: https://patentgrep.com/patent/US20260073603A1

## CPC

- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G11B 27/00: Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

Systems and methods for animated image generation can obtain user-generated content, perform a video segment search based on the user-generated content, process the video segment to generate an animated image, and provide the animated image as an output. The systems and methods can perform sentiment analysis, audio transcription, key frame extraction, and sequence-based rendering to perform the animated image generation.

## Claims

### Claim 1

A computing system for generating animated images, the system comprising:
one or more processors; and
one or more non-transitory computer-readable media that collectively store instructions that, when executed by the one or more processors, cause the computing system to perform operations, the operations comprising:
obtaining, via a link notes interface, user-generated content data, wherein the user-generated content data comprises a text string input by a user, wherein the link notes interface comprises a user interface that is configured to receive inputs to generate user generated link notes to index with web resources;
obtaining, via the link note interface, video data, wherein the video data comprises a plurality of image frames and audio data;
processing the user-generated content data and the video data to determine a subset of frames of the plurality of image frames are associated with the user-generated content data;
processing the subset of frames of the plurality of image frames to generate an animated image, wherein the animated image comprises an animated playback of the subset of frames ordered sequentially; and
providing the animated image for display via the link notes interface.

### Claim 2 (depends on 1)

The system of claim 1, wherein the operations further comprise:
obtaining a selection of the animated image; and
augmenting, based on the selection of the animated image, a link note to include the animated image and the text string input.

### Claim 3 (depends on 1)

The system of claim 1, wherein processing the subset of frames of the plurality of image frames to generate the animated image comprises:
processing the audio data to transcribe at least a portion of the audio data associated with the subset of frames to generate a partial transcript; and
rendering the partial transcript over the subset of frames.

### Claim 4 (depends on 1)

The system of claim 1, wherein processing the user-generated content data and the video data to determine the subset of frames of the plurality of image frames are associated with the user-generated content data comprises:
processing the audio data with a transcription model to generate a transcript for the video data; and
processing the transcript and the text string input with a machine-learned language model to determine the subset of frames of the plurality of image frames.

### Claim 5 (depends on 1)

The system of claim 1, wherein obtaining, via the link notes interface, the user-generated content data comprises:
receiving the text string input with a freeform input box provided by the link notes interface.

### Claim 6 (depends on 5)

The system of claim 5, wherein providing the animated image for display via the link notes interface comprises:
providing the animated image for display within the freeform input box adjacent to the text string input.

### Claim 7 (depends on 1)

The system of claim 1, wherein the operations further comprise:
generating a graphical card based on the text string input and the animated image, wherein the graphical card comprises a stylized format of the text string input and the animated image.

### Claim 8 (depends on 7)

The system of claim 7, wherein the operations further comprise:
indexing the graphical card with resource data associated with a particular web resource.

### Claim 9 (depends on 8)

The system of claim 8, wherein the operations further comprise:
obtaining a search query;
determining the particular web resource is responsive to the search query; and
generating a search results interface that comprises a title for the particular web resource, a text snippet from the particular web resource, a hyperlink to access the particular web resource, and the graphical card.

### Claim 10 (depends on 1)

The system of claim 1, wherein the animated image is configured in a graphics interchange format.

### Claim 11

A computer-implemented method for generating animated images, the method comprising:
obtaining, by a computing system comprising one or more processors and via a link notes interface, user-generated content data, wherein the user-generated content data comprises a text string input by a user, wherein the link notes interface comprises a user interface that is configured to receive inputs to generate user generated link notes to index with web resources;
obtaining, by the computing system and from a video database, a video based on the text string input, wherein the video comprises a plurality of image frames and audio data, wherein the video database comprises a plurality of different videos;
processing, by the computing system, the user-generated content data and the video to determine a subset of frames of the plurality of image frames are associated with the user-generated content data;
processing, by the computing system, the subset of frames of the plurality of image frames to generate an animated image, wherein the animated image comprises an animated playback of the subset of frames ordered sequentially; and
providing, by the computing system, the animated image for display via the link notes interface.

### Claim 12 (depends on 11)

The method of claim 11, wherein the video database comprises a user-specific video database that stores videos saved by the user.

### Claim 13 (depends on 11)

The method of claim 11, wherein the video database comprises a historical log of videos recently viewed by the user.

### Claim 14 (depends on 11)

The method of claim 11, wherein processing, by the computing system, the user-generated content data and the video to determine the subset of frames of the plurality of image frames are associated with the user-generated content data comprises:
determining, by the computing system, a particular sentiment of the text string input; and
determining, by the computing system, the subset of frames of the plurality of image frames are associated with the particular sentiment.

### Claim 15 (depends on 11)

The method of claim 11, wherein processing, by the computing system, the user-generated content data and the video to determine the subset of frames of the plurality of image frames are associated with the user-generated content data comprises:
determining, by the computing system, a particular topic of the text string input; and
determining, by the computing system, the subset of frames of the plurality of image frames are associated with the particular topic.

### Claim 16 (depends on 11)

The method of claim 11, wherein processing, by the computing system, the user-generated content data and the video to determine the subset of frames of the plurality of image frames are associated with the user-generated content data comprises:
determining, by the computing system, a particular action of the text string input; and
determining, by the computing system, the subset of frames of the plurality of image frames comprises a sequence of frames of an individual performing the particular action.

### Claim 17

One or more non-transitory computer-readable media that collectively store instructions that, when executed by one or more computing devices, cause the one or more computing devices to perform operations, the operations comprising:
obtaining, via a link notes interface, user-generated content data, wherein the user-generated content data comprises a text string input by a user, wherein the link notes interface comprises a user interface that is configured to receive inputs to generate user generated link notes to index with web resources;
determining a video comprises content associated with at least a subset of text string input, wherein the video data comprises a plurality of image frames and audio data;
processing the user-generated content data and the video to determine a subset of frames of the plurality of image frames are associated with the user-generated content data;
segmenting the subset of frames of the plurality of image frames from the video based on determining the subset of frames of the plurality of image frames are associated with the user-generated content data;
processing the subset of frames of the plurality of image frames to generate an animated image, wherein the animated image comprises an animated playback of the subset of frames ordered sequentially; and
providing the animated image for display via the link notes interface.

### Claim 18 (depends on 17)

The one or more non-transitory computer-readable media of claim 17, wherein processing the subset of frames of the plurality of image frames to generate the animated image comprises:
processing at least a subset of the text string input with a text-to-image generation model to generate one or more model-generated images, wherein the one or more model-generated images comprise a plurality of predicted pixels generated based on the text string input; and
generating the animated image based on the subset of frames and the one or more model-generated images.

### Claim 19 (depends on 18)

The one or more non-transitory computer-readable media of claim 18, wherein the text-to-image generation model comprises a diffusion model.

### Claim 20 (depends on 18)

The one or more non-transitory computer-readable media of claim 18, wherein the animated image comprises the one or more model-generated images interweaved within the subset of frames of the plurality of image frames.
