# US 2026/0073131 A1 · Generation of Context-Based Text Content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0073131 A1
- Document ID: US20260073131A1
- Status: Published application
- Kind: A1
- Application number: 18/830,151
- Filed: 2024-09-10
- Published: 2026-03-12
- Earliest claimed: 2024-09-10
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Vishu Goyal; Rosemond Gerold Dorleans
- Web page: https://patentgrep.com/patent/US20260073131A1

## CPC

- G06F 40/20: Natural language analysis (semantic analysis of natural language G06F40/30)
- G06F 40/30: Semantic analysis
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Methods, systems, devices, and non-transitory computer readable media for generating context-based text content are provided. The disclosed technology can include receiving content data comprising content associated with one or more data modalities. One or more associated with the content data can be determined. Based on inputting the content data and context data based on the one or more contexts into one or more machine-learned models, one or more context-based text segments based on the content data can be generated. The one or more machine-learned models can be configured to generate the one or more context-based text segments based on recognition of one or more features of the content data and the context data. Furthermore, context-based text content based on the one or more context-based text segments can be generated.

## Claims

### Claim 1

A computer-implemented method of generating context-based text content, the computer-implemented method comprising:
receiving, by a computing system comprising one or more processors, content data comprising content associated with one or more data modalities;
determining, by the computing system, one or more contexts associated with the content data;
generating, by the computing system, based on inputting the content data and context data based on the one or more contexts into one or more machine-learned models, one or more context-based text segments associated with the content data, wherein the one or more machine-learned models are configured to generate the one or more context-based text segments based on recognition of one or more features of the content data and the context data; and
generating, by the computing system, context-based text content based on the one or more context-based text segments.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, further comprising:
receiving, by the computing system, prompt data comprising one or more prompts associated with the content data, wherein the one or more machine-learned models are further configured to generate the one or more context-based text segments based on recognition of one or more features of the one or more prompts.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, further comprising:
generating, by the computing system, a link note comprising the context-based text content and one or more links to one or more web resources associated with the context-based text content, wherein the one or more web resources comprise one or more search results, one or more web pages, one or more database entries, or one or more social media posts.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein the one or more contexts comprise information associated with one or more locations, and wherein the one or more machine-learned models are configured to determine the one or more context-based text segments based on the information associated with the one or more locations.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein the one or more contexts comprise one or more temporal indications associated with one or more times at which the content data was generated, and wherein the one or more machine-learned models are configured to determine the one or more context-based text segments based on the one or more temporal indications.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, wherein the one or more contexts comprise information associated with one or more events associated with the content data, and wherein the one or more machine-learned models are configured to generate the one or more context-based text segments based on the information associated with the one or more events.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein the one or more contexts comprise information associated with one or more applications associated with the content data, and wherein the one or more machine-learned models are configured to classify the one or more applications and generate the one or more context-based text segments based on the information associated with the one or more applications.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1, wherein the one or more contexts comprise one or more search queries associated with the content data, wherein the one or more machine-learned models are configured to classify the one or more search queries and generate the one or more context-based text segments based on the one or more search queries.

### Claim 9 (depends on 1)

The computer-implemented method of claim 1, wherein the one or more machine-learned models are configured to identify information associated with one or more users in the content data and generate the context-based text segments based on the information associated with the one or more users.

### Claim 10 (depends on 1)

The computer-implemented method of claim 1, wherein the content data comprises one or more images, one or more audio segments, or one or more video segments.

### Claim 11 (depends on 1)

The computer-implemented method of claim 1, wherein the one or more machine-learned models are trained to generate the one or more context-based text segments, and wherein the training of the one or more machine-learned models comprises:
receiving, by the computing system, training data comprising a plurality of training data inputs and a corresponding plurality of ground-truth text segments, wherein the plurality of training data inputs comprise a plurality of training images, a plurality of training audio segments, a plurality of training text segments, or a plurality of training video segments;
determining, by the computing system, based on inputting the plurality of training data inputs into the one or more machine-learned models, a plurality of predicted text segments;
determining, by the computing system, a loss based on one or more differences between the plurality of predicted text segments and the corresponding plurality of ground-truth text segments; and
modifying, by the computing system, a plurality of parameters of the one or more machine-learned models to minimize the loss.

### Claim 12 (depends on 1)

The computer-implemented method of claim 1, wherein the one or more machine-learned models comprise one or more multimodal transformer models that are trained to generate the one or more context-based text segments based on training data comprising a plurality of embeddings based on training data comprising training content data or training context data.

### Claim 13 (depends on 12)

The computer-implemented method of claim 12, wherein the training content data comprises a plurality of training images, a plurality of training audio segments, a plurality of training video segments, and a corresponding plurality of ground-truth text segments, and wherein the training context data comprises a plurality of training locations, a plurality of temporal indications, a plurality of training applications, or a plurality of training search queries.

### Claim 14 (depends on 1)

The computer-implemented method of claim 1, wherein the one or more machine-learned models are trained based on training data comprising a plurality of training context-based text segments of a user associated with the content data, wherein the one or more machine-learned models are configured to generate the context-based text content in a visual style based on the plurality of training context-based texts, and wherein the visual style comprises a color scheme or one or more font types of the one or more context-based text segments.

### Claim 15 (depends on 1)

The computer-implemented method of claim 1, wherein the one or more machine-learned models are trained to generate the one or more context-based text segments based on training data comprising a plurality of training text segments of a user associated with the content data, and wherein the one or more machine-learned models are configured to generate the one or more context-based text segments in a writing style based on the plurality of training text segments.

### Claim 16

One or more tangible non-transitory computer-readable media storing computer-readable instructions that when executed by one or more processors cause the one or more processors to perform operations, the operations comprising:
receiving content data comprising content associated with one or more data modalities;
determining one or more contexts associated with the content data;
generating, based on inputting the content data and context data based on the one or more contexts into one or more machine-learned models, one or more context-based text segments associated with the content data, wherein the one or more machine-learned models are configured to generate the one or more context-based text segments based on recognition of one or more features of the content data and the context data; and
generating context-based text content based on the one or more context-based text segments.

### Claim 17 (depends on 16)

The one or more tangible non-transitory computer-readable media of claim 16, wherein the one or more machine-learned models comprise one or more multimodal transformer models that are trained to generate the one or more context-based text segments based on training data comprising a plurality of embeddings based on training data comprising training content data or training context data.

### Claim 18

A computing system comprising:
one or more processors;
one or more non-transitory computer-readable media storing instructions that when executed by the one or more processors cause the one or more processors to perform operations comprising:
receiving content data comprising content associated with one or more data modalities;
determining one or more contexts associated with the content data;
generating, based on inputting the content data and context data based on the one or more contexts into one or more machine-learned models, one or more context-based text segments associated with the content data, wherein the one or more machine-learned models are configured to generate the one or more context-based text segments based on recognition of one or more features of the content data and the context data; and
generating context-based text content based on the one or more context-based text segments.

### Claim 19 (depends on 18)

The computing system of claim 18, wherein the one or more machine-learned models comprise one or more multimodal transformer models that are trained to generate the one or more context-based text segments based on training data comprising a plurality of embeddings based on training data comprising training content data or training context data.

### Claim 20 (depends on 18)

The computing system of claim 18, wherein the one or more machine-learned models are trained based on training data comprising a plurality of training context-based text segments of a user associated with the content data, wherein the one or more machine-learned models are configured to generate the context-based text content in a visual style based on the plurality of training context-based texts, and wherein the visual style comprises a color scheme or one or more font types of the one or more context-based text segments.
