# US 2025/0094708 A1 · Generating large language model outputs from stored content items

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0094708 A1
- Document ID: US20250094708A1
- Status: Published application
- Kind: A1
- Application number: 18/469,357
- Filed: 2023-09-18
- Published: 2025-03-20
- Earliest claimed: 2023-09-18
- Assignees: Dropbox, Inc.
- Applicants: Dropbox, Inc.
- Inventors: Eric Cunningham; Bradley Crossen; Tejas Patel; Royce Ausburn; Brett Bergeron
- Web page: https://patentgrep.com/patent/US20250094708A1

## CPC

- G06F 40/284: Lexical analysis, e.g. tokenisation or collocates
- G06F 16/907: Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F 40/205: Parsing
- G06F 40/30: Semantic analysis
- G06F 40/40: Processing or translation of natural language (natural language analysis G06F40/20; semantic analysis G06F40/30)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

The present disclosure relates to systems, non-transitory computer-readable media, and methods for generating content-item-specific large language model responses from content items by segmenting a content item and selecting relevant sections of the content item to provide to a large language model to generate a corresponding output. In particular, in one or more embodiments, the disclosed systems can generate a text representation that includes a plurality of text segments each comprising a number of tokens of the text representation. Further, the systems can extract, from the plurality of text segments, segment-specific text embeddings that correspond to respective portions of the text representation of the content item. Additionally, the systems can determine a segment-specific text embedding corresponding to a model output request. Moreover, the systems can generate a model output by passing a text segment corresponding to the segment-specific text embedding to a large language model together with the model output request.

## Claims

### Claim 1

A computer-implemented method comprising:
generating, from a content item utilizing a content conversion model, a text representation that includes a plurality of text segments each comprising a number of tokens of the text representation;
extracting, from the plurality of text segments, segment-specific text embeddings that correspond to respective portions of the text representation of the content item;
in response to receiving a model output request from a client device, determining a segment-specific text embedding corresponding to the model output request; and
generating a model output by passing one or more text segments corresponding to the segment-specific text embedding to a large language model together with the model output request.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein generating the text representation for the content item comprises utilizing the content conversion model to generate a set of text characters that describe the content item according to a compatibility graph.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein extracting the segment-specific text embeddings comprises generating a latent vector representation for a segment-specific text embedding from among the segment-specific text embeddings.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, further comprising receiving the model output request from the client device by receiving a summary generation request or a response generation request from the client device.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein determining the segment-specific text embedding corresponding to the model output request comprises:
extracting an output request embedding from the model output request;
comparing the output request embedding with the segment-specific text embeddings; and
selecting the segment-specific text embedding corresponding to the model output request based on comparing the output request embedding with the segment-specific text embeddings.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, wherein generating the model output comprises:
determining source content items that include digital content corresponding to text segments provided to the large language model to generate the model output; and
generating a ranked list of the source content items for display on the client device.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein generating the model output comprises:
determining a content item location within the content item corresponding to the text segment provided to the large language model to generate the model output; and
providing an indication of the content item location for display on the client device.

### Claim 8

A system comprising:
at least one processor; and
a non-transitory computer readable medium storing instructions that, when executed by the at least one processor, cause the system to:
generate, from a content item utilizing a content conversion model, a text representation that includes a plurality of text segments each comprising a number of tokens of the text representation;
extract, from the plurality of text segments, segment-specific text embeddings corresponding to respective portions of the text representation of the content item;
determine a segment-specific text embedding corresponding to a model output request; and
generate a model output by passing a text segment corresponding to the segment-specific text embedding to a large language model together with the model output request.

### Claim 9 (depends on 8)

The system of claim 8, wherein the instructions cause the system to generate the model output by passing, to the large language model, the text segment corresponding to the segment-specific text embedding along with a threshold number of initial text segments extracted from the text representation of the content item.

### Claim 10 (depends on 8)

The system of claim 8, wherein the instructions cause the system to generate the model output by passing, to the large language model, the text segment corresponding to the segment-specific text embedding along with a threshold number of additional text segments corresponding to the model output request.

### Claim 11 (depends on 8)

The system of claim 8, further storing instructions that, when executed by the at least one processor, cause the system to generate a suggested model output request specific to the content item to provide for display with the model output.

### Claim 12 (depends on 8)

The system of claim 8, further storing instructions that, when executed by the at least one processor, cause the system to:
receive the model output request by receiving a summary generation request; and
generate the model output by generating a content item summary in response to receiving the summary generation request by passing the text segment corresponding to the segment-specific text embedding to the large language model together with the model output request.

### Claim 13 (depends on 8)

The system of claim 8, further storing instructions that, when executed by the at least one processor, cause the system to:
extract an output request embedding from the model output request; and
compare the segment-specific text embeddings with the output request embedding to determine relevant text embeddings of the text representation.

### Claim 14 (depends on 13)

The system of claim 13, further storing instructions that, when executed by the at least one processor, cause the system to:
pass at least one of the relevant text embeddings to the large language model; and
omit one or more irrelevant text embeddings from providing to the large language model.

### Claim 15 (depends on 8)

The system of claim 8, further storing instructions that, when executed by the at least one processor, cause the system to:
determine a location within the content item corresponding to the text segment within the text representation of the content item; and
provide an indication of the location for display on a client device together with the model output.

### Claim 16

A non-transitory computer readable medium storing instructions that, when executed by at least one processor, cause the at least one processor to:
generate, from a content item, a text representation that includes a plurality of text segments each comprising a number of tokens of the text representation;
extract, from the plurality of text segments, segment-specific text embeddings that correspond to respective portions of the text representation of the content item;
in response to receiving a model output request, determine a segment-specific text embedding corresponding to the model output request; and
generate a model output by passing a text segment corresponding to the segment-specific text embedding to a large language model together with the model output request.

### Claim 17 (depends on 16)

The non-transitory computer readable medium of claim 16, wherein the instructions cause the at least one processor to generate the model output by passing, to the large language model, the text segment corresponding to the segment-specific text embedding along with a first text segment beginning at a start point of the text representation and a second text segment beginning immediately after the first text segment.

### Claim 18 (depends on 16)

The non-transitory computer readable medium of claim 16, further comprising instructions that, when executed by the at least one processor, cause the at least one processor to generate a suggested model output request specific to the content item to provide for display with the model output by utilizing the large language model to determine the suggested model output request based on the model output and the text segment provided to the large language model.

### Claim 19 (depends on 16)

The non-transitory computer readable medium of claim 16, further comprising instructions that, when executed by the at least one processor, cause the at least one processor to:
receive the model output request by receiving a response generation request; and
generate the model output by generating a response in response to the response generation request by passing the text segment corresponding to the segment-specific text embedding to the large language model together with the model output request.

### Claim 20 (depends on 16)

The non-transitory computer readable medium of claim 16, further storing instructions that when executed by the at least one processor, cause the at least one processor to: extract the text segments from the text representation by dividing the text representation into segments having a set number of tokens.
