# US 2026/0087259 A1 · Personalizations for artificial intelligence assistant system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0087259 A1
- Document ID: US20260087259A1
- Status: Published application
- Kind: A1
- Application number: 18/898,179
- Filed: 2024-09-26
- Published: 2026-03-26
- Earliest claimed: 2024-09-26
- Assignees: Amazon Technologies, Inc.
- Applicants: Amazon Technologies, Inc.
- Inventors: Matthew Bryce Penberthy; Andrew Peter DeBruyne; George Borden; Alexander Gregory Wipf; Helena Mariadason Chua; Lei Xue
- Web page: https://patentgrep.com/patent/US20260087259A1

## CPC

- G06F 40/30: Semantic analysis
- G06F 40/35: Discourse or dialogue representation
- G06F 40/40: Processing or translation of natural language (natural language analysis G06F40/20; semantic analysis G06F40/30)
- G06N 3/045: Combinations of networks
- G06N 3/08: Learning methods
- G06N 5/02: Knowledge representation; Symbolic representation
- G06N 5/022: Knowledge engineering; Knowledge acquisition
- G06N 5/04: Inference or reasoning models
- G06N 5/041: {Abduction}
- G06N 20/00: Machine learning
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Techniques for creating and updating natural language summaries representing personalized user knowledge (e.g., user interests, user affinities, user preferences, family structure, routines, and other insights) based on conversational interactions with and other natural language content available to an AI system are described. In some embodiments, to provide a more personalized service, a system can use a generative model to summarize learnings about a user and determine helpful nuanced insights about the user such as “the user is learning how to play guitar.” This “user knowledge” can be updated based on further (later) conversations with the user, where updating can involve negating or deleting stored information, adding to or modifying stored information, etc.

## Claims

### Claim 1

A computer-implemented method comprising:
receiving first dialog data associated with a user profile identifier, the first dialog data including at least a first natural language user input;
receiving first user knowledge data from storage, the first user knowledge data associated with the user profile identifier, and the first user knowledge data including first natural language data conveying a first affinity and second natural language data conveying a second affinity;
determining a first prompt including the first dialog data, the first user knowledge data, and a first request to determine updated user knowledge for the user profile identifier based at least in part on the first natural language user input and the first user knowledge data;
processing, using a first language model, the first prompt to generate second user knowledge data including:
the first natural language data, and
third natural language data conveying a modification of the second affinity, and
storing, in the storage, the second user knowledge data in association with the user profile identifier.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, further comprising:
prior to receiving the first dialog data, causing presentation of a system output requesting information from a user associated with the user profile identifier;
in response to the system output, receiving a second natural language user input;
processing, using a second language model, the second natural language user input to generate action data indicating that the second natural language user input is to be processed to determine user knowledge data;
based on the action data, determining a second prompt including the second natural language user input and a second request to determine user knowledge for the user profile identifier based on the second natural language user input;
processing, using the first language model, the second prompt to generate the first user knowledge data; and
storing, in the storage, the first user knowledge data in association with the user profile identifier.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein the first dialog data includes a second natural language user input and the method further comprises:
determining that the second natural language user input includes a command for storing user knowledge data associated with the user profile identifier; and
based on the second natural language user input including the command, selecting the first dialog data for inclusion in the first prompt.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, further comprising:
receiving second dialog data associated with the user profile identifier, the second dialog data including at least a second natural language user input;
determining, from the storage, the second user knowledge data associated with the user profile identifier;
determining a second prompt including the second dialog data, the second user knowledge data, and a second request to determine updated user knowledge for the user profile identifier based at least in part on the second natural language user input and the second user knowledge data;
processing, using the first language model, the second prompt to generate third user knowledge data excluding the first natural language data, the third user knowledge data including the third natural language data and fourth natural language data describing a third affinity; and
storing, in the storage, the third user knowledge data in association with the user profile identifier.

### Claim 5

A computer-implemented method comprising:
receiving first dialog data associated with a user profile identifier;
determining first data representing at least first user knowledge associated with the user profile identifier;
determining a first prompt including a first request to determine at least second user knowledge based on the first dialog data and the first data;
processing, using a first generative model, the first prompt to generate second data representing at least the second user knowledge; and
storing third data associating the second data with the user profile identifier.

### Claim 6 (depends on 5)

The computer-implemented method of claim 5, further comprising:
causing presentation of a system output requesting information from a user associated with the user profile identifier;
receiving the first dialog data in response to the system output; and
selecting the first dialog data for further processing based on the first dialog data being in response to the system output, wherein further processing includes determining the first prompt.

### Claim 7 (depends on 5)

The computer-implemented method of claim 5, further comprising:
processing, using a second generative model, the first dialog data to determine that the first dialog data is to be selected for further processing, wherein further processing includes determining the first prompt.

### Claim 8 (depends on 5)

The computer-implemented method of claim 5, further comprising:
receiving a set of commands corresponding to dialog data to be excluded from further processing;
determining that the first dialog data corresponds to a first command excluded from the set of commands; and
based on the first dialog data corresponding to the first command, selecting the first dialog data for further processing, wherein further processing includes determining the first prompt.

### Claim 9 (depends on 5)

The computer-implemented method of claim 5, further comprising:
determining that the first dialog data corresponds to a command for updating user knowledge data associated with the user profile identifier; and
based on the first dialog data corresponding to the command, selecting the first dialog data for further processing, wherein further processing includes determining the first prompt.

### Claim 10 (depends on 5)

The computer-implemented method of claim 5, wherein the first data includes an affinity,
wherein processing using the first generative model comprises generating the second user knowledge representing a modification to the affinity.

### Claim 11 (depends on 5)

The computer-implemented method of claim 5, further comprising:
receiving image data corresponding to the first dialog data; and
determining the first prompt including the first request to determine at least the second user knowledge based on the first dialog data, the image data and the first data.

### Claim 12 (depends on 5)

The computer-implemented method of claim 5, wherein receiving the first data comprises receiving the first data including first natural language data describing the first user knowledge, and
wherein the second data includes second natural language data describing the second user knowledge.

### Claim 13

A system comprising:
at least one processor; and
at least one memory including instructions that, when executed by the at least one processor, cause the system to:
receive first dialog data associated with a user profile identifier;
determine first data representing at least first user knowledge associated with the user profile identifier;
determine a first prompt including a first request to determine at least second user knowledge based on the first dialog data and the first data;
process, using a first generative model, the first prompt to generate second data representing at least the second user knowledge; and
store third data associating the second data with the user profile identifier.

### Claim 14 (depends on 13)

The system of claim 13, wherein the at least one memory includes further instructions that, when executed by the at least one processor, further cause the system to:
cause presentation of a system output requesting information from a user associated with the user profile identifier;
receive the first dialog data in response to the system output; and
select the first dialog data for further processing based on the first dialog data being in response to the system output, wherein further processing includes determining the first prompt.

### Claim 15 (depends on 13)

The system of claim 13, wherein the at least one memory includes further instructions that, when executed by the at least one processor, further cause the system to:
process, using a second generative model, the first dialog data to determine that the first dialog data is to be selected for further processing, wherein further processing includes determining the first prompt.

### Claim 16 (depends on 13)

The system of claim 13, wherein the at least one memory includes further instructions that, when executed by the at least one processor, further cause the system to:
receive a set of commands corresponding to dialog data to be excluded from further processing;
determine that the first dialog data corresponds to a first command excluded from the set of commands; and
based on the first dialog data corresponding to the first command, select the first dialog data for further processing, wherein further processing includes determining the first prompt.

### Claim 17 (depends on 13)

The system of claim 13, wherein the at least one memory includes further instructions that, when executed by the at least one processor, further cause the system to:
determine that the first dialog data corresponds to a command for updating user knowledge data associated with the user profile identifier; and
based on the first dialog data corresponding to the command, select the first dialog data for further processing, wherein further processing includes determining the first prompt.

### Claim 18 (depends on 13)

The system of claim 13, wherein the first data includes an affinity,
wherein processing using the first generative model comprises generating the second user knowledge representing a modification to the affinity.

### Claim 19 (depends on 13)

The system of claim 13, wherein the at least one memory includes further instructions that, when executed by the at least one processor, further cause the system to:
receive image data corresponding to the first dialog data; and
determine the first prompt including the first request to determine at least the second user knowledge based on the first dialog data, the image data and the first data.

### Claim 20 (depends on 13)

The system of claim 13, wherein receiving the first data comprises receiving the first data including first natural language data describing the first user knowledge, and
wherein the second data includes second natural language data describing the second user knowledge.
