# US 2026/0100190 A1 · Customized, personalized, and extendable large language model (llm)-enhanced virtual assistants

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0100190 A1
- Document ID: US20260100190A1
- Status: Published application
- Kind: A1
- Application number: 19/195,146
- Filed: 2025-04-30
- Published: 2026-04-09
- Earliest claimed: 2024-10-07
- Assignees: Zoom Communications, Inc.
- Applicants: Zoom Communications, Inc.
- Inventors: Zheng Chen; Ashley Alexandra Hellmann; Gareth Paul Jones; Wei Li; Ross Douglas Mayfield; Stephen George Newton; Rachita Audhesh Singh; Jeffrey William Smith; Bo Yan
- Web page: https://patentgrep.com/patent/US20260100190A1

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- H04N 7/15: Conference systems
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Techniques for customized, personalized, and extendable large language model (“LLM”)-enhanced virtual assistants are provided. In an example method, a computing system receives first information about one or more data sources. The computing system receives, from a first client device, an expression. The computing system accesses the one or more data sources based on the expression to retrieve contextual information based on the expression. The computing system receives additional information from one or more services, where at least one service of the one or more services is accessed using an integration interface. The computing system receives, from an LLM, a response to a prompt, the prompt based on the expression, the contextual information, and the additional information. The computing system outputs, to the first client device, the response.

## Claims

### Claim 1

A method, comprising:
receiving first information about one or more data sources;
receiving, from a first client device, an expression;
accessing the one or more data sources based on the expression to retrieve contextual information based on the expression;
receiving additional information from one or more services, where at least one service of the one or more services is accessed using an integration interface;
receiving, from a large language model (“LLM”), a response to a prompt, the prompt based on the expression, the contextual information, and the additional information; and
outputting, to the first client device, the response.

### Claim 2 (depends on 1)

The method of claim 1, wherein the one or more data sources includes second information about a data history of a user of the first client device.

### Claim 3 (depends on 1)

The method of claim 1, wherein the one or more data sources includes a dictionary comprising a plurality of expressions and associated contexts.

### Claim 4 (depends on 1)

The method of claim 1, where the one or more services include an issue management platform.

### Claim 5 (depends on 1)

The method of claim 1, wherein:
the method further comprises:
joining the first client device to a video conference, the video conference being joined by a plurality of client devices including the first client device; and
the expression is based on a spoken utterance by a first participant using the first client device.

### Claim 6 (depends on 5)

The method of claim 5, further comprising:
receiving, from a subset of the plurality of client devices, additional expressions, the additional expressions being a portion of a conversation among a plurality of participants using the respective subset of the plurality of client devices, including the first participant;
receiving, from the LLM, a contribution to the conversation in response to a second prompt, the second prompt based on the additional expressions, the contextual information, and the additional information; and
outputting, to the first client device, the contribution to the conversation.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
receiving, from the first client device, additional expressions responsive to the response;
receiving, from the LLM, coaching information in response to a second prompt, the second prompt based on the additional expressions, the contextual information, and the additional information; and
outputting, to the first client device, the coaching information.

### Claim 8 (depends on 1)

The method of claim 1, wherein:
the method further comprises:
receiving a first indication that the first client device is joined to a video conference provided by an external video conference provider, the video conference being joined by a plurality of client devices including the first client device; and
receiving the expression comprises receiving a second indication of the expression from the external video conference provider; and
outputting the response comprises outputting a message to the external video conference provider including the response to cause the message to be received by the first client device.

### Claim 9 (depends on 1)

The method of claim 1, wherein:
the LLM is a component of an agentic framework including one or more agents configured to perform one or more respective specialized tasks, wherein the agentic framework comprises a coordination mechanism that manages interactions between the one or more agents based on the expression; and
the response is generated by the agentic framework using the expression, the contextual information, and the additional information by:
determining an intent associated with the response;
selecting at least one agent of the one or more agents based on the intent and the contextual information;
instructing the selected agents to execute tasks to retrieve or generate additional content; and
generating the response using the additional content.

### Claim 10 (depends on 1)

The method of claim 1, wherein:
the first information further includes a template; and
the prompt is further based on the template.

### Claim 11

A non-transitory computer-readable storage medium storing processor-executable instructions configured to cause one or more processors to:
receive first information about one or more data sources;
receive, from a first client device, an expression;
access the one or more data sources based on the expression to retrieve contextual information based on the expression;
receive additional information from one or more services, where at least one service of the one or more services is accessed using an integration interface;
receive, from an LLM, a response to a prompt, the prompt based on the expression, the contextual information, and the additional information; and
output, to the first client device, the response.

### Claim 12 (depends on 11)

The non-transitory computer-readable storage medium of claim 11, wherein the one or more data sources includes a dictionary comprising a plurality of expressions and associated contexts.

### Claim 13 (depends on 11)

The non-transitory computer-readable storage medium of claim 11, wherein:
the processor-executable instructions are further configured to cause the one or more processors to:
join the first client device to a video conference, the video conference being joined by a plurality of client devices including the first client device; and
the expression is based on a spoken utterance by a first participant using the first client device.

### Claim 14 (depends on 11)

The non-transitory computer-readable storage medium of claim 11, wherein the processor-executable instructions are further configured to cause the one or more processors to:
receive, from the first client device, additional expressions responsive to the response;
receive, from the LLM, coaching information in response to a second prompt, the second prompt based on the additional expressions, the contextual information, and the additional information; and
output, to the first client device, the coaching information.

### Claim 15 (depends on 11)

The non-transitory computer-readable storage medium of claim 11, wherein:
the LLM is a component of an agentic framework including one or more agents configured to perform one or more respective specialized tasks, wherein the agentic framework comprises a coordination mechanism that manages interactions between the one or more agents based on the expression; and
the response is generated by the agentic framework using the expression, the contextual information, and the additional information by:
determining an intent associated with the response;
selecting at least one agent of the one or more agents based on the intent and the contextual information;
instructing the selected agents to execute tasks to retrieve or generate additional content; and
generating the response using the additional content.

### Claim 16

A system comprising:
one or more non-transitory computer-readable media; and
one or more processors communicatively coupled to the one or more non-transitory computer-readable media, the one or more processors configured to execute processor-executable instructions stored in the non-transitory computer-readable media to:
receive first information about one or more data sources;
receive, from a first client device, an expression;
access the one or more data sources based on the expression to retrieve contextual information based on the expression;
receive additional information from one or more services, where at least one service of the one or more services is accessed using an integration interface;
receive, from an LLM, a response to a prompt, the prompt based on the expression, the contextual information, and the additional information; and
output, to the first client device, the response.

### Claim 17 (depends on 16)

The system of claim 16, wherein the one or more data sources includes a dictionary comprising a plurality of expressions and associated contexts.

### Claim 18 (depends on 16)

The system of claim 16, wherein:
the one or more processors are further configured to execute processor-executable instructions stored in the non-transitory computer-readable media to:
join the first client device to a video conference, the video conference being joined by a plurality of client devices including the first client device; and
the expression is based on a spoken utterance by a first participant using the first client device.

### Claim 19 (depends on 16)

The system of claim 16, wherein:
the one or more processors are further configured to execute processor-executable instructions stored in the non-transitory computer-readable media to:
receive a first indication that the first client device is joined to a video conference provided by an external video conference provider, the video conference being joined by a plurality of client devices including the first client device; and
receive the expression comprises receiving a second indication of the expression from the external video conference provider; and
outputting the response comprises outputting a message to the external video conference provider including the response to cause the message to be received by the first client device.

### Claim 20 (depends on 16)

The system of claim 16, wherein:
the LLM is a component of an agentic framework including one or more agents configured to perform one or more respective specialized tasks, wherein the agentic framework comprises a coordination mechanism that manages interactions between the one or more agents based on the expression; and
the response is generated by the agentic framework using the expression, the contextual information, and the additional information by:
determining an intent associated with the response;
selecting at least one agent of the one or more agents based on the intent and the contextual information;
instructing the selected agents to execute tasks to retrieve or generate additional content; and
generating the response using the additional content.
