# US 2026/0046375 A1 · Contextual speech recognition of virtual meetings

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0046375 A1
- Document ID: US20260046375A1
- Status: Published application
- Kind: A1
- Application number: 18/798,633
- Filed: 2024-08-08
- Published: 2026-02-12
- Earliest claimed: 2024-08-08
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Tal Cohen
- Web page: https://patentgrep.com/patent/US20260046375A1

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- H04N 7/157: {defining a virtual conference space and using avatars or agents (computer conference optimisation or adaptation H04L12/1827)}
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- H04L 12/1822: {Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission}
- H04L 12/1827: {Network arrangements for conference optimisation or adaptation}
- H04L 12/1831: {Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status}
- H04L 51/02: using automatic reactions or user delegation, e.g. automatic replies or chatbot-generated messages
- H04L 51/066: Format adaptation, e.g. format conversion or compression
- H04M 3/568: {audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants (echo suppression in two-way loud-speaking telephone systems H04M9/02; sound field processing per se H04S7/30)}
- H04N 7/15: Conference systems
- H04N 7/152: {Multipoint control units therefor}
- G10L 15/063: {Training}
- G10L 15/065: Adaptation
- G10L 15/16: using artificial neural networks
- G10L 2015/0638: {Interactive procedures}
- G10L 2015/228: {of application context}
- H04M 2201/40: using speech recognition
- H04M 2203/552: Call annotations
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

A method includes receiving audio data of a virtual meeting and identifying, within a plurality of content items related to the virtual meeting, content not previously recognized by a speech recognition system designated to convert the audio data of the virtual meeting into text. The method also includes causing the speech recognition system to be modified based on the previously unrecognized content. The method further includes causing the audio data of the virtual meeting to be converted into the text using the modified speech recognition system, wherein the text comprises at least part of the previously unrecognized content.

## Claims

### Claim 1

A method comprising:
receiving audio data of a virtual meeting;
identifying, within a plurality of content items related to the virtual meeting, content not previously recognized by a speech recognition system designated to convert the audio data of the virtual meeting into text;
causing the speech recognition system to be modified based on the previously unrecognized content; and
causing the audio data of the virtual meeting to be converted into the text using the modified speech recognition system, wherein the text comprises at least part of the previously unrecognized content.

### Claim 2 (depends on 1)

The method of claim 1, wherein the plurality of content items comprises at least one of:
names of participants of the virtual meeting;
documents related to the virtual meeting;
text shared between participants of the virtual meeting; or
documents associated with an organization of a participant of the virtual meeting.

### Claim 3 (depends on 1)

The method of claim 1, wherein an image is shared during the virtual meeting, and wherein the plurality of content items comprises text derived from processing the image using optical character recognition.

### Claim 4 (depends on 1)

The method of claim 1, wherein causing the speech recognition system to be modified based on the previously unrecognized content comprises:
generating one or more possible pronunciations for the previously unrecognized content; and
adding the one or more possible pronunciations to a lexicon of the speech recognition system.

### Claim 5 (depends on 1)

The method of claim 1, wherein the speech recognition system comprises one or more machine learning models trained to convert speech data to corresponding text data.

### Claim 6 (depends on 5)

The method of claim 5, wherein causing the speech recognition system to be modified based on the previously unrecognized content comprises:
generating one or more possible pronunciations for the previously unrecognized content;
generating training data comprising the one or more possible pronunciations as inputs and the previously unrecognized content as target output; and
retraining a first machine learning model of the one or more machine learning models using the generated training data.

### Claim 7 (depends on 5)

The method of claim 5, wherein causing the speech recognition system to be modified based on the previously unrecognized content comprises:
generating one or more possible pronunciations for the previously unrecognized content;
generating training data comprising the one or more possible pronunciations as inputs and the previously unrecognized content as target output;
training a new machine learning model using the generated training data to recognize the previously unrecognized content; and
adding the new machine learning model to the one or more machine learning models of the speech recognition system.

### Claim 8 (depends on 5)

The method of claim 5, wherein causing the speech recognition system to be modified based on the previously unrecognized content comprises providing a representation of the previously unrecognized content to at least a first machine learning model of the one or more machine learning models.

### Claim 9 (depends on 1)

The method of claim 1, wherein the text from causing the audio data of the virtual meeting to be converted using the modified speech recognition system is at least one of:
live captions visible during the virtual meeting;
a transcription of the virtual meeting; or
a summary of the virtual meeting generated using one or more machine learning models.

### Claim 10

A system comprising:
a memory device; and
a processing device coupled to the memory device, the processing device to perform operations comprising:
receiving audio data of a virtual meeting;
identifying, within a plurality of content items related to the virtual meeting, content not previously recognized by a speech recognition system designated to convert the audio data of the virtual meeting into text;
causing the speech recognition system to be modified based on the previously unrecognized content; and
causing the audio data of the virtual meeting to be converted into the text using the modified speech recognition system, wherein the text comprises at least part of the previously unrecognized content.

### Claim 11 (depends on 10)

The system of claim 10, wherein the plurality of content items comprises at least one of:
names of participants of the virtual meeting;
documents related to the virtual meeting;
text shared between participants of the virtual meeting; or
documents associated with an organization of a participant of the virtual meeting.

### Claim 12 (depends on 10)

The system of claim 10, wherein an image is shared during the virtual meeting, and wherein the plurality of content items comprises text derived from processing the image using optical character recognition.

### Claim 13 (depends on 10)

The system of claim 10, wherein causing the speech recognition system to be modified based on the previously unrecognized content comprises:
generating one or more possible pronunciations for the previously unrecognized content; and
adding the one or more possible pronunciations to a lexicon of the speech recognition system.

### Claim 14 (depends on 10)

The system of claim 10, wherein the speech recognition system comprises one or more machine learning models trained to convert speech data to corresponding text data.

### Claim 15 (depends on 14)

The system of claim 14, wherein causing the speech recognition system to be modified based on the previously unrecognized content comprises:
generating one or more possible pronunciations for the previously unrecognized content;
generating training data comprising the one or more possible pronunciations as inputs and the previously unrecognized content as target output; and
retraining a first machine learning model of the one or more machine learning models using the generated training data.

### Claim 16 (depends on 14)

The system of claim 14, wherein causing the speech recognition system to be modified based on the previously unrecognized content comprises:
generating one or more possible pronunciations for the previously unrecognized content;
generating training data comprising the one or more possible pronunciations as inputs and the previously unrecognized content as target output;
. a new machine learning model using the generated training data to recognize the previously unrecognized content; and
. the new machine learning model to the one or more machine learning models of the speech recognition system.

### Claim 17 (depends on 14)

The system of claim 14, wherein causing the speech recognition system to be modified based on the previously unrecognized content comprises providing a representation of the previously unrecognized content to at least a first machine learning model of the one or more machine learning models.

### Claim 18 (depends on 10)

The system of claim 10, wherein the text generated based on the audio data of the virtual meeting using the modified speech recognition system is at least one of:
live captions visible during the virtual meeting;
a transcription of the virtual meeting; or
a summary of the virtual meeting generated using one or more machine learning models.

### Claim 19

A non-transitory computer-readable storage medium comprising instructions that, when executed by a processing device, cause the processing device to perform operations comprising:
receiving audio data of a virtual meeting;
identifying, within a plurality of content items related to the virtual meeting, content not previously recognized by a speech recognition system designated to convert the audio data of the virtual meeting into text;
causing the speech recognition system to be modified based on the previously unrecognized content; and
causing the audio data of the virtual meeting to be converted into the text using the modified speech recognition system, wherein the text comprises at least part of the previously unrecognized content.

### Claim 20 (depends on 19)

The non-transitory computer-readable storage medium of claim 19, wherein the plurality of content items comprises at least one of:
names of participants of the virtual meeting;
documents related to the virtual meeting;
text shared between participants of the virtual meeting; or
documents associated with an organization of a participant of the virtual meeting.
