# US 2025/0157474 A1 · Automatically Recognizing and Surfacing Important Moments in Multi-Party Conversations

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0157474 A1
- Document ID: US20250157474A1
- Status: Published application
- Kind: A1
- Application number: 19/020,845
- Filed: 2025-01-14
- Published: 2025-05-15
- Earliest claimed: 2020-03-10
- Assignees: Outreach Corporation
- Applicants: Outreach Corporation
- Inventors: Krishnamohan Reddy Nareddy; Abhishek Abhishek; Rohit Ganpat Mane; Rajiv Garg
- Web page: https://patentgrep.com/patent/US20250157474A1

## CPC

- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G10L 17/14: Use of phonemic categorisation or speech recognition prior to speaker recognition or verification
- G06F 16/3344: {using natural language analysis}
- G06F 16/345: {Summarisation for human users}
- G06F 16/685: {using automatically derived transcript of audio data, e.g. lyrics (speech recognition G10L15/00)}
- G06N 20/00: Machine learning
- G06F 16/9535: Search customisation based on user profiles and personalisation
- G06N 5/022: Knowledge engineering; Knowledge acquisition
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A system and a method are disclosed for identifying a subjectively interesting moment in a transcript. In an embodiment, a device receives a transcription of a conversation, and identifies a participant of the conversation. The device accesses a machine learning model corresponding to the participant, and applies, as input to the machine learning model, the transcription. The device receives as output from the machine learning model a portion of the transcription having relevance to the participant, and generates for display, to the participant, information pertaining to the portion.

## Claims

### Claim 1

A non-transitory computer-readable medium comprising instructions encoded thereon to identify a moment in a transcript, the instructions when executed by at least one processor causing the at least one processor to:
receive a transcription of a conversation, the conversation being ongoing between a plurality of participants including a given participant, the transcription received as the conversation continues;
select a machine learning model for the given participant based on a profile of the given participant;
apply, as input to the selected machine learning model, the transcription on an ongoing basis as the conversation continues;
receive, as output from the selected machine learning model, a portion of the transcription having relevance to the given participant; and
generate for display, to the given participant, on an ongoing basis as the conversation from which the transcription was received continues, information pertaining to the portion, the information tailored to the given participant based on the portion output by the selected machine learning model.

### Claim 2 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the instructions to select the machine learning model for the given participant comprise instructions to:
determine a group of which the given participant is a part;
identify a group model trained based on preferences of the group; and
assign the group model as the selected machine learning model.

### Claim 3 (depends on 2)

The non-transitory computer-readable medium of claim 2, wherein the group model is used to surface moments to other users who are a part of the group.

### Claim 4 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the selected machine learning model is trained to correspond to the given participant by:
accessing a profile of the given participant, the profile indicating terms in historical search queries performed by the given participant, and indicating interaction by the given participant with results of the historical search queries; and
labeling the terms based on the indicated participant interaction.

### Claim 5 (depends on 4)

The non-transitory computer-readable medium of claim 4, wherein a strength of association between the terms and the label is updated based on:
a frequency with which the given participant uses the terms; and
how recently, relative to a present time, a term was used in the historical search queries by the given participant.

### Claim 6 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the instructions to apply, as input to the selected machine learning model, the transcription further comprise instructions to:
identify one or more word embeddings corresponding to the transcription; and
apply, as additional input to each machine learning model, the one or more word embeddings.

### Claim 7 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the instructions to receive, as output from the selected machine learning model, a portion of the transcription having relevance to the given participant further comprise instructions to:
receive a plurality of scores for different portions of the transcription;
compare each score of the plurality of scores to a threshold; and
determine the portion of the transcription having relevance to the given participant based on its corresponding score exceeding the threshold.

### Claim 8 (depends on 1)

The non-transitory computer-readable medium of claim 1, further comprising receiving the transcription automatically and in real-time during the conversation.

### Claim 9

A method comprising:
receiving a transcription of a conversation, the conversation being ongoing between a plurality of participants including a given participant, the transcription received as the conversation continues;
selecting a machine learning model for the given participant based on a profile of the given participant;
applying, as input to the selected machine learning model, the transcription on an ongoing basis as the conversation continues;
receiving, as output from the selected machine learning model, a portion of the transcription having relevance to the given participant; and
generating for display, to the given participant, on an ongoing basis as the conversation from which the transcription was received continues, information pertaining to the portion, the information tailored to the given participant based on the portion output by the selected machine learning model.

### Claim 10 (depends on 9)

The method of claim 9, wherein selecting the machine learning model for the given participant comprises:
determining a group of which the given participant is a part;
identifying a group model trained based on preferences of the group; and
assigning the group model as the machine learning model for the given participant.

### Claim 11 (depends on 10)

The method of claim 10, wherein the group model is used to surface moments to other users who are a part of the group.

### Claim 12 (depends on 9)

The method of claim 9, further comprising training the selected machine learning model to correspond to the given participant by:
accessing a profile of the given participant, the profile indicating terms in historical search queries performed by the given participant, and indicating interaction by the given participant with results of the historical search queries; and
labeling the terms based on the indicated participant interaction.

### Claim 13 (depends on 12)

The method of claim 12, wherein a strength of association between the terms and the label is updated based on:
a frequency with which the given participant uses the terms; and
how recently, relative to a present time, a term was used in the historical search queries by the given participant.

### Claim 14 (depends on 9)

The method of claim 9, wherein applying, as input to the selected machine learning model, the transcription further comprises:
identifying one or more word embeddings corresponding to the transcription; and
applying, as additional input to each machine learning model, the one or more word embeddings.

### Claim 15 (depends on 9)

The method of claim 9, wherein receiving, as output from the selected machine learning model, a portion of the transcription having relevance to the given participant further comprises:
receiving a plurality of scores for different portions of the transcription;
comparing each score of the plurality of scores to a threshold; and
determining the portion of the transcription having relevance to the given participant based on its corresponding score exceeding the threshold.

### Claim 16 (depends on 9)

The method of claim 9, further comprising receiving the transcription automatically and in real-time during the conversation.

### Claim 17

A system comprising:
memory with instructions encoded thereon; and
one or more processors that, when executing the instructions, are caused to perform operations comprising:
receiving a transcription of a conversation, the conversation being ongoing between a plurality of participants including a given participant, the transcription received as the conversation continues;
selecting a machine learning model for the given participant based on a profile of the given participant;
applying, as input to the selected machine learning model, the transcription on an ongoing basis as the conversation continues;
receiving, as output from the selected machine learning model, a portion of the transcription having relevance to the given participant; and
generating for display, to the given participant, on an ongoing basis as the conversation from which the transcription was received continues, information pertaining to the portion, the information tailored to the given participant based on the portion output by the selected machine learning model.

### Claim 18 (depends on 17)

The system of claim 17, wherein selecting the machine learning model for the given participant comprises:
determining a group of which the given participant is a part;
identifying a group model trained based on preferences of the group; and
assigning the group model as the machine learning model for the given participant.

### Claim 19 (depends on 18)

The system of claim 18, wherein the group model is used to surface moments to other users who are a part of the group.

### Claim 20 (depends on 17)

The system of claim 17, the operations further comprising training the selected machine learning model to correspond to the given participant by:
accessing a profile of the given participant, the profile indicating terms in historical search queries performed by the given participant, and indicating interaction by the given participant with results of the historical search queries; and
labeling the terms based on the indicated participant interaction.
