# US 10,770,069 B2 · Speech processing and context-based language prompting

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,770,069 B2
- Document ID: US10770069B2
- Status: Granted
- Kind: B2
- Application number: 16/002,241
- Filed: 2018-06-07
- Published: 2019-12-12
- Granted: 2020-09-08
- Earliest claimed: 2018-06-07
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Sripathi S. Mithra; Sirisha Akella; Venkata Alubelli; Saraswathi S. Perumalla
- Web page: https://patentgrep.com/patent/US10770069B2

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 15/1815: {Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning}
- G10L 25/78: Detection of presence or absence of voice signals (switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10)
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L 2015/227: {of the speaker; Human-factor methodology}
- H04L 12/1822: {Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A computer system processes speech. Speech of a user is received from an audio sensor. An interruption in the speech of the user is determined and the speech of the user is analyzed to determine a context of the speech. One or more language data sources are analyzed to generate a suggestion corresponding to the interruption and based on the context of the speech. The suggestion is presented to the user. Embodiments of the present invention further include a method and program product for prompting a user in substantially the same manner described above.

## Claims

### Claim 1

A computer-implemented method of processing speech, the method comprising:
receiving speech of a user from an audio sensor;
determining an interruption in the speech of the user and analyzing the speech of the user to determine a context of the speech at a time of the interruption;
analyzing one or more language data sources to generate a suggestion corresponding to the interruption and based on the determined context of the speech, wherein generating the suggestion comprises determining one or more words to automatically prompt the user to complete the speech after the interruption, and wherein the one or more language data sources include one or more from a group of: a document written by the user, a speech history of the user, a social media history of the user, prior suggestions to the user, and brain data of the user; and
presenting the suggestion to the user.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the interruption comprises one or more from a group of: a pause in speech and a filler word.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein the brain data comprises data collected from the user with an electroencephalography device.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein the suggestion is presented by one or more of: a display of a mobile device, and an audio speaker of a mobile device.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein the determined context is a question posed to the user, and wherein the suggestion comprises a response to the question.

### Claim 6

A computer system for processing speech, the computer system comprising:
one or more computer processors;
one or more computer readable storage media;
program instructions stored on the one or more computer readable storage media for execution by at least one of the one or more computer processors, the program instructions comprising instructions to:
receive speech of a user from an audio sensor;
determine an interruption in the speech of the user and analyze the speech of the user to determine a context of the speech at a time of the interruption;
analyze one or more language data sources to generate a suggestion corresponding to the interruption and based on the determined context of the speech, wherein generating the suggestion comprises determining one or more words to automatically prompt the user to complete the speech after the interruption, and wherein the one or more language data sources include one or more from a group of: a document written by the user, a speech history of the user, a social media history of the user, prior suggestions to the user, and brain data of the user; and
present the suggestion to the user.

### Claim 7 (depends on 6)

The computer system of claim 6, wherein the interruption comprises one or more from a group of: a pause in speech and a filler word.

### Claim 8 (depends on 6)

The computer system of claim 6, wherein the brain data comprises data collected from the user with an electroencephalography device.

### Claim 9 (depends on 6)

The computer system of claim 6, wherein the suggestion is presented by one or more of: a display of a mobile device, and an audio speaker of a mobile device.

### Claim 10 (depends on 6)

The computer system of claim 6, wherein the determined context is a question posed to the user, and wherein the suggestion comprises a response to the question.

### Claim 11

A computer program product for processing speech, the computer program product comprising one or more computer readable storage media collectively having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to:
receive speech of a user from an audio sensor;
determine an interruption in the speech of the user and analyze the speech of the user to determine a context of the speech at a time of the interruption;
analyze one or more language data sources to generate a suggestion corresponding to the interruption and based on the context of the speech, wherein generating the suggestion comprises determining one or more words to automatically prompt the user to complete the speech after the interruption, and wherein the one or more language data sources include one or more from a group of: a document written by the user, a speech history of the user, a social media history of the user, prior suggestions to the user, and brain data of the user; and
present the suggestion to the user.

### Claim 12 (depends on 11)

The computer program product of claim 11, wherein the interruption comprises one or more from a group of: a pause in speech and a filler word.

### Claim 13 (depends on 11)

The computer program product of claim 11, wherein the brain data comprises data collected from the user with an electroencephalography device.

### Claim 14 (depends on 11)

The computer program product of claim 11, wherein the suggestion is presented by one or more of: a display of a mobile device, and an audio speaker of a mobile device.

### Claim 15 (depends on 11)

The computer program product of claim 11, wherein the determined context is a question posed to the user, and wherein the suggestion comprises a response to the question.
