# US 2019/0378501 A1 · Speech processing and context-based language prompting

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0378501 A1
- Document ID: US20190378501A1
- Status: Published application
- Kind: A1
- Application number: 16/002,241
- Filed: 2018-06-07
- Published: 2019-12-12
- Earliest claimed: 2018-06-07
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Sripathi S. Mithra; Sirisha Akella; Venkata Alubelli; Saraswathi S. Perumalla
- Web page: https://patentgrep.com/patent/US20190378501A1

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 15/1815: {Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning}
- G10L 25/78: Detection of presence or absence of voice signals (switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10)
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L 2015/227: {of the speaker; Human-factor methodology}
- H04L 12/1822: {Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A computer system processes speech. Speech of a user is received from an audio sensor. An interruption in the speech of the user is determined and the speech of the user is analyzed to determine a context of the speech. One or more language data sources are analyzed to generate a suggestion corresponding to the interruption and based on the context of the speech. The suggestion is presented to the user. Embodiments of the present invention further include a method and program product for prompting a user in substantially the same manner described above.

## Claims

### Claim 1

A computer-implemented method of processing speech, the method comprising:
receiving speech of a user from an audio sensor;
determining an interruption in the speech of the user and analyzing the speech of the user to determine a context of the speech;
analyzing one or more language data sources to generate a suggestion corresponding to the interruption and based on the determined context of the speech; and
presenting the suggestion to the user.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the interruption comprises one or more from a group of: a pause in speech and a filler word.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein the one or more language data sources include one or more from a group of: at least one document written by the user, a speech history of the user, a general language sample, a social media history of the user, prior suggestions, and brain data.

### Claim 4 (depends on 3)

The computer-implemented method of claim 3, wherein the brain data comprises data collected from the user with an electroencephalography device.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein the suggestion is presented by one or more of: a display of a mobile device, and an audio speaker of a mobile device.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, wherein the determined context is a question posed to the user, and wherein the suggestion comprises a response to the question.

### Claim 7

A computer system for processing speech, the computer system comprising:
one or more computer processors;
one or more computer readable storage media;
program instructions stored on the one or more computer readable storage media for execution by at least one of the one or more computer processors, the program instructions comprising instructions to:
receive speech of a user from an audio sensor;
determine an interruption in the speech of the user and analyze the speech of the user to determine a context of the speech;
analyze one or more language data sources to generate a suggestion corresponding to the interruption and based on the determined context of the speech; and
present the suggestion to the user.

### Claim 8 (depends on 7)

The computer system of claim 7, wherein the interruption comprises one or more from a group of: a pause in speech and a filler word.

### Claim 9 (depends on 7)

The computer system of claim 7, wherein the one or more language data sources include one or more from a group of: at least one document written by the user, a speech history of the user, a general language sample, a social media history of the user, prior suggestions and brain data.

### Claim 10 (depends on 9)

The computer system of claim 9, wherein the brain data comprises data collected from the user with an electroencephalography device.

### Claim 11 (depends on 7)

The computer system of claim 7, wherein the suggestion is presented by one or more of: a display of a mobile device, and an audio speaker of a mobile device.

### Claim 12 (depends on 7)

The computer system of claim 7, wherein the determined context is a question posed to the user, and wherein the suggestion comprises a response to the question.

### Claim 13

A computer program product for processing speech, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to:
receive speech of a user from an audio sensor;
determine an interruption in the speech of the user and analyze the speech of the user to determine a context of the speech;
analyze one or more language data sources to generate a suggestion corresponding to the interruption and based on the context of the speech; and
present the suggestion to the user.

### Claim 14 (depends on 13)

The computer program product of claim 13, wherein the interruption comprises one or more from a group of: a pause in speech and a filler word.

### Claim 15 (depends on 13)

The computer program product of claim 13, wherein the one or more language data sources include one or more from a group of: at least one document written by the user, a speech history of the user, a general language sample, a social media history of the user, prior suggestions and brain data.

### Claim 16 (depends on 15)

The computer program product of claim 15, wherein the brain data comprises data collected from the user with an electroencephalography device.

### Claim 17 (depends on 13)

The computer program product of claim 13, wherein the suggestion is presented by one or more of: a display of a mobile device, and an audio speaker of a mobile device.

### Claim 18 (depends on 13)

The computer program product of claim 13, wherein the determined context is a question posed to the user, and wherein the suggestion comprises a response to the question.
