# US 2021/0065716 A1 · Voice processing method and electronic device supporting the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0065716 A1
- Document ID: US20210065716A1
- Status: Published application
- Kind: A1
- Application number: 17/097,087
- Filed: 2020-11-13
- Published: 2021-03-04
- Earliest claimed: 2017-07-10
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Joo Hyuk JEON; Woo Up KWON; Jin Woo PARK; Kyoung Gu WOO; Eun Taek LIM; Kyung Hak HYUN; Dong Ho JANG
- Web page: https://patentgrep.com/patent/US20210065716A1

## CPC

- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 40/274: Converting codes to words; Guess-ahead of partial word inputs
- G06F 40/35: Discourse or dialogue representation
- G06F 40/40: Processing or translation of natural language (natural language analysis G06F40/20; semantic analysis G06F40/30)
- G10L 15/16: using artificial neural networks
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L 2015/228: {of application context}
- H04W 88/02: Terminal devices
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

An electronic device and method are disclosed herein. The electronic device includes a network interface and processor. The processor implements the method, including receiving a voice input through a network interface as transmitted from a first external device, including a request to execute a function using at least one application which is not indicated in the voice input, extracting a first text from the voice input by executing automatic speech recognition (ASR), when the at least one application is identified based on the first text, transmitting, through the network interface to the first external device, second data associated with the identified at least one application for display by the first external device, and when the at least one application is not identified based at least in part on the first text, reattempting identification of the at least one application by executing natural language understanding (NLU) on the first text.

## Claims

### Claim 1

An electronic device, comprising:
a network interface;
at least one processor operatively connected with the network interface; and
at least one memory storing instructions and operatively connected with the at least one processor, the instructions executable by the at least one processor to:
receive a voice input through the network interface as transmitted from a first external device, the voice input including a request to execute a function using at least one application which is not indicated in the voice input,
extract a first text from the voice input by executing automatic speech recognition (ASR) on the voice input,
when the at least one application is identified based at least in part on the first text, transmit, through the network interface to the first external device, second data associated with the identified at least one application for display by the first external device, and
when the at least one application is not identified based at least in part on the first text, reattempt identification of the at least one application by executing natural language understanding (NLU) on the first text to determine the at least one application capable of executing the function.

### Claim 2 (depends on 1)

The electronic device of claim 1, wherein the instructions cause the at least one processor to:
identify the at least one application program by comparing the first text with at least one of a plurality of prestored sentences, a plurality of prestored phrases, and a plurality of prestored words.

### Claim 3 (depends on 1)

The electronic device of claim 1, wherein the instructions cause the at least one processor to:
perform the NLU on the first text to identify a domain indicating a set of prestored user intents indicated by the first text.

### Claim 4 (depends on 1)

The electronic device of claim 1, wherein the identified at least one application program comprises at least one of an application program downloadable from an app store, a web application program, and an interactive agent program.

### Claim 5 (depends on 1)

The electronic device of claim 1, wherein the instructions cause the at least one processor to:
when the at least one application is not identified by executing NLU, execute an Internet search on the first text.

### Claim 6 (depends on 1)

The electronic device of claim 1, wherein the instructions cause the at least one processor to:
after the second data is transmitted to the first external device for display, receive a user selection as transmitted from the first external device.

### Claim 7 (depends on 6)

The electronic device of claim 6, wherein the instructions cause the at least one processor to:
transmit to the first external device an indication allowing performance of the function based on the user selection.

### Claim 8 (depends on 6)

The electronic device of claim 6, wherein the instructions cause the at least one processor to:
transmit to the first external device a second indication allowing display of a result of performance of the function by an external server, based on the user selection.

### Claim 9 (depends on 6)

The electronic device of claim 6, wherein the instructions cause the at least one processor to:
execute the function according to selection of a function available to the identified at least one application, the function derived from at least one of a downloadable application program, a web application program, and an interactive agent program.

### Claim 10

A method in an electronic device, the method comprising:
receiving a voice input through a network interface as transmitted from a first external device, the voice input including a request to execute a function using at least one application which is not indicated in the voice input,
extracting, by at least one processor, a first text from the voice input by executing automatic speech recognition (ASR) on the voice input,
when the at least one application is identified based at least in part on the first text, transmitting, through the network interface to the first external device, second data associated with the identified at least one application for display by the first external device, and
when the at least one application is not identified based at least in part on the first text, reattempting identification of the at least one application by executing natural language understanding (NLU) on the first text to determine the at least one application capable of executing the function.

### Claim 11 (depends on 10)

The method of claim 10, further comprising:
identifying the at least one application program by comparing the first text with at least one of a plurality of prestored sentences, a plurality of prestored phrases, and a plurality of prestored words.

### Claim 12 (depends on 10)

The method of claim 10, further comprising:
performing the NLU on the first text to identify a domain indicating a set of prestored user intents indicated by the first text.

### Claim 13 (depends on 10)

The method of claim 10, wherein the identified at least one application program comprises at least one of an application program downloadable from an app store, a web application program, and an interactive agent program.

### Claim 14 (depends on 10)

The method of claim 10, further comprising:
when the at least one application is not identified by executing NLU, executing an Internet search on the first text.

### Claim 15 (depends on 10)

The method of claim 10, further comprising:
after the second data is transmitted to the first external device for display, receiving a user selection as transmitted from the first external device.

### Claim 16 (depends on 15)

The method of claim 15, further comprising:
transmitting to the first external device an indication allowing performance of the function based on the user selection.

### Claim 17 (depends on 15)

The method of claim 15, further comprising:
transmitting to the first external device a second indication allowing display of a result of performance of the function by an external server, based on the user selection.

### Claim 18 (depends on 15)

The method of claim 15, further comprising:
executing the function according to selection of a function available to the identified at least one application, the function derived from at least one of a downloadable application program, a web application program, and an interactive agent program.
