# US 2019/0172465 A1 · Method for voice recognition and electronic device for performing same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0172465 A1
- Document ID: US20190172465A1
- Status: Published application
- Kind: A1
- Application number: 16/321,549
- Filed: 2017-07-04
- Published: 2019-06-06
- Earliest claimed: 2016-08-23
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Dong Kyu LEE; Ja Min GOO; Hyung Woo KIM; Seung Hyuk YU; Jin Hong JEONG; Ji Hyun PARK; Kyung Hee LEE; Ju Yeong LEE
- Web page: https://patentgrep.com/patent/US20190172465A1

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G10L 15/1822: {Parsing for meaning understanding}
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
- G10L 15/32: Multiple recognisers used in sequence or in parallel; Score combination systems therefor, e.g. voting systems
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An electronic device includes an audio input module, a memory storing a speech recognition application, a first application, and a second application, a communication circuit communicating with a first NLU server associated with the first application and a second NLU server associated with the second application, and a processor electrically connected to the audio input module, the memory, and the communication circuit and executing the speech recognition application. The processor is configured to convert an utterance of a user received through the audio input module, into an audio signal, to transmit text data corresponding to the audio signal to the first NLU server and the second NLU server, to receive a first control message as a result of analyzing the text data, from the first NLU server, to receive a second control message as a result of analyzing the text data, from the second NLU server, to select one of the first control message or the second control message depending on a specified condition, to provide the first control message to the first application, when the first control message is selected, and to provide the second control message to the second application, when the second control message is selected.

## Claims

### Claim 1

A method for recognizing voice, the method comprising:
obtaining voice information corresponding to an utterance of a user;
transmitting the voice information to a first natural language understanding (NLU) server associated with a first application and a second NLU server associated with a second application;
obtaining first information from the first NLU server and obtaining second information from the second NLU server, in response to the voice information; and
executing a function corresponding to the utterance, using at least one of the first application and the second application based at least partly on the first information and the second information.

### Claim 2 (depends on 1)

The method of claim 1, wherein the first information includes a first confidence associated with a result of analyzing the voice information in the first NLU server, and
wherein the second information includes a second confidence associated with a result of analyzing the voice information in the second NLU server.

### Claim 3

A method for recognizing voice, the method comprising:
converting an utterance of a user into an audio signal;
obtaining text data corresponding to the audio signal;
transmitting the text data to a first NLU server associated with a first application and a second NLU server associated with a second application;
respectively receiving a first control message and a second control message from the first NLU server and the second NLU server as a result of analyzing the text data;
selecting one of the first control message or the second control message, depending on a specified condition; and
providing the selected control message to an application associated with an NLU server transmitting the selected control message.

### Claim 4 (depends on 3)

The method of claim 3, wherein each of the first control message and the second control message includes data indicating a confidence of a result of analyzing the text data, and
wherein the selecting includes selecting a control message, the confidence of which is higher, from among the first control message or the second control message.

### Claim 5

An electronic device comprising:
an audio input module;
a memory configured to store a speech recognition application, a first application, and a second application;
a communication circuit configured to communicate with a first NLU server associated with the first application and a second NLU server associated with the second application; and
a processor electrically connected to the audio input module, the memory, and the communication circuit and configured to execute the speech recognition application, wherein the processor is configured to:
convert an utterance of a user received through the audio input module, into an audio signal;
transmit text data corresponding to the audio signal to the first NLU server and the second NLU server;
receive a first control message as a result of analyzing the text data, from the first NLU server;
receive a second control message as a result of analyzing the text data, from the second NLU server;
select one of the first control message or the second control message depending on a specified condition;
provide the first control message to the first application, when the first control message is selected; and
provide the second control message to the second application, when the second control message is selected.

### Claim 6 (depends on 5)

The electronic device of claim 5, wherein the first application causes the processor to perform an operation that the first control message indicates, and
wherein the second application causes the processor to perform an operation that the second control message indicates.

### Claim 7 (depends on 5)

The electronic device of claim 5, wherein the communication circuit is configured to further communicate with an ASR server, and
wherein the processor is configured to:
transmit the audio signal to the ASR server; and
receive the text data from the ASR server.

### Claim 8 (depends on 5)

The electronic device of claim 5, wherein the processor is configured to:
convert the audio signal into the text data based on a specified algorithm.

### Claim 9 (depends on 5)

The electronic device of claim 5, wherein each of the first control message and the second control message includes data indicating a confidence of a result of analyzing the text data, and
wherein the processor is configured to:
select a control message, the confidence of which is higher, from among the first control message or the second control message.

### Claim 10 (depends on 5)

The electronic device of claim 5, wherein the memory further stores data indicating an execution frequency of each of the first application and the second application, and
wherein the processor is configured to:
select a control message corresponding to an application, the execution frequency of which is the highest, from among the first application and the second application.

### Claim 11 (depends on 5)

The electronic device of claim 5, wherein the memory further stores data indicating an execution history of each of the first application and the second application, and
wherein the processor is configured to:
select a control message corresponding to a most recently executed application among the first application and the second application.

### Claim 12 (depends on 5)

The electronic device of claim 5, wherein the processor is configured to:
select a control message, which is received first, from among the first control message or the second control message.

### Claim 13 (depends on 5)

The electronic device of claim 5, wherein the memory further stores a market application,
wherein the communication circuit further communicates with a third NLU server associated with the market application, and
wherein the processor is configured to:
transmit the text data corresponding to the audio signal to the third NLU server; and
receive a third control message including identification information of a recommendation application as a result of analyzing the text data, from the third NLU server.

### Claim 14 (depends on 13)

The electronic device of claim 13, wherein each of the first control message and the second control message includes a confidence of the result of analyzing the text data, and
wherein the processor is configured to:
provide the third control message to the market application, when the confidence of each of the first control message and the second control message is lower than a specified value.

### Claim 15 (depends on 14)

The electronic device of claim 14, wherein the market application causes the processor to provide a user interface (UI) for downloading the recommendation application by using the identification information included in the third control message.
