# US 2022/0044670 A1 · Electronic device for performing voice recognition using microphones selected on basis of operation state, and operation method of same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0044670 A1
- Document ID: US20220044670A1
- Status: Published application
- Kind: A1
- Application number: 17/276,342
- Filed: 2019-05-28
- Published: 2022-02-10
- Earliest claimed: 2018-10-18
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Jaekyu SHIM; Seunghyun CHO; Sungmin HONG
- Web page: https://patentgrep.com/patent/US20220044670A1

## CPC

- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G10L 15/02: Feature extraction for speech recognition; Selection of recognition unit
- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- G10L 15/083: {Recognition networks (G10L15/142, G10L15/16 take precedence)}
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- H04R 1/1041: {Mechanical or electronic switches, or control elements (switches in general H01H)}
- H04R 3/005: {for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407)}
- H04R 29/005: {Microphone arrays}
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L 2015/228: {of application context}
- H04R 2420/07: Applications of wireless loudspeakers or wireless microphones
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

Various embodiments of the present invention relate to an electronic device for performing voice recognition using microphones selected on the basis of the operation state, and an operation method of same. According to an embodiment, the electronic device includes: one or more microphone arrays which include a plurality of microphones; at least one processor operatively connected to the microphone arrays; and at least one memory electrically connected to the processor, wherein the memory may store instructions for the processor to, at the time of execution; receive wake-up utterances, for calling designated voice services, by using a first group of microphones among the plurality of microphones when operating in a first state; operate in a second state in response to the wake-up utterances; and receive subsequent utterances using a second group of microphones among the plurality of microphones when operating in the second state. Various other embodiments are also possible.

## Claims

### Claim 1

An electronic device comprising:
one or more microphone arrays including a plurality of microphones;
at least one processor operatively connected to the one or more microphone arrays; and
at least one memory electrically connected to the at least one processor,
wherein the memory stores instructions which, when executed, enable the at least one processor to:
receive a wake-up utterance, which calls a designated voice service, using first group microphones among the plurality of microphones, while operating in a first state,
operate in a second state in response to the wake-up utterance, and
receive a subsequent utterance using second group microphones among the plurality of microphones, while operating in the second state, and
wherein the second group microphones comprise microphones, a number of which is greater than a number of the first group microphones.

### Claim 2 (depends on 1)

The electronic device as claimed in claim 1,
wherein the at least one processor comprises a first processor and a second processor, which is capable of operating logically or physically separately from the first processor, and
wherein the instructions comprise an instruction which enables the first processor to perform an operation associated with the first state, and enables the second processor to perform an operation associated with the second state.

### Claim 3 (depends on 1)

The electronic device as claimed in claim 1,
wherein the at least one processor comprises a first processor and a second processor, which is capable of operating logically or physically separately from the first processor, and
wherein the instructions comprise an instruction which enables the first processor to perform an operation associated with the first state if detecting a state change event while operating in the second state.

### Claim 4 (depends on 1)

The electronic device as claimed in claim 1,
wherein the at least one processor comprises a first processor and a second processor, which is capable of operating logically or physically separately from the first processor, and
wherein the instructions comprise an instruction which enables the first processor to request the second processor to verify the wake-up utterance in response to the wake-up utterance, and if the verification of the wake-up utterance is completed by the second processor, enables the second processor to operate an operation associated with the second state.

### Claim 5 (depends on 4)

The electronic device as claimed in claim 4,
wherein the instructions comprise an instruction which enables the first processor to receive another subsequent utterance using the first group microphones until the verification of the wake-up utterance is completed by the second processor, and if the verification of the wake-up utterance is completed by the second processor, enables the first processor to provide the received another subsequent utterance to the second processor.

### Claim 6 (depends on 5)

The electronic device as claimed in claim 5, wherein the instructions comprise an instruction which enables the second processor to perform natural language processing on the received another subsequent utterance.

### Claim 7 (depends on 1)

The electronic device as claimed in claim 1,
wherein the at least one processor comprises a first processor and a second processor, which is capable of operating logically or physically separately from the first processor, and
wherein the instructions comprise an instruction which enables the first processor to perform a first pre-processing on the wake-up utterance that calls the designated voice service, and enables the second processor to perform a second pre-processing on the subsequent utterance, the second pre-processing having a greater processing capability than that of the first pre-processing.

### Claim 8 (depends on 1)

The electronic device as claimed in claim 1,
wherein the electronic device comprises a switch operatively connected to the microphone arrays and the at least one processor,
wherein the at least one processor comprises a first processor and a second processor, which is capable of operating logically or physically separately from the first processor, and
wherein the instructions comprise an instruction which enables the switch to provide an utterance received via the first group microphones to the first processor, while operating in the first state, and enables the switch to provide an utterance received via the second group microphones to the second processor, while operating in the second state.

### Claim 9

An operation method of an electronic device, the method comprising:
while operating in a first state, receiving a wake-up utterance, which calls a designated voice service, using first group microphones among a plurality of microphones, and in response to the wake-up utterance, changing a state of the electronic device to a second state; and
while operating in the second state, receiving a subsequent utterance using second group microphones among the plurality of microphones,
wherein the second group microphones comprise microphones, a number of which is greater than a number of the first group microphones.

### Claim 10 (depends on 9)

The method as claimed in claim 9, the method comprising:
activating a first processor to receive the wake-up utterance; and
activating a second processor, which has an utterance recognition capability relatively greater than that of the first processor, in order to receive the subsequent utterance.

### Claim 11 (depends on 10)

The method as claimed in claim 10, the method comprising:
if detecting a state change event while operating in the second state, activating the first processor to operate an operation associated with the first state.

### Claim 12 (depends on 10)

The method as claimed in claim 10, the method comprising:
activating the second processor to verify the wake-up utterance in response to the wake-up utterance; and
if the verification of the wake-up utterance is completed, performing an operation associated with the second state.

### Claim 13 (depends on 12)

The method as claimed in claim 12, the method comprising:
until the verification of the wake-up utterance is completed, maintaining the first processor in an activated state so as to receive another subsequent utterance using first group microphones.

### Claim 14 (depends on 13)

The method as claimed in claim 13, the method comprising:
controlling the second processor so as to perform natural language processing on the received another subsequent utterance, if the verification of the wake-up utterance is completed.

### Claim 15 (depends on 9)

The method as claimed in claim 9, the method comprising:
controlling a first processor so as to perform first pre-processing on the wake-up utterance which calls the designated voice service; and
controlling a second processor so as to perform second pre-processing on the subsequent utterance, the second pre-processing having a greater processing capability than that of the first pre-processing.
