# US 12,112,753 B2 · Method and mobile device for processing command based on utterance input

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,112,753 B2
- Document ID: US12112753B2
- Status: Granted
- Kind: B2
- Application number: 17/698,671
- Filed: 2022-03-18
- Published: 2022-08-25
- Granted: 2024-10-08
- Earliest claimed: 2021-02-19
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Jongsun Lee; Seonghan Ryu; Hyungrai Oh; Hojung Lee
- Web page: https://patentgrep.com/patent/US12112753B2

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G06F 3/16: Sound input; Sound output (speech processing G10L)
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06Q 10/02: Reservations, e.g. for tickets, services or events
- G10L 15/065: Adaptation
- H04W 4/02: Services making use of location information
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L 2015/226: {using non-speech characteristics}
- G10L 2015/228: {of application context}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

A mobile device includes: a location sensor configured to detect a location of the mobile device; a timer; a microphone configured to receive an utterance input of a user; a communication interface; a memory; and a processor. The processor is configured to execute one or more instructions stored in the memory to extract, from the utterance input of the user, element information corresponding to a command controlling a target device and detection condition information of the target device; detect first context information using the location sensor and the timer; determine whether the detected first context information satisfies the detection condition information of the target device; and process the command corresponding to the element information of the command, based on a result of the determination.

## Claims

### Claim 1

A method, performed by a mobile device, of processing a command based on an utterance input of a user, the method comprising:
extracting, from the utterance input of the user, element information corresponding to the command controlling a target device and detection condition information of the target device;
detecting first context information using a location sensor and a timer;
determining whether the detected first context information satisfies the detection condition information; and
processing the command corresponding to the element information, based on a result of the determining,
wherein, in a case where the utterance input comprises a reservation time of a function to be performed by the target device, the processing of the command comprises, in a case where the detected first context information satisfies the detection condition information, when a signal indicating that reservation is impossible is received from the target device in response to detecting the target device and transmitting the command to the target device:
generating the command in a form from which the reservation time is removed;
registering the command in a command list; and
performing a process of attempting to detect the target device again at the reservation time, and transmitting the command registered in the command list to the target device.

### Claim 2 (depends on 1)

The method of claim 1, wherein the processing of the command comprises, in a case where the detected first context information does not satisfy the detection condition information, registering the command in a the command list and detecting a change in the first context information to second context information, and in a case where the second context information satisfies the detection condition information, detecting the target device and transmitting the command to the target device.

### Claim 3 (depends on 1)

The method of claim 1, wherein the processing of the command comprises, in a case where the detected first context information satisfies the detection condition information, when the target device is not detected, registering the command in the command list and periodically performing a process of attempting to detect the target device again to transmit the command registered in the command list to the target device.

### Claim 4 (depends on 1)

The method of claim 1, wherein the processing of the command comprises, in a case where the detected first context information satisfies the detection condition information, when the target device is not detected, registering the command in the command list, and when movement of the mobile device is detected, performing a process of attempting to detect the target device again to transmit the command registered in the command list to the target device.

### Claim 5 (depends on 1)

The method of claim 1, wherein the processing of the command comprises, in a case where the detected first context information satisfies the detection condition information, when the target device is not detected, registering the command in the command list, and when a request signal is received from an external device, performing a process of attempting to detect the target device again to transmit the command registered in the command list to the target device.

### Claim 6 (depends on 1)

The method of claim 1, wherein the processing of the command comprises, in a case where the detected first context information satisfies the detection condition information, when the target device is not detected and when the first context information detected using at least one of the location sensor or the timer is changed to second context information and thus the detection condition information is no longer satisfied, performing an action corresponding to the detection condition information that is no longer satisfied.

### Claim 7 (depends on 1)

The method of claim 1, wherein the processing of the command comprises, in a case where the detected first context information does not satisfy the detection condition information, registering the command in the command list, and when the first context information detected using the location sensor and the timer is changed to second context information and thus the detection condition information is satisfied, detecting the target device and transmitting the command registered in the command list to the target device.

### Claim 8

A non-transitory computer-readable recording medium having recorded thereon a program to be executed on a computer, the non-transitory computer- readable recording medium comprising instructions for:
extracting, from an utterance input of a user, element information corresponding to a command controlling a target device and detection condition information of the target device;
detecting first context information using a location sensor and a timer;
determining whether the detected first context information satisfies the detection condition information; and
processing the command corresponding to the element information, based on a result of the determination,
wherein, in a case where the utterance input comprises a reservation time of a function to be performed by the target device, the processing of the command comprises, in a case where the detected first context information satisfies the detection condition information, when a signal indicating that reservation is impossible is received from the target device in response to detecting the target device and transmitting the command to the target device:
generating the command in a form from which the reservation time is removed;
registering the command in a command list; and
performing a process of attempting to detect the target device again at the reservation time, and transmitting the command registered in the command list to the target device.

### Claim 9

A mobile device comprising:
a location sensor configured to detect a location of the mobile device;
a timer;
a microphone configured to receive an utterance input of a user;
a communication interface;
a memory storing one or more instructions; and
a processor configured to execute the one or more instructions to:
extract, from the utterance input of the user, element information corresponding to a command controlling a target device and detection condition information of the target device;
detect first context information using the location sensor and the timer;
determine whether the detected first context information satisfies the detection condition information; and
process the command corresponding to the element information, based on a result of the determination,
wherein, in a case where the utterance input comprises a reservation time of a function to be performed by the target device, wherein the processor is further configured to execute the one or more instructions to:
identify whether the target device supports a reservation function, based on information on model-wise reservation function supportability of the target device, and when the target device does not support the reservation function, generate the command in a form from which the reservation time is removed;
register the command in a command list; and
detect the first context information using the location sensor and the timer at the reservation time.

### Claim 10 (depends on 9)

The mobile device of claim 9, wherein the processor is further configured to execute the one or more instructions to, in a case where the detected first context information does not satisfy the detection condition information, register the command in the command list and detect a change in the first context information to second context information, and in a case where the second context information satisfies the detection condition information, detect the target device and transmit the command to the target device.

### Claim 11 (depends on 9)

The mobile device of claim 9, wherein the processor is further configured to execute the one or more instructions to, in a case where the detected first context information satisfies the detection condition information, when the target device is not detected via the communication interface:
register the command in the command list; and
periodically perform a process of attempting to detect the target device again via the communication interface to transmit the command registered in the command list to the target device.

### Claim 12 (depends on 9)

The mobile device of claim 9, wherein the processor is further configured to execute the one or more instructions to, in a case where the detected first context information satisfies the detection condition information, when the target device is not detected via the communication interface:
register the command in the command list; and
when movement of the mobile device is detected, perform a process of attempting to detect the target device again via the communication interface to transmit the command registered in the command list to the target device.

### Claim 13 (depends on 9)

The mobile device of claim 9, wherein the processor is further configured to execute the one or more instructions to, in a case where the detected first context information satisfies the detection condition information, when the target device is not detected via the communication interface:
register the command in the command list; and
when a request signal is received from an external device via the communication interface, perform a process of attempting to detect the target device again to transmit the command registered in the command list to the target device.