# US 2021/0243354 A1 · Voice input apparatus, control method thereof, and storage medium for executing processing corresponding to voice instruction

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0243354 A1
- Document ID: US20210243354A1
- Status: Published application
- Kind: A1
- Application number: 17/163,884
- Filed: 2021-02-01
- Published: 2021-08-05
- Earliest claimed: 2020-02-05
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: Daiyu Ueno; Maiki Okuwaki
- Web page: https://patentgrep.com/patent/US20210243354A1

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- H04N 23/66: Remote control of cameras or camera parts, e.g. by remote control devices
- G03B 17/02: Bodies
- G03B 31/00: Associated working of cameras or projectors with sound-recording or sound-reproducing means
- G06F 3/16: Sound input; Sound output (speech processing G10L)
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 40/16: Human faces, e.g. facial parts, sketches or expressions
- H04N 23/61: based on recognised objects
- G10L 17/22: Interactive procedures; Man-machine interfaces
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A voice input apparatus inputs voice and performs control to, in a case where a second voice instruction for operating the voice input apparatus is input in a fixed period after a first voice instruction for enabling operations by voice on the voice input apparatus is input, execute processing corresponding to the second voice instruction. The voice input apparatus, in a case where it is estimated that a predetermined user issued the second voice instruction, executes processing corresponding to the second voice instruction when the second voice instruction is input, even in a case where the first voice instruction is not input.

## Claims

### Claim 1

A voice input apparatus comprising.
a voice input device configured to input voice;
one or more processors; and
a memory storing instructions which, when the instructions are executed by the one or more processors, cause the voice input apparatus to function as:
a control unit configured to perform control to, in a case where a second voice instruction for operating the voice input apparatus is input in a fixed period after a first voice instruction for enabling operations by voice on the voice input apparatus is input, execute processing corresponding to the second voice instruction,
wherein the control unit, in a case where it is estimated that a predetermined user issued the second voice instruction, executes processing corresponding to the second voice instruction when the second voice instruction is input, even in a case where the first voice instruction is not input.

### Claim 2 (depends on 1)

The voice input apparatus according to claim 1, further comprising:
an image capture device configured to output a shot image including the predetermined user as a subject,
wherein the control unit:
calculates a first direction representing a direction of the predetermined user from the voice input apparatus based on the shot image, and calculates a direction from which the second voice instruction issued as a second direction based on the second voice instruction, and
in a case where the first direction matches the second direction, estimates that the predetermined user issued the second voice instruction.

### Claim 3 (depends on 1)

The voice input apparatus according to claim 1, further comprising;
an image capture device configured to output a shot image including the predetermined user as a subject,
wherein the control unit:
calculates a distance from the voice input apparatus to the predetermined user based on the second voice instruction, and calculates an orientation of a face of the subject in the shot image as a third direction, and
in a case where the distance to the predetermined user is less than or equal to a threshold, and it is determined that a fourth direction which is an orientation of the voice input apparatus and the third direction are facing each other, estimates that the predetermined user issued the second voice instruction.

### Claim 4 (depends on 1)

The voice input apparatus according to claim 1, further comprising:
an image capture device configured to output a shot image including the predetermined user as a subject; and
a communication device configured to perform near field communication with a communication apparatus of the predetermined user,
wherein the control unit;
calculates a distance from the voice input apparatus to the communication apparatus based on the near field communication with the communication apparatus, and calculates an orientation of a face of the subject in the shot image as a third direction, and
in a case where the distance to the communication apparatus is less than or equal to a threshold, and it is determined that a fourth direction which is an orientation of the voice input apparatus and the third direction are facing each other, estimates that the predetermined user issued the second voice instruction.

### Claim 5 (depends on 3)

The voice input apparatus according to claim 3, wherein the control unit, in a case where an angle difference between the fourth direction and the third direction that is determined by an orientation of an optical axis of the image capture device is less than or equal to a predetermined angle threshold, determines that the fourth direction which is the orientation of the voice input apparatus and the third direction are facing each other.

### Claim 6 (depends on 5)

The voice input apparatus according to claim 5, wherein the control unit, in a case where an angle difference between the fourth direction and the third direction that is determined by an orientation of an optical axis of the image capture device is less than or equal to a predetermined angle threshold, and a time for which the angle difference is less than or equal to the predetermined angle threshold is greater than or equal to a predetermined time threshold, determines that the fourth direction which is the orientation of the voice input apparatus and the third direction are facing each other.

### Claim 7 (depends on 3)

The voice input apparatus according to claim 3, wherein the control unit, in a case where the distance from the voice input apparatus to the predetermined user is not less than or equal to the threshold, does not execute processing corresponding to the second voice instruction, even if the second voice instruction is input.

### Claim 8 (depends on 2)

The voice input apparatus according to claim 2, the instructions further causing the voice input apparatus to function as:
a determination unit configured to determine whether the predetermined user is a registered user, based on a face of the subject in the shot image or a voice of the second voice instruction,
wherein the control unit, in a case where it is determined that the predetermined user is a registered user, and it is estimated that the predetermined user issued the second voice instruction, executes processing corresponding to the second voice instruction when the second voice instruction is input, even in a case where the first voice instruction is not input.

### Claim 9 (depends on 2)

The voice input apparatus according to claim 2, wherein the control unit does not execute processing corresponding to the second voice instruction if the voice input apparatus is not set to a mode for shooting.

### Claim 10 (depends on 9)

The voice input apparatus according to claim 9, wherein the control unit does not execute processing corresponding to the second voice instruction, if the second voice instruction is not a shooting instruction.

### Claim 11 (depends on 2)

The voice input apparatus according to claim 2, wherein the image capture device is disposed on at least one of a front side and a back side of the voice input apparatus.

### Claim 12 (depends on 1)

The voice input apparatus according to claim 1, wherein the control unit does not execute processing corresponding to the second voice instruction, if a voice volume of the second voice instruction is not greater than or equal to a fixed voice volume.

### Claim 13 (depends on 1)

The voice input apparatus according to claim 1, wherein the voice input device is configured so as acquire, from an external device, voice input by the external device.

### Claim 14

A control method of a voice input apparatus, the voice input apparatus comprising a voice input device configured to input voice, the control method comprising:
performing control to, in a case where a second voice instruction for operating the voice input apparatus is input in a fixed period after a first voice instruction for enabling operations by voice on the voice input apparatus is input, execute processing corresponding to the second voice instruction,
wherein, in the controlling, in a case where it is estimated that a predetermined user issued the second voice instruction, processing corresponding to the second voice instruction is executed when the second voice instruction is input, even in a case where the first voice instruction is not input.

### Claim 15

A non-transitory computer-readable storage medium comprising instructions for performing a control method of a voice input apparatus, the voice input apparatus comprising a voice input device configured to input voice, the control method comprising:
performing control to, in a case where a second voice instruction for operating the voice input apparatus is input in a fixed period after a first voice instruction for enabling operations by voice on the voice input apparatus is input, execute processing corresponding to the second voice instruction,
wherein, in the controlling, in a case where it is estimated that a predetermined user issued the second voice instruction, processing corresponding to the second voice instruction is executed when the second voice instruction is input, even in a case where the first voice instruction is not input.
