# US 2020/0286478 A1 · Voice processing device, meeting system, and voice processing method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0286478 A1
- Document ID: US20200286478A1
- Status: Published application
- Kind: A1
- Application number: 16/802,149
- Filed: 2020-02-26
- Published: 2020-09-10
- Earliest claimed: 2019-03-06
- Assignees: Sharp Kabushiki Kaisha
- Applicants: Sharp Kabushiki Kaisha
- Inventors: KEIKO HIRUKAWA; SATOSHI TERADA
- Web page: https://patentgrep.com/patent/US20200286478A1

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G10L 15/183: using context dependencies, e.g. language models
- G10L 15/28: Constructional details of speech recognition systems
- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- H04N 7/15: Conference systems
- G10L 17/00: Speaker identification or verification techniques
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A voice processing device includes a voice receiver that receives a voice, an imager, an image acquirer that acquires a captured image captured by the imager, an utterer identifier that identifies an utterer based on the voice received by the voice receiver and the captured image acquired by the image acquirer, a voice determiner that determines whether the voice is a specific word based on the voice received by the voice receiver and an image of the utterer identified by the utterer identifier, the image being included in the captured image, and a voice transmitter that switches a transmission destination of the voice received by the voice receiver based on a determination result by the voice determiner.

## Claims

### Claim 1

A voice processing device comprising:
a voice receiver that receives a voice;
an imager;
an image acquirer that acquires a captured image captured by the imager;
an utterer identifier that identifies an utterer based on the voice received by the voice receiver and the captured image acquired by the image acquirer;
a voice determiner that determines whether the voice is a specific word for starting receiving a predetermined command based on the voice received by the voice receiver and an image of the utterer identified by the utterer identifier, the image of the utterer being included in the captured image; and
a voice transmitter that switches a transmission destination of the voice received by the voice receiver based on a determination result by the voice determiner.

### Claim 2 (depends on 1)

The voice processing device according to claim 1, wherein if the voice determiner determines that the voice received by the voice receiver is the specific word, the voice transmitter transmits a voice received following the specific word by the voice receiver, as a command voice, to a server device that executes the predetermined command.

### Claim 3 (depends on 1)

The voice processing device according to claim 1, wherein if the voice determiner determines that the voice received by the voice receiver is not the specific word, the voice transmitter transmits the voice to a predetermined external device.

### Claim 4 (depends on 1)

The voice processing device according to claim 1, wherein if the voice received by the voice receiver matches the specific word and a direction of a face of the utterer or a line of sight of the utterer included in the captured image is directed to the imager, the voice determiner determines that the voice received by the voice receiver is the specific word.

### Claim 5 (depends on 1)

The voice processing device according to claim 1, wherein the voice transmitter switches, based on a determination result by the voice determiner, between a first transmission mode in which the voice received by the voice receiver is transmitted to a server device that executes the predetermined command and a second transmission mode in which the voice received by the voice receiver is transmitted to a predetermined external device.

### Claim 6 (depends on 5)

The voice processing device according to claim 5, further including a display process operator that causes to display identification information indicating the first transmission mode or the second transmission mode.

### Claim 7 (depends on 5)

The voice processing device according to claim 5, further including an adjustment process operator that adjusts a directivity of a microphone that collects the voice, into a direction of the utterer identified by the utterer identifier if the second transmission mode is switched to the first transmission mode by the voice transmitter.

### Claim 8 (depends on 2)

The voice processing device according to claim 2, further including a response process operator that acquires a response corresponding to the command executed in the server device from the server device, and outputs the response.

### Claim 9

A meeting system comprising a first voice processing device and a second voice processing device that are connected to each other via a network so that a voice received by the first voice processing device is transmitted to the second voice processing device and a voice received by the second voice processing device is transmitted to the first voice processing device, in which the first voice processing device includes:
a voice receiver that receives a voice;
an imager;
an image acquirer that acquires a captured image captured by the imager;
an utterer identifier that identifies an utterer based on the voice received by the voice receiver and the captured image acquired by the image acquirer;
a voice determiner that determines whether the voice is a specific word for starting receiving a predetermined command based on the voice received by the voice receiver and an image of the utterer identified by the utterer identifier, the image of the utterer being included in the captured image; and
a voice transmitter that switches a transmission destination of the voice received by the voice receiver based on a determination result by the voice determiner, wherein
if the voice determiner determines that the voice received by the voice receiver is the specific word, the voice transmitter transmits a voice received following the specific word by the voice receiver, as a command voice, to a server device that executes the predetermined command, and
if the voice determiner determines that the voice received by the voice receiver is not the specific word, the voice transmitter transmits the voice to the second voice processing device.

### Claim 10 (depends on 9)

The meeting system according to claim 9, wherein the second voice processing device outputs the voice received from the first voice processing device.

### Claim 11

A voice processing method for executing, by one or more processors:
a voice reception process for receiving a voice;
an image processing process for acquiring a captured image captured by an imager;
an utterer identifying process for identifying an utterer based on the voice received at the voice reception process and the captured image acquired at the image processing process;
a voice determination process for determining whether the voice is a specific word for starting receiving a predetermined command based on the voice received at the voice reception process and an image of the utterer identified at the utterer identifying process, the image of the utterer being included in the captured image; and
a voice transmission process for switching a transmission destination of the voice received at the voice reception process based on a determination result at the voice determination process.
