# US 2019/0172459 A1 · External control device, speech interactive control system, and control method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0172459 A1
- Document ID: US20190172459A1
- Status: Published application
- Kind: A1
- Application number: 16/207,450
- Filed: 2018-12-03
- Published: 2019-06-06
- Earliest claimed: 2017-12-04
- Assignees: Sharp Kabushiki Kaisha
- Applicants: Sharp Kabushiki Kaisha
- Inventors: AKIHIRO KANZAKI
- Web page: https://patentgrep.com/patent/US20190172459A1

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 16/538: Presentation of query results
- G06F 16/90332: {Natural language query formulation or dialogue systems}
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L 2015/225: {Feedback of the input speech}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An external control device is realized that provides information in a format that is readily comprehended by a user. The external control device obtains related information related to audio input information that an audio input/output device has accepted, determines whether or not to include an image in response information to be provided to the user, based on contents of the obtained related information, and control is effected to display this image on a display device.

## Claims

### Claim 1

An external control device,
receiving audio input information from a user accepted by an audio input/output device,
analyzing the audio input information, and obtaining related information relating to the audio input information,
determining whether or not to include an image in response information to be provided to the user, based on contents of the obtained related information, and
in a case of determining to include the image in the response information, effecting control to display the image on a display device.

### Claim 2 (depends on 1)

The external control device according to claim 1,
wherein, in a case of having determined to include the image in the response information, part of the response information is output by audio from the audio input/output device.

### Claim 3 (depends on 1)

The external control device according to claim 1,
wherein a message inquiring of the user whether or not to display the image on the display device is output from the audio input/output device,
and wherein, in a case where the user permits display of the image on the display device, control is effected to display the image on the display device.

### Claim 4 (depends on 1)

The external control device according to claim 1,
wherein the external control device obtains the related information from an external server.

### Claim 5 (depends on 1)

A speech interactive control system, comprising:
the external control device according to claim 1;
an audio input/output device configured to accept audio input information from a user; and
a display device configured to display an image obtained by the external control device.

### Claim 6

A control method, comprising:
receiving audio input information from a user accepted by an audio input/output device;
analyzing the audio input information, and obtaining related information relating to the audio input information;
determining whether or not to include an image in response information to be provided to the user, based on contents of the obtained related information; and
in a case of determining to include the image in the response information to be provided to the user, effecting control to display the image on a display device.