# US 2022/0020369 A1 · Information processing device, information processing system, and information processing method, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0020369 A1
- Document ID: US20220020369A1
- Status: Published application
- Kind: A1
- Application number: 17/309,555
- Filed: 2019-10-10
- Published: 2022-01-20
- Earliest claimed: 2018-12-13
- Assignees: Sony Group Corporation
- Applicants: Sony Group Corporation
- Inventors: CHIAKI MIYAZAKI; JURI YAEDA; SAKI YOKOYAMA
- Web page: https://patentgrep.com/patent/US20220020369A1

## CPC

- G10L 13/027: Concept to speech synthesisers; Generation of natural phrases from machine-based concepts (generation of parameters for speech synthesis out of text G10L13/08)
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G06F 40/289: Phrasal analysis, e.g. finite state techniques or chunking
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A device and a method that determine an utterance type of a user utterance and generate a system response according to a determination result are achieved. A user utterance type determination unit that determines an utterance type of a user utterance, and a system response generation unit that generates a system response according to a type determination result determined by the user utterance type determination unit are included. The user utterance type determination unit determines whether the user utterance is of type A that requests all reutterances of a system utterance immediately before the user utterance, or type B that requests a reutterance of a part of the system utterance immediately before the user utterance. The system response generation unit generates a system response to reutter all system utterances immediately before the user utterance in a case where the user utterance is of type A, and generates a system response to reutter a part of system utterances immediately before the user utterance in a case where the user utterance is of type B.

## Claims

### Claim 1

An information processing device comprising:
a user utterance type determination unit that determines an utterance type of a user utterance; and
a system response generation unit that generates a system response according to a type determination result determined by the user utterance type determination unit,
wherein the user utterance type determination unit determines which type of type A or type B below the user utterance is,
(Type A) user utterance that requests all reutterances of a system utterance immediately before the user utterance,
(Type B) user utterance that requests a reutterance of a part of the system utterance immediately before the user utterance,
the system response generation unit
generates a system response to reutter all system utterances immediately before the user utterance in a case where the user utterance is of type A, and
generates a system response to reutter a part of system utterances immediately before the user utterance in a case where the user utterance is of type B.

### Claim 2 (depends on 1)

The information processing device according to claim 1, wherein
the user utterance type determination unit further determines
whether or not the user utterance is
(Type C) User utterance asking general knowledge, and
the system response generation unit generates a system response including an answer to a question of the user utterance in a case where the user utterance is of type C.

### Claim 3 (depends on 1)

The information processing device according to claim 1, wherein
the user utterance type determination unit further determines
whether or not the user utterance is
(Other type) user utterance of task request type,
the system response generation unit
generates a system response as a result of executing a requested task of the user utterance in a case where the user utterance is of the other type.

### Claim 4 (depends on 1)

The information processing device according to claim 1, wherein
the user utterance type determination unit,
in a case where the user utterance is determined to be
(Type B) user utterance that requests a reutterance of a part of the system utterance immediately before the user utterance,
further determines which type of type B1, B2, or B3 below the user utterance is,
(Type B1) user utterance requesting a reutterance of a specified position part of the system utterance,
(Type B2) user utterance requesting a reutterance of a specified time-series part of the system utterance, or
(Type B3) user utterance requesting a partial reutterance other than the B1 and B2 described above.

### Claim 5 (depends on 4)

The information processing device according to claim 4, wherein
the system response generation unit,
in a case where the user utterance is of type B1,
analyzes a user utterance text, which is a voice recognition result of the user utterance, and selects a reutterance part of the system utterance.

### Claim 6 (depends on 5)

The information processing device according to claim 5, wherein
the label is a label that makes it possible to identify a phrase immediately before or immediately after the reutterance part to be selected from the system utterance.

### Claim 7 (depends on 4)

The information processing device according to claim 4, wherein
the system response generation unit,
in a case where the user utterance is of type B2,
analyzes a user utterance text, which is a voice recognition result of the user utterance,
extracts a reference event to be a time-series reference, further determines a time-series direction of whether the reutterance request event is in past or future of the reference event, and
selects a reutterance part of the system utterance on a basis of the reference event and the time-series direction.

### Claim 8 (depends on 7)

The information processing device according to claim 7, wherein
the system response generation unit,
in a case where it is determined that the reutterance request event is in the past of the reference event,
selects, as the reutterance part, a phrase that includes an event that occurs or has occurred before the reference event from the system utterance.

### Claim 9 (depends on 7)

The information processing device according to claim 7, wherein
the system response generation unit,
in a case where it is determined that the reutterance request event is the future of the reference event,
selects, as the reutterance part, a phrase that includes an event that occurs or has occurred after the reference event from the system utterance.

### Claim 10

An information processing system comprising a user terminal and a data processing server,
wherein the user terminal has:
a voice input unit that inputs a user utterance; and
a communication unit that transmits the input user utterance to the data processing server,
the data processing server has:
a user utterance type determination unit that determines an utterance type of the user utterance received from the user terminal; and
a system response generation unit that generates a system response according to a type determination result determined by the user utterance type determination unit, and
the user utterance type determination unit determines which type of type A or type B below the user utterance is,
(Type A) user utterance that requests all reutterances of a system utterance immediately before the user utterance,
(Type B) user utterance that requests a reutterance of a part of the system utterance immediately before the user utterance,
the system response generation unit
generates a system response to reutter all system utterances immediately before the user utterance in a case where the user utterance is of type A, and
generates a system response to reutter a part of system utterances immediately before the user utterance in a case where the user utterance is of type B.

### Claim 11

An information processing method executed in an information processing device, the method comprising:
a user utterance type determination step in which a user utterance type determination unit determines an utterance type of a user utterance; and
a system response generation step in which a system response generation unit generates a system response according to a type determination result in the user utterance type determination step,
wherein the user utterance type determination step determines which type of type A or type B below the user utterance is,
(Type A) user utterance that requests all reutterances of a system utterance immediately before the user utterance,
(Type B) user utterance that requests a reutterance of a part of the system utterance immediately before the user utterance,
the system response generation step
generates a system response to reutter all system utterances immediately before the user utterance in a case where the user utterance is of type A, and
generates a system response to reutter a part of system utterances immediately before the user utterance in a case where the user utterance is of type B.

### Claim 12

An information processing method executed in an information processing system including a user terminal and a data processing server,
wherein the user terminal
inputs a user utterance via a voice input unit and transmits the user utterance to the data processing server,
the data processing server executes
a user utterance type determination process that determines an utterance type of the user utterance received from the user terminal, and
a system response generation process that generates a system response according to a type determination result determined by the user utterance type determination unit,
the user utterance type determination process determines which type of type A or type B below the user utterance is,
(Type A) user utterance that requests all reutterances of a system utterance immediately before the user utterance,
(Type B) user utterance that requests a reutterance of a part of the system utterance immediately before the user utterance,
the system response generation process
generates a system response to reutter all system utterances immediately before the user utterance in a case where the user utterance is of type A, and
generates a system response to reutter a part of system utterances immediately before the user utterance in a case where the user utterance is of type B.

### Claim 13

A program that causes an information processing device to execute information processing comprising:
a user utterance type determination step of causing a user utterance type determination unit to determine an utterance type of a user utterance; and
a system response generation step of causing a system response generation unit to generate a system response according to a type determination result in the user utterance type determination step,
wherein the user utterance type determination step performs a process to determine which type of type A or type B below the user utterance is,
(Type A) user utterance that requests all reutterances of a system utterance immediately before the user utterance,
(Type B) user utterance that requests a reutterance of a part of the system utterance immediately before the user utterance,
the system response generation step performs a process to
generate a system response to reutter all system utterances immediately before the user utterance in a case where the user utterance is of type A, and
generate a system response to reutter a part of system utterances immediately before the user utterance in a case where the user utterance is of type B.
