# US 2024/0203447 A1 · Information processing device and non-transitory computer-readable medium storing information processing program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0203447 A1
- Document ID: US20240203447A1
- Status: Published application
- Kind: A1
- Application number: 18/522,672
- Filed: 2023-11-29
- Published: 2024-06-20
- Earliest claimed: 2022-12-20
- Assignees: Toyota Jidosha Kabushiki Kaisha
- Applicants: Toyota Jidosha Kabushiki Kaisha
- Inventors: Ryosuke TACHIBANA
- Web page: https://patentgrep.com/patent/US20240203447A1

## CPC

- G10L 25/63: for estimating an emotional state
- G10L 25/27: characterised by the analysis technique
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

An information processing device including: a memory; and a processor coupled to the memory, the processor being configured to: acquire one piece of audio data of a user, extract plural pieces of audio data that have been extracted during a predetermined time period from the one piece of audio data, the plural pieces of audio data being extracted by moving the time period by a predetermined unit time, estimate respective feature amounts indicating an emotion of the user from each of the plural pieces of audio data, by using an estimation model obtained by executing machine learning for estimating feature amounts indicating an emotion of the user from the plural pieces of audio data that have been extracted, and determine the emotion of the user indicated by the one piece of audio data, by using the respective feature amounts corresponding to the plural pieces of audio data.

## Claims

### Claim 1

An information processing device comprising:
a memory; and
a processor coupled to the memory, the processor being configured to:
acquire one piece of audio data of a user,
extract a plurality of pieces of audio data that have been extracted during a predetermined time period from the one piece of audio data, the plurality of pieces of audio data being extracted by moving the time period by a predetermined unit time,
estimate respective feature amounts indicating an emotion of the user from each of the plurality of pieces of audio data, by using an estimation model obtained by executing machine learning for estimating feature amounts indicating an emotion of the user from the plurality of pieces of audio data that have been extracted, and
determine the emotion of the user indicated by the one piece of audio data, by using the respective feature amounts corresponding to the plurality of pieces of audio data.

### Claim 2 (depends on 1)

The information processing device according to claim 1, wherein the predetermined time period is set according to, in the one piece of audio data that has been previously acquired:
feature amounts indicating an emotion that corresponds to an emotion of the user that has been set as a label of the one piece of audio data, and
feature amounts indicating an emotion that is different from the emotion of the user that has been set as the label of the one piece of audio data.

### Claim 3 (depends on 1)

The information processing device according to claim 1, wherein the processor is configured to extract the plurality of pieces of audio data by setting the unit time, such that a number of pieces of the audio data extracted from the one piece of audio data is a predetermined number.

### Claim 4 (depends on 1)

The information processing device according to claim 1, wherein the processor is configured to:
estimate the respective feature amounts indicating the emotion of the user, using, as the estimation model, an individual user estimation model obtained by learning one piece of audio data for each individual user among a plurality of users, and an overall user estimation model obtained by learning one piece of audio data related to all of the plurality of users, and
determine the emotion of the user indicated by the one piece of audio data, using feature amounts that have respectively been estimated by the individual user estimation model and the overall user estimation model.

### Claim 5

A non-transitory computer-readable medium storing an information processing program that is executable by a computer to perform processing comprising:
acquiring one piece of audio data of a user,
extracting a plurality of pieces of audio data that have been extracted during a predetermined time period from the one piece of audio data, the plurality of pieces of audio data being extracted by moving the time period by a predetermined unit time,
estimate respective feature amounts indicating an emotion of the user from each of the plurality of pieces of audio data, by using an estimation model obtained by executing machine learning for estimating feature amounts indicating an emotion of the user from the plurality of pieces of audio data that have been extracted, and
determine the emotion of the user indicated by the one piece of audio data, by using the respective feature amounts corresponding to the plurality of pieces of audio data.
