# US 12,014,735 B2 · Emotion adjustment system and emotion adjustment method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,014,735 B2
- Document ID: US12014735B2
- Status: Granted
- Kind: B2
- Application number: 17/390,119
- Filed: 2021-07-30
- Published: 2022-05-12
- Granted: 2024-06-18
- Earliest claimed: 2020-11-06
- Assignees: Hyundai Motor Company; Kia Corporation
- Applicants: Hyundai Motor Company; Kia Corporation
- Inventors: Ki Chang Kim; Dong Chul Park; Tae Kun Yun; Jin Sung Lee
- Web page: https://patentgrep.com/patent/US12014735B2

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- A61B 5/165: {Evaluating the state of mind, e.g. depression, anxiety}
- A61B 5/4803: {Speech analysis specially adapted for diagnostic purposes}
- G10L 25/63: for estimating an emotional state
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)

## Abstract

An emotion adjustment system for determining a user's emotions based on a user's voice includes: a microphone configured to receive the user's voice; a controller configured to extract a plurality of sound quality factors in response to processing the user's voice, calculate a depression index of the user based on at least one sound quality factor among the plurality of sound quality factors, identify an emotional state of the user as a depressive state when the depression index is a preset value or more, determine the depressive state as a first state or a second state based on a correlation between at least two sound quality factors among the plurality of sound quality factors, and transmit a control command corresponding to the emotional state of the user identified as the first state or the second state; and a feedback device configured to perform an operation corresponding to the control command.

## Claims

### Claim 1

An emotion adjustment system, comprising:
a microphone configured to receive a user's voice;
a controller configured to extract a plurality of sound quality factors in response to processing the user's voice, calculate a depression index of the user based on at least one sound quality factor among the plurality of sound quality factors, identify an emotional state of the user as a depressive state when the depression index is a preset value or more, determine the depressive state as a first state or a second state based on a correlation between at least two sound quality factors among the plurality of sound quality factors, and transmit a control command corresponding to the emotional state of the user identified as the first state or the second state; and
a feedback device configured to perform an operation corresponding to the control command,
wherein the plurality of sound quality factors comprises a sharpness, a roughness, and a fluctuation strength,
wherein the controller is configured to calculate a noise index of the user's voice based on a correlation between the sharpness, the roughness, and the fluctuation strength, and determine the depressive state as the first state or the second state based on the noise index,
wherein the noise index comprises a rattle index and a squeak index, and
wherein the controller is configured to determine the depressive state as the first state or the second state based on a ratio between the rattle index and the squeak index.

### Claim 2 (depends on 1)

The emotion adjustment system of claim 1, wherein the plurality of sound quality factors further comprise at least one of a sound pressure level or a loudness.

### Claim 3 (depends on 2)

The emotion adjustment system of claim 2, wherein the controller is configured to calculate the depression index of the user based on at least one of the sound pressure level or the loudness.

### Claim 4 (depends on 3)

The emotion adjustment system of claim 3, wherein the controller is configured to calculate the depression index of the user based on a change pattern of the sound pressure level or the loudness.

### Claim 5 (depends on 1)

The emotion adjustment system of claim 1, wherein the controller is configured to determine the depressive state as the first state when the rattle index is greater than the squeak index, and determine the depressive state as the second state when the squeak index is greater than the rattle index.

### Claim 6 (depends on 5)

The emotion adjustment system of claim 5, wherein the feedback device comprises a vibrating element, and
the controller is configured to transmit a first control command to cause the vibrating element to vibrate at a first frequency and a first intensity when the emotional state of the user is identified as the first state and transmit a second control command to cause the vibrating element to vibrate at a second frequency and a second intensity when the emotional state of the user is identified as the second state, and
the first frequency is less than the second frequency and the first intensity is less than the second intensity.

### Claim 7 (depends on 5)

The emotion adjustment system of claim 5, wherein the feedback device comprises a speaker, and
the controller is configured to transmit a first control command to cause the speaker to play a first sound source when the emotional state of the user is identified as the first state and transmit a second control command to cause the speaker to play a second sound source when the emotional state of the user is identified as the second state, and
a frequency band of the first sound source is narrower than a frequency band of the second sound source.

### Claim 8 (depends on 1)

The emotion adjustment system of claim 1, wherein the controller is configured to identify the emotional state of the user as an instable state or a pleasant state when the depression index is less than the preset value, and transmit a control command corresponding to the emotional state of the user identified as the instable state or the pleasant state.

### Claim 9

An emotion adjustment method, comprising:
receiving, by a microphone, a user's voice;
extracting, by a controller, a plurality of sound quality factors in response to processing the user's voice;
calculating, by the controller, a depression index of the user based on at least one sound quality factor among the plurality of sound quality factors;
identifying, by the controller, an emotional state of the user as a depressive state when the depression index is a preset value or more;
determining, by the controller, the depressive state as a first state or a second state based on a correlation between at least two sound quality factors among the plurality of sound quality factors;
transmitting, by the controller, a control command corresponding to the emotional state of the user identified as the first state or the second state; and
performing, by a feedback device, an operation corresponding to the control command,
wherein the plurality of sound quality factors comprises a sharpness, a roughness, and a fluctuation strength,
wherein determining the depressive state as the first state or the second state comprises:
calculating a noise index of the user's voice based on a correlation between the sharpness, the roughness, and the fluctuation strength; and
determining the depressive state as the first state or the second state based on the noise index,
wherein the noise index comprises a rattle index and a squeak index, and
wherein determining the depressive state as the first state or the second state based on the noise index comprises:
determining the depressive state as the first state or the second state based on a ratio between the rattle index and the squeak index.

### Claim 10 (depends on 9)

The emotion adjustment method of claim 9, wherein the plurality of sound quality factors comprise at least one of a sound pressure level or a loudness.

### Claim 11 (depends on 10)

The emotion adjustment method of claim 10, wherein calculating the depression index of the user comprises:
calculating the depression index of the user based on at least one of the sound pressure level or the loudness.

### Claim 12 (depends on 11)

The emotion adjustment method of claim 11, wherein calculating the depression index of the user comprises:
calculating the depression index of the user based on a change pattern of the sound pressure level or the loudness.

### Claim 13 (depends on 9)

The emotion adjustment method of claim 9, wherein determining the depressive state as the first state or the second state based on the ratio between the rattle index and the squeak index comprises:
determining the depressive state as the first state when the rattle index is greater than the squeak index, and determining the depressive state as the second state when the squeak index is greater than the rattle index.

### Claim 14 (depends on 13)

The emotion adjustment method of claim 13, wherein the feedback device comprises a vibrating element, and
wherein the transmitting the control command corresponding to the emotional state of the user identified as the first state or the second state comprises:
transmitting a first control command to cause the vibrating element to vibrate at a first frequency and a first intensity when the emotional state of the user is identified as the first state; and
transmitting a second control command to cause the vibrating element to vibrate at a second frequency and a second intensity when the emotional state of the user is identified as the second state, and
the first frequency is less than the second frequency and the first intensity is less than the second intensity.

### Claim 15 (depends on 13)

The emotion adjustment method of claim 13, wherein the feedback device comprises a speaker, and wherein transmitting the control command corresponding to the emotional state of the user identified as the first state or the second state comprises:
transmitting a first control command to cause the speaker to play a first sound source when the emotional state of the user is identified as the first state; and
transmitting a second control command to cause the speaker to play a second sound source when the emotional state of the user is identified as the second state, and
a frequency band of the first sound source is narrower than a frequency band of the second sound source.

### Claim 16 (depends on 9)

The emotion adjustment method of claim 9, further comprising:
identifying the emotional state of the user as an instable state or a pleasant state when the depression index is less than the preset value; and
transmitting a control command corresponding to the emotional state of the user identified as the instable state or the pleasant state.