# US 2021/0233538 A1 · Agent system, terminal device, and computer readable recording medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0233538 A1
- Document ID: US20210233538A1
- Status: Published application
- Kind: A1
- Application number: 17/101,492
- Filed: 2020-11-23
- Published: 2021-07-29
- Earliest claimed: 2020-01-23
- Assignees: Toyota Jidosha Kabushiki Kaisha
- Applicants: Toyota Jidosha Kabushiki Kaisha
- Inventors: Kohki TAKESHITA
- Web page: https://patentgrep.com/patent/US20210233538A1

## CPC

- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G10L 17/06: Decision making techniques; Pattern matching strategies
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

An agent system includes: a terminal device including a first processor including hardware, the first processor being configured to recognize spoken voice of a user, determine to which speech interaction agent among a plurality of speech interaction agents an instruction included in the spoken voice of the user is directed, and transfer the spoken voice of the user to an agent server configured to realize a function of the determined speech interaction agent; and an agent server including a second processor including hardware, the second processor being configured to recognize the spoken voice of the user which voice is transferred from the terminal device, and output a result of the recognition to the terminal device.

## Claims

### Claim 1

An agent system comprising:
a terminal device comprising
a first processor comprising hardware, the first processor being configured to
recognize spoken voice of a user,
determine to which speech interaction agent among a plurality of speech interaction agents an instruction included in the spoken voice of the user is directed, and
transfer the spoken voice of the user to an agent server configured to realize a function of the determined speech interaction agent; and
an agent server comprising
a second processor comprising hardware, the second processor being configured to
recognize the spoken voice of the user which voice is transferred from the terminal device, and
output a result of the recognition to the terminal device.

### Claim 2 (depends on 1)

The agent system according to claim 1, wherein the second processor is configured to:
recognize the spoken voice of the user which voice is transferred from the terminal device;
perform processing based on a result of the recognition; and
output response data related to the processing to the terminal device.

### Claim 3 (depends on 1)

The agent system according to claim 1, wherein
the first processor is configured to output a recognition result of the spoken voice of the user to the agent server instead of the spoken voice of the user, and
the second processor is configured to
perform processing based on the recognition result of the spoken voice of the user which result is transferred from the terminal device, and
output response data related to the processing to the terminal device.

### Claim 4 (depends on 1)

The agent system according to claim 1, wherein
the terminal device includes a display, and
the first processor is configured to cause, when the determining to which speech interaction agent among the plurality of speech interaction agents the instruction included in the spoken voice of the user is directed, the display to display a name of the determined speech interaction agent.

### Claim 5 (depends on 3)

The agent system according to claim 3, wherein the second processor is configured to:
accumulate interaction contents of the user as preference information of the user in a storage unit, and
perform, when performing the processing based on the recognition result of the spoken voice of the user which result is transferred from the terminal device, processing in consideration of the preference information of the user.

### Claim 6 (depends on 1)

The agent system according to claim 1, wherein the first processor is configured to:
convert the spoken voice of the user into text data; and
determines, in a case where a phrase identifying a speech interaction agent is included in the text data, the instruction is for the speech interaction agent.

### Claim 7 (depends on 1)

The agent system according to claim 1, wherein the spoken voice of the user includes a phrase identifying a speech interaction agent, and an instruction for the speech interaction agent.

### Claim 8 (depends on 7)

The agent system according to claim 7, wherein the terminal device includes a button pressed by the user in speaking.

### Claim 9 (depends on 1)

The agent system according to claim 1, wherein the terminal device is an in-vehicle device mounted on a vehicle.

### Claim 10 (depends on 1)

The agent system according to claim 1, wherein the terminal device is an information terminal device owned by the user.

### Claim 11

A terminal device comprising a processor comprising hardware, wherein the processor is configured to:
recognize spoken voice of a user, determines to which speech interaction agent among a plurality of speech interaction agents an instruction included in the spoken voice of the user is directed;
transfer the spoken voice of the user to an agent server that realizes a function of the determined speech interaction agent; and
acquire a recognition result of the spoken voice of the user from the agent server.

### Claim 12 (depends on 11)

The terminal device according to claim 11, wherein the processor is configured to:
output a recognition result of the spoken voice of the user to the agent server instead of the spoken voice of the user; and
acquire response data related to processing based on the recognition result of the spoken voice of the user from the agent server.

### Claim 13 (depends on 11)

The terminal device according to claim 11, further comprising a display, wherein
the processor is configured to cause, when determining to which speech interaction agent among the plurality of speech interaction agents the instruction included in the spoken voice of the user is directed, the display to display a name of the determined speech interaction agent.

### Claim 14 (depends on 11)

The terminal device according to claim 11, wherein the processor is configured to:
convert the spoken voice of the user into text data; and
determine, in a case where a phrase identifying a speech interaction agent is included in the text data, the instruction is for the speech interaction agent.

### Claim 15 (depends on 11)

The terminal device according to claim 11, wherein the spoken voice of the user includes a phrase identifying a speech interaction agent, and an instruction for the speech interaction agent.

### Claim 16 (depends on 15)

The terminal device according to claim 15, further comprising a button pressed by the user in speaking.

### Claim 17 (depends on 11)

The terminal device according to claim 11, wherein the terminal device is an in-vehicle device mounted on a vehicle.

### Claim 18 (depends on 11)

The terminal device according to claim 11, wherein the terminal device is an information terminal device owned by the user.

### Claim 19

A non-transitory computer-readable recording medium on which an executable program is recorded, the program causing a processor of a computer to execute:
recognizing spoken voice of a user, determining to which speech interaction agent among a plurality of speech interaction agents an instruction included in the spoken voice of the user is directed; and
transferring the spoken voice of the user to an agent server that realizes a function of the determined speech interaction agent.

### Claim 20 (depends on 19)

The non-transitory computer-readable recording medium according to claim 19, wherein the program causes the processor to execute
outputting a recognition result of the spoken voice of the user to the agent server instead of the spoken voice of the user; and
acquiring response data related to processing based on the recognition result of the spoken voice of the user from the agent server.
