# US 2019/0244607 A1 · Method for providing vehicle ai service and device using the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0244607 A1
- Document ID: US20190244607A1
- Status: Published application
- Kind: A1
- Application number: 15/903,397
- Filed: 2018-02-23
- Published: 2019-08-08
- Earliest claimed: 2018-02-02
- Assignees: Obigo Inc.
- Applicants: Obigo Inc.
- Inventors: Ki Hyun Jo; Jung Seok Lee
- Web page: https://patentgrep.com/patent/US20190244607A1

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06N 5/04: Inference or reasoning models
- G10L 15/1815: {Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning}
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L 2015/228: {of application context}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A method for providing a vehicle AI service is provided. The method includes steps of: an AI service providing device (a) supporting an AI server to extract from a voice of a user (i) at least one of skill candidates including service categories and (ii) at least one of command candidates, to create voice analysis data, and receiving it from the AI server; and (b) (I) analyzing at least one of (i) the voice analysis data, (ii) second data created by analyzing voices of other users within a certain time, (iii) third data created by analyzing voices of the user within a particular time, and (iv) fourth data having information on context of the user, and (II) recognizing an intention included in the voice and determining a final skill and a final command matching the intention; wherein each of the data includes the skill candidates and the command candidates.

## Claims

### Claim 1

A method for providing a vehicle AI service, comprising steps of:
(a) an AI service providing device, if a voice of a specific user is acquired from a voice receiver, supporting an AI server to extract from the voice (i) at least one of skill candidates each of which includes a service category and (ii) at least one of command candidates, to thereby create voice analysis data, and receiving the voice analysis data from the AI server; and
(b) the AI service providing device (I) analyzing at least one of (i) first data including the voice analysis data, (ii) second data including real-time trend data created by analyzing voices of other users acquired within a certain time period, (iii) third data including user history data created by analyzing voices of the specific user acquired within a particular time period, and (iv) fourth data including situation data having information on context of the specific user, and then (II) recognizing an intention included in the voice of the specific user acquired at the step of (a) and determining a final skill and a final command which match the intention;
wherein each of the first data, the second data, the third data, and the fourth data includes at least one of the skill candidates and at least one of the command candidates.

### Claim 2 (depends on 1)

The method of claim 1, wherein each of m-th data {m|m∈1, 2, 3, 4} includes (i) information on each of (m-k)-th skill scores which represents an extent of the intention analyzed for each of (m-k)-th skill candidates {k|k∈1, 2, 3, . . . , kk} and (ii) information on each of (m-n)-th command scores {n|n∈1, 2, 3, . . . , nk} which represents an extent of the intention analyzed for each of (m-n)-th command candidates.

### Claim 3 (depends on 2)

The method of claim 2, wherein, at the step of (b), if a specific command candidate among the command candidates has a highest score among (1-k)-th skill scores and (1-n)-th command scores included in the first data, the AI service providing device determines the specific command candidate as the final command, and selects the final skill from at least part of the skill candidates capable of executing commands corresponding to the specific command candidate.

### Claim 4 (depends on 3)

The method of claim 3, wherein, on condition that a-th skill candidates {a|a∈1, 2, 3, . . . , ak} are among the at least part of the skill candidates capable of executing commands corresponding to the specific command candidate, the AI service providing device calculates each of a-th matching scores corresponding to the intention, for each of the a-th skill candidates by referring to an m-th weight factor which is a weight factor of the m-th data, to thereby determine a specific skill candidate with a highest score among the a-th matching scores as the final skill, wherein the a-th matching scores include respective summations of multiplications of the m-th weight factor by each skill score of the m-th data corresponding to each of the a-th skill candidates.

### Claim 5 (depends on 2)

The method of claim 2, wherein, at the step of (b), if a specific skill candidate among the skill candidates has a highest score among (1-k)-th skill scores and (1-n)-th command scores included in the first data, the AI service providing device determines the specific skill candidate as the final skill, and selects the final command from at least part of the command candidates capable of performing skills corresponding to the specific skill candidate.

### Claim 6 (depends on 5)

The method of claim 5, wherein, on condition that a-th command candidates {a|a∈1, 2, 3, . . . , ak} are among the at least part of the command candidates capable of performing skills corresponding to the specific skill candidate, the AI service providing device calculates each of a-th matching scores corresponding to the intention, for each of the a-th command candidates by referring to an m-th weight factor which is a weight factor of the m-th data, to thereby determine a specific command candidate with a highest score among the a-th matching scores as the final command, wherein the a-th matching scores include respective summations of multiplications of the m-th weight factor by each score of the m-th data corresponding to each of the a-th command candidates.

### Claim 7 (depends on 2)

The method of claim 2, wherein, at the step of (b), if a specific command candidate has a highest value among (i) values of respective multiplications of each of the (m-k)-th skill scores by an m-th weight factor which is a weight factor of the m-th data, and (ii) values of respective multiplications of each of the (m-n)-th command scores by the m-th weight factor, the AI service providing device determines the specific command candidate as the final command, and selects the final skill from at least part of the skill candidates capable of executing commands corresponding to the specific command candidate.

### Claim 8 (depends on 2)

The method of claim 2, wherein, at the step of (b), if a specific skill candidate has a highest value among (i) values of respective multiplications of each of the (m-k)-th skill scores by an m-th weight factor which is a weight factor of the m-th data, and (ii) values of respective multiplications of each of the (m-n)-th command scores by the m-th weight factor, the AI service providing device determines the specific skill candidate as the final skill, and selects the final command from at least part of the command candidates capable of performing skills corresponding to the specific skill candidate.

### Claim 9 (depends on 1)

The method of claim 1, wherein the third data includes information created by analyzing the voices of the specific user acquired within the particular time period at a particular area which includes a current location, wherein the particular time period contains at least one of (i) a certain past time window and (ii) a current time.

### Claim 10 (depends on 1)

The method of claim 1, wherein the fourth data includes at least one of (i) vehicle information on at least one of a model name of a vehicle and a type of its engine; (ii) driving information on at least one of speed of the vehicle, its transmission operating mode, and its parking state; (iii) information on at least one of a location of the vehicle, direction of the vehicle and a name of a road on which the vehicle is in operation; (iv) situation information on at least one of a current time and current weather; and (v) app information on at least one application currently being executed in a device installed in or connected with the vehicle.

### Claim 11

An AI service providing device for providing a vehicle AI service, comprising:
a communication part for receiving voice analysis data from an AI server if the AI server acquires a voice of a specific user from a voice receiver, and extract from the voice (i) at least one of skill candidates each of which includes a service category and (ii) at least one of command candidates, to thereby create the voice analysis data; and
a processor for (I) analyzing at least one of (i) first data including the voice analysis data, (ii) second data including real-time trend data created by analyzing voices of other users acquired within a certain time period, (iii) third data including user history data created by analyzing voices of the specific user acquired within a particular time period, and (iv) fourth data including situation data having information on context of the specific user, and then (II) recognizing an intention included in the voice of the specific user acquired from the communication part and determining a final skill and a final command which match the intention;
wherein each of the first data, the second data, the third data, and the fourth data includes at least one of the skill candidates and at least one of the command candidates.

### Claim 12 (depends on 11)

The AI service providing device of claim 11, wherein each of m-th data {m|m∈1, 2, 3, 4} includes (i) information on each of (m-k)-th skill scores which represents an extent of the intention analyzed for each of (m-k)-th skill candidates {k|k∈1, 2, 3, . . . , kk} and (ii) information on each of (m-n)-th command scores {n|n∈1, 2, 3, . . . , nk} which represents an extent of the intention analyzed for each of (m-n)-th command candidates.

### Claim 13 (depends on 12)

The AI service providing device of claim 12, wherein, if a specific command candidate among the command candidates has a highest score among (1-k)-th skill scores and (1-n)-th command scores included in the first data, the processor determines the specific command candidate as the final command, and selects the final skill from at least part of the skill candidates capable of executing commands corresponding to the specific command candidate.

### Claim 14 (depends on 13)

The AI service providing device of claim 13, wherein, on condition that a-th skill candidates {a|a∈1, 2, 3, . . . , ak} are among the at least part of the skill candidates capable of executing commands corresponding to the specific command candidate, the processor calculates each of a-th matching scores corresponding to the intention, for each of the a-th skill candidates by referring to an m-th weight factor which is a weight factor of the m-th data, to thereby determine a specific skill candidate with a highest score among the a-th matching scores as the final skill, wherein the a-th matching scores include respective summations of multiplications of the m-th weight factor by each skill score of the m-th data corresponding to each of the a-th skill candidates.

### Claim 15 (depends on 12)

The AI service providing device of claim 12, wherein, if a specific skill candidate among the skill candidates has a highest score among (1-k)-th skill scores and (1-n)-th command scores included in the first data, the processor determines the specific skill candidate as the final skill, and selects the final command from at least part of the command candidates capable of performing skills corresponding to the specific skill candidate.

### Claim 16 (depends on 15)

The AI service providing device of claim 15, wherein, on condition that a-th command candidates {a|a∈1, 2, 3, . . . , ak} are among the at least part of the command candidates capable of performing skills corresponding to the specific skill candidate, the processor calculates each of a-th matching scores corresponding to the intention, for each of the a-th command candidates by referring to an m-th weight factor which is a weight factor of the m-th data, to thereby determine a specific command candidate with a highest score among the a-th matching scores as the final command, wherein the a-th matching scores include respective summations of multiplications of the m-th weight factor by each score of the m-th data corresponding to each of the a-th command candidates.

### Claim 17 (depends on 2)

The AI service providing device of claim 2, wherein, if a specific command candidate has a highest value among (i) values of respective multiplications of each of the (m-k)-th skill scores by an m-th weight factor which is a weight factor of the m-th data, and (ii) values of respective multiplications of each of the (m-n)-th command scores by the m-th weight factor, the processor determines the specific command candidate as the final command, and selects the final skill from at least part of the skill candidates capable of executing commands corresponding to the specific command candidate.

### Claim 18 (depends on 12)

The AI service providing device of claim 12, wherein, if a specific skill candidate has a highest value among (i) values of respective multiplications of each of the (m-k)-th skill scores by an m-th weight factor which is a weight factor of the m-th data, and (ii) values of respective multiplications of each of the (m-n)-th command scores by the m-th weight factor, the processor determines the specific skill candidate as the final skill, and selects the final command from at least part of the command candidates capable of performing skills corresponding to the specific skill candidate.

### Claim 19 (depends on 11)

The AI service providing device of claim 11, wherein the third data includes information created by analyzing the voices of the specific user acquired within the particular time period at a particular area which includes a current location, wherein the particular time period contains at least one of (i) a certain past time window and (ii) a current time.

### Claim 20 (depends on 11)

The AI service providing device of claim 11, wherein the fourth data includes at least one of (i) vehicle information on at least one of a model name of a vehicle and a type of its engine; (ii) driving information on at least one of speed of the vehicle, its transmission operating mode, and its parking state; (iii) information on at least one of a location of the vehicle, direction of the vehicle and a name of a road on which the vehicle is in operation; (iv) situation information on at least one of a current time and current weather; and (v) app information on at least one application currently being executed in a device installed in or connected with the vehicle.
