# US 2021/0334640 A1 · Artificial intelligence server and method for providing information to user

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0334640 A1
- Document ID: US20210334640A1
- Status: Published application
- Kind: A1
- Application number: 16/493,848
- Filed: 2019-08-13
- Published: 2021-10-28
- Earliest claimed: 2019-08-13
- Assignees: LG Electronics Inc.
- Applicants: LG Electronics Inc.
- Inventors: Sihyuk YI; Wonyoung LEE
- Web page: https://patentgrep.com/patent/US20210334640A1

## CPC

- B25J 11/0005: {Manipulators having means for high-level communication with users, e.g. speech generator, face recognition means}
- G06N 3/08: Learning methods
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06N 3/0499: Feedforward networks
- G06N 3/09: Supervised learning
- G10L 15/16: using artificial neural networks
- G10L 15/18: using natural language modelling
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- B25J 9/163: {learning, adaptive, model based, rule based expert control}
- G05D 1/0221: {involving a learning process}
- G06F 40/30: Semantic analysis
- G10L 2015/223: {Execution procedure of a spoken command}
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES

## Abstract

In an artificial intelligence server for providing information to a user, the artificial intelligence server includes a communication unit configured to communicate with a plurality of artificial intelligence apparatuses deployed in a service area and a processor configured to receive at least one of speech data of the user or terminal usage information of the user from at least one of the plurality of artificial intelligence apparatuses, generate intention information of the user based on at least one of the received speech data or the received terminal usage information, generate status information of the user using the plurality of artificial intelligence apparatuses, determine an information providing device among the plurality of artificial intelligence apparatuses based on the generated status information of the user, generate output information to be outputted from the determined information providing device, and transmit a control signal for outputting the generated output information to the determined information providing device.

## Claims

### Claim 1

An artificial intelligence server for providing information to a user, the artificial intelligence server comprising:
a communication unit configured to communicate with a plurality of artificial intelligence apparatuses deployed in a service area; and
a processor configured to:
receive at least one of speech data of the user or terminal usage information of the user from at least one of the plurality of artificial intelligence apparatuses,
generate intention information of the user based on at least one of the received speech data or the received terminal usage information,
generate status information of the user using the plurality of artificial intelligence apparatuses,
determine an information providing device among the plurality of artificial intelligence apparatuses based on the generated status information of the user,
generate output information to be outputted from the determined information providing device, and
transmit a control signal for outputting the generated output information to the determined information providing device.

### Claim 2 (depends on 1)

The artificial intelligence server of claim 1, wherein the terminal usage information comprises a usage record of the user for the artificial intelligence apparatus and user identification information identifying the user.

### Claim 3 (depends on 1)

The artificial intelligence server of claim 1, wherein the processor is configured to generate the intention information from the received speech data using a natural language processing (NLP) technique.

### Claim 4 (depends on 1)

The artificial intelligence server of claim 1, wherein the processor is configured to generate the intention information from the received terminal usage record using an intention information generation model, and
wherein the intention information generation model comprises an artificial neural network and is learned by using a machine learning algorithm or a deep learning algorithm.

### Claim 5 (depends on 1)

The artificial intelligence server of claim 1, wherein the status information comprises at least one of a location of the user, a route of the user, a moving direction of the user, a gaze direction of the user, or a motion of the user.

### Claim 6 (depends on 5)

The artificial intelligence server of claim 5, wherein the processor is configured to:
receive speech data on the user, image data on the user, or terminal status information on the user from the plurality of artificial intelligence apparatuses, and
generate the status information based on at least one of the received speech data, the received image data, or the received terminal status information.

### Claim 7 (depends on 6)

The artificial intelligence server of claim 6, wherein the processor is configured to:
recognize the user from the received image data using a user recognition model, and
generate the status information using the recognition result,
wherein the user recognition model comprises an artificial neural network and is learned by using a machine learning algorithm or a deep learning algorithm.

### Claim 8 (depends on 5)

The artificial intelligence server of claim 5, wherein the processor is configured to:
receive user recognition information generated for the user from the plurality of artificial intelligence apparatuses, and
generate the status information by using the received user recognition information.

### Claim 9 (depends on 5)

The artificial intelligence server of claim 5, wherein the processor is configured to determine, as the information providing device, a device located within a first reference distance from the user among the plurality of artificial intelligence apparatuses.

### Claim 10 (depends on 9)

The artificial intelligence server of claim 9, wherein the processor is configured to determine, as the information providing device, a device located within a predetermined angle from the gazing direction of the user and located within a second reference distance from the user among the plurality of artificial intelligence apparatuses.

### Claim 11 (depends on 1)

The artificial intelligence server of claim 1, wherein the processor is configured to:
update at least one of the intention information or the status information periodically or in real time, and
update at least one of the information providing device or the output information when at least one of the intention information or the status information is changed.

### Claim 12

A method of providing information to a user, the method comprising:
receiving at least one of speech data of the user or terminal usage information of the user from at least one of a plurality of artificial intelligence apparatuses deployed in a service area,
generating intention information of the user based on at least one of the received speech data or the received terminal usage information,
generating status information of the user using the plurality of artificial intelligence apparatuses,
determining an information providing device among the plurality of artificial intelligence apparatuses based on the generated status information of the user,
generating output information to be outputted from the determined information providing device, and
transmitting a control signal for outputting the generated output information to the determined information providing device.

### Claim 13

A recording medium having recorded thereon a program for performing a method for providing information to a user,
wherein the method of providing information to the user comprises:
receiving at least one of speech data of the user or terminal usage information of the user from at least one of a plurality of artificial intelligence apparatuses deployed in a service area,
generating intention information of the user based on at least one of the received speech data or the received terminal usage information,
generating status information of the user using the plurality of artificial intelligence apparatuses,
determining an information providing device among the plurality of artificial intelligence apparatuses based on the generated status information of the user,
generating output information to be outputted from the determined information providing device, and
transmitting a control signal for outputting the generated output information to the determined information providing device.
