# US 11,116,027 B2 · Electronic apparatus and operation method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,116,027 B2
- Document ID: US11116027B2
- Status: Granted
- Kind: B2
- Application number: 16/730,529
- Filed: 2019-12-30
- Published: 2020-05-14
- Granted: 2021-09-07
- Earliest claimed: 2019-12-23
- Assignees: LG Electronics Inc.
- Applicants: LG Electronics Inc.
- Inventors: Poram Kim; Hyunchul Choi; Inyeop Jang; Salkmann Ji; Hyunsu Choi; Sungmin You; Taegil Cho
- Web page: https://patentgrep.com/patent/US11116027B2

## CPC

- H04W 76/15: Setup of multiple wireless link connections
- G06V 20/59: inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V 40/172: {Classification, e.g. identification}
- H04W 4/48: for in-vehicle communication
- H04W 4/80: Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Provided is a method of storing information on a face of a passenger in a vehicle in association with a terminal of the passenger, and an electronic apparatus therefor. In the present disclosure, at least one of an electronic apparatus, a vehicle, a vehicle terminal, and an autonomous vehicle may be connected or converged with an artificial intelligence (AI) module, an unmanned aerial vehicle (UAV), a robot, an augmented reality (AR) device, a virtual reality (VR) device, a device associated with a 5G service, and the like.

## Claims

### Claim 1

An operation method of an electronic apparatus, the method comprising:
recognizing a face of a passenger in a vehicle through a sensor;
acquiring information on a position of the passenger and information on a position of a terminal in the vehicle;
storing, when a difference between the position of the passenger and the position of the terminal in the vehicle is within a preset distance, information on the recognized face in association with the terminal based on the acquired information;
recognizing a first terminal in the vehicle;
determining whether a first face associated with the first terminal is present among faces of one or more passengers in the vehicle, based on first face information stored in association with the first terminal; and
storing information on a second face among the faces in association with the first terminal when the first face is absent as a determination result.

### Claim 2 (depends on 1)

The operation method of claim 1, further comprising:
transmitting the information on the recognized face to one or more terminals in the vehicle; and
storing the information on the recognized face in association with a terminal among the one or more terminals, based on information input in the one or more terminals.

### Claim 3 (depends on 1)

The operation method of claim 1, further comprising:
acquiring information on a voice of the passenger; and
storing the information on the voice in association with the terminal.

### Claim 4 (depends on 1)

The operation method of claim 1, further comprising:
recognizing a third face of a third passenger;
recognizing a third terminal associated with the recognized third face based on terminal information and face information correspondingly stored in a database; and
establishing communication connection with the third terminal.

### Claim 5 (depends on 1)

The operation method of claim 1, further comprising:
recognizing faces of a plurality of passengers;
recognizing terminals respectively associated with the recognized faces based on terminal information and face information correspondingly stored in a database;
determining priorities for communication connection with the terminals; and
establishing communication connection with the terminals based on the determined priorities.

### Claim 6 (depends on 5)

The operation method of claim 5, wherein the determining of the priorities comprises:
determining priorities for communication connection with the terminals based on information on the recognized faces.

### Claim 7

An operation method of an electronic apparatus, the method comprising:
recognizing a face of a passenger in a vehicle through a sensor;
acquiring information on a position of the passenger and information on a position of a terminal in the vehicle;
storing, when a difference between the position of the passenger and the position of the terminal in the vehicle is within a preset distance, information on the recognized face in association with the terminal based on the acquired information;
establishing communication connection with a first terminal of a first passenger;
determining whether face information associated with a second terminal of a second passenger is preset passenger face information when a preset event occurs in the second terminal; and
establishing communication connection with the second terminal when the face information associated with the second terminal is the preset passenger face information as a determination result.

### Claim 8 (depends on 1)

The operation method of claim 1, further comprising:
establishing communication connection with a fourth terminal; and
allowing only a passenger having a face associated with the fourth terminal to control the fourth terminal, based on face information stored in association with the fourth terminal.

### Claim 9 (depends on 1)

A non-transitory non-volatile computer-readable recording medium comprising a computer program for performing the operation method of claim 1.

### Claim 10

An electronic apparatus comprising:
an interface configured to acquire sensing information of a face of a passenger in a vehicle from a sensor; and
a processor configured to recognize the face of the passenger based on the acquired sensing information, and store information on the recognized face in association with the terminal based on information on a position of the passenger acquired through the interface and information on a position of a terminal in the vehicle when a difference between the position of the passenger and the position of the terminal is within a preset distance,
wherein the processor is configured to:
recognize a first terminal in the vehicle;
determine whether a first face associated with the first terminal is present among faces of one or more passengers in the vehicle, based on first face information stored in association with the first terminal; and
store information on a second face among the faces in association with the first terminal when the first face is absent as a determination result.

### Claim 11 (depends on 10)

The electronic apparatus of claim 10, wherein the processor is configured to:
transmit the information on the recognized face to one or more terminals in the vehicle; and
store the information on the recognized face in association with a terminal among the one or more terminals, based on information input in the one or more terminals.

### Claim 12 (depends on 10)

The electronic apparatus of claim 10, wherein the interface is configured to acquire information on a voice of the passenger, and
the processor is configured to store the information on the voice in association with the terminal.

### Claim 13 (depends on 10)

The electronic apparatus of claim 10, wherein the processor is configured to:
recognize a third face of a third passenger;
recognize a third terminal associated with the recognized third face based on terminal information and face information correspondingly stored in a database; and
establish communication connection with the third terminal.

### Claim 14 (depends on 10)

The electronic apparatus of claim 10, wherein the processor is configured to:
recognize faces of a plurality of passengers;
recognize terminals respectively associated with the recognized faces based on terminal information and face information correspondingly stored in a database;
determine priorities for communication connection with the terminals; and
establish communication connection with the terminals based on the determined priorities.

### Claim 15 (depends on 14)

The electronic apparatus of claim 14, wherein the processor is configured to:
determine priorities for communication connection with the terminals based on information on the recognized faces.

### Claim 16 (depends on 10)

The electronic apparatus of claim 10, wherein the processor is configured to:
establish communication connection with a fourth terminal; and
allow only a passenger having a face associated with the fourth terminal to control the fourth terminal, based on face information stored in association with the fourth terminal.

### Claim 17

An electronic apparatus comprising:
an interface configured to acquire sensing information of a face of a passenger in a vehicle from a sensor; and
a processor configured to recognize the face of the passenger based on the acquired sensing information, and store information on the recognized face in association with the terminal based on information on a position of the passenger acquired through the interface and information on a position of a terminal in the vehicle when a difference between the position of the passenger and the position of the terminal is within a preset distance,
wherein the processor is configured to:
establish communication connection with a first terminal of a first passenger;
determine whether face information associated with a second terminal of a second passenger is preset passenger face information when a preset event occurs in the second terminal; and
establish communication connection with the second terminal when the face information associated with the second terminal is the preset passenger face information as a determination result.

### Claim 18

A vehicle comprising:
a sensor; and
an electronic apparatus that recognizes a face of a passenger in the vehicle based on sensing information acquired from the sensor, acquires information on a position of the passenger and information on a position of a terminal in the vehicle, and stores, when a difference between the position of the passenger and the position of the vehicle is within a preset distance, information on the recognized face in association with the terminal based on the acquired information,
wherein the electronic apparatus is configured to:
recognize a first terminal in the vehicle;
determine whether a first face associated with the first terminal is present among faces of one or more passengers in the vehicle, based on first face information stored in association with the first terminal; and
store information on a second face among the faces in association with the first terminal when the first face is absent as a determination result.