# US 2021/0334562 A1 · Vehicle control device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0334562 A1
- Document ID: US20210334562A1
- Status: Published application
- Kind: A1
- Application number: 16/486,074
- Filed: 2019-03-15
- Published: 2021-10-28
- Earliest claimed: 2019-03-15
- Assignees: LG Electronics Inc.
- Applicants: LG Electronics Inc.
- Inventors: Minsick PARK
- Web page: https://patentgrep.com/patent/US20210334562A1

## CPC

- G06V 20/593: {Recognising seat occupancy}
- B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
- B60R 16/037: for occupant comfort {, e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel}
- B60R 21/015: including means for detecting the presence or position of passengers, passenger seats or child seats {, and the related safety parameters therefor, e.g. speed or timing of airbag inflation in relation to occupant position or seat belt use}
- B60W 30/14: {Adaptive} cruise control
- B60W 40/08: related to drivers or passengers
- B60W 50/00: Details of control systems for road vehicle drive control not related to the control of a particular sub-unit {, e.g. process diagnostic or vehicle driver interfaces}
- B60W 50/08: Interaction between the driver and the control system
- G06F 3/01: Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence)
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06V 20/597: {Recognising the driver's state or behaviour, e.g. attention or drowsiness}
- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)}
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 2015/223: {Execution procedure of a spoken command}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A vehicle control device is disclosed. The vehicle control device includes: an interface unit that is connected to a camera for capturing a vehicle passenger and to a plurality of devices installed inside the vehicle; and a processor that receives an image captured by the camera through the interface unit and exchanges information with the plurality of devices through the interface unit, wherein the processor detects the position of the passenger from the image acquired by the camera, configures a space adjacent to the passenger as a virtual control space, matches a device corresponding to the position of the passenger, among the plurality of devices, to the virtual control device, and, upon detecting a preset gesture through the virtual control space, controls the device based on the preset gesture.

## Claims

### Claim 1

A vehicle control device comprising:
an interface unit that is connected to a camera for capturing a vehicle passenger and to a plurality of devices installed inside the vehicle; and
a processor that receives an image captured by the camera through the interface unit and exchanges information with the plurality of devices through the interface unit,
wherein the processor detects the position of the passenger from the image acquired by the camera, configures a space adjacent to the passenger as a virtual control space, matches a device corresponding to the position of the passenger, among the plurality of devices, to the virtual control device, and, upon detecting a preset gesture through the virtual control space, controls the device based on the preset gesture.

### Claim 2 (depends on 1)

The vehicle control device of claim 1, wherein the passenger is positioned in a driver's seat, and a plurality of devices corresponding to the position of the passenger are provided in front of the passenger,
wherein the interface unit is connected to a voice recognition unit installed inside the vehicle, and the processor receives the passenger's voice recognized by the voice recognition unit through the interface unit, selects one device corresponding to the position of the passenger from among the plurality of devices based on the passenger's voice, and matches the selected device to the virtual control space.

### Claim 3 (depends on 2)

The vehicle control device of claim 2, wherein the interface unit is connected to a button provided inside the vehicle, and the processor activates the voice recognition unit upon receiving an input into the button through the interface unit.

### Claim 4 (depends on 2)

The vehicle control device of claim 2, wherein, if the preset gesture is not detected from the virtual control space for a preset period of time after controlling the device based on the preset gesture, the processor undoes the matching of the selected device and the virtual control space.

### Claim 5 (depends on 2)

The vehicle control device of claim 2, wherein, upon detecting a preset gesture through the virtual control space and detecting that the passenger's body is partially outside the virtual control space, the processor controls the device to correspond to the detected gesture and undoes the matching of the selected device and the virtual control space.

### Claim 6 (depends on 5)

The vehicle control device of claim 5, wherein the vehicle comprises an assistant driver's seat spaced apart from the driver's seat, and the virtual control space is positioned between the driver's seat and the assistant driver's seat.

### Claim 7 (depends on 1)

The vehicle control device of claim 1, wherein the passenger comprises a first passenger and a second passenger, and, if a device corresponding to the position of the first passenger and a device corresponding to the position of the second passenger are the same, and the first passenger is matched with the device earlier than the second passenger, the processor gives priority to the first passenger's gesture and controls the device according to the priority.

### Claim 8 (depends on 7)

The vehicle control device of claim 7, wherein the processor configures the virtual control space in front of the first passenger.

### Claim 9 (depends on 7)

The vehicle control device of claim 7, wherein the interface unit is connected to a voice recognition unit that is installed inside the vehicle and detects the direction of a voice, and the processor acquires the first passenger's voice and the first passenger's utterance position, senses the second passenger's voice based on the first passenger's utterance position, and performs noise cancelling on the second passenger's voice.

### Claim 10 (depends on 1)

The vehicle control device of claim 1, wherein the device is positioned in front of the passenger, and the virtual control space is provided at a predetermined distance in front of the passenger and comprises a width corresponding to the shoulder width of the passenger.

### Claim 11 (depends on 1)

The vehicle control device of claim 1, wherein the device is positioned in front the passenger, the interface is connected to a voice recognition unit installed inside the vehicle, and the processor acquires the passenger's voice detected by the voice recognition unit through the interface unit and controls the device based on the passenger's voice.

### Claim 12 (depends on 1)

The vehicle control device of claim 1, wherein the device is a first device, the virtual control space is a first virtual control space, and the processor detects a twist of the passenger's upper body from the image acquired by the camera, configures a space in front of the passenger as a second virtual control space based on the passenger twisting the upper body, matches a second device corresponding to the passenger twisting the upper body, among the plurality of devices, to the second virtual control space, and, upon detecting a preset gesture from the second virtual control space, controls the device based on the preset gesture.

### Claim 13 (depends on 1)

The vehicle control device of claim 1, wherein the adjacent space is at least one of a space positioned between the passenger and the device, a space positioned in front of the passenger, and a space positioned to one side of the passenger.

### Claim 14 (depends on 1)

The vehicle control device of claim 1, wherein the processor detects the passenger's field of view through the camera, picks out a plurality of devices positioned in the field of view, forms a plurality of virtual control spaces respectively corresponding to the plurality of picked-out devices, matches the plurality of picked-out devices and the plurality of virtual control devices, respectively, and, upon detecting the preset gesture through the plurality of virtual control spaces, controls the device matched to the virtual control space where the preset gesture is detected.

### Claim 15 (depends on 14)

The vehicle control device of claim 14, wherein the plurality of virtual control spaces are spaced apart from one another, are positioned between the passenger and the plurality of picked-out devices, and surround the passenger.

### Claim 16

A vehicle control method comprising:
detecting the position of a passenger from an image acquired by a camera for capturing a vehicle passenger;
configuring a space adjacent to the passenger as a virtual control space;
matching a device corresponding to the position of the passenger, among the plurality of devices, to the virtual control device, and;
upon detecting a preset gesture through the virtual control space, controlling the device based on the preset gesture.

### Claim 17 (depends on 16)

The vehicle control method of claim 16, wherein the passenger is positioned in a driver's seat, and a plurality of devices corresponding to the position of the passenger are provided,
wherein the vehicle control method further comprises:
receiving the passenger's voice recognized by a voice recognition unit installed inside the vehicle;
selecting one device corresponding to the position of the passenger from among the plurality of devices based on the passenger's voice; and
matching the selected device to the virtual control space.

### Claim 18 (depends on 17)

The vehicle control method of claim 17, further comprising, upon receiving an input into a button provided inside the vehicle, activating the voice recognition unit.

### Claim 19 (depends on 17)

The vehicle control method of claim 17, further comprising, if the preset gesture is not detected from the virtual control space for a preset period of time after controlling the device based on the preset gesture, undoing the matching of the selected device and the virtual control space.

### Claim 20 (depends on 17)

The vehicle control method of claim 17, further comprising, upon detecting a preset gesture through the virtual control space and detecting that the passenger's body is partially outside the virtual control space, controlling the device to correspond to the detected gesture and undoing the matching of the selected device and the virtual control space.
