# US 11,027,189 B2 · Entertainment method for self-driving vehicle

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,027,189 B2
- Document ID: US11027189B2
- Status: Granted
- Kind: B2
- Application number: 16/653,407
- Filed: 2019-10-15
- Published: 2020-11-05
- Granted: 2021-06-08
- Earliest claimed: 2019-05-02
- Assignees: Hyundai Motor Company; Kia Motors Corporation
- Applicants: Hyundai Motor Company; Kia Motors Corporation
- Inventors: Baek Hee Lee; Jin Hee Lee; Min Hyuk Kwak; Yo Seob Lee
- Web page: https://patentgrep.com/patent/US11027189B2

## CPC

- A63F 13/218: using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
- A63F 13/214: for locating contacts on a surface, e.g. floor mats or touch pads
- A63F 13/24: Constructional details thereof, e.g. game controllers with detachable joystick handles
- A63F 13/285: Generating tactile feedback signals via the game input device, e.g. force feedback
- A63F 13/48: Starting a game, e.g. activating a game device or waiting for other players to join a multiplayer session
- A63F 13/75: Enforcing rules, e.g. detecting foul play or generating lists of cheating players
- A63F 13/80: Special adaptations for executing a specific game genre or game mode
- A63F 13/803: Driving vehicles or craft, e.g. cars, airplanes, ships, robots or tanks
- A63F 13/90: Constructional details or arrangements of video game devices not provided for in groups A63F13/20 or A63F13/25, e.g. housing, wiring, connections or cabinets
- A63F 13/98: Accessories, i.e. detachable arrangements optional for the use of the video game device, e.g. grip supports of game controllers
- B60N 2/0028: {of a body part, e.g. of an arm or a leg}
- B60N 2/003: {characterised by the sensor mounting location in or on the seat}
- B60N 2/0244: {with logic circuits}
- B60N 2/24: for particular purposes or particular vehicles
- B60N 2/976: {massaging systems}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F 3/03547: {Touch pads, in which fingers can move on a surface}
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06V 20/59: inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V 40/174: {Facial expression recognition}
- G06V 40/175: {Static expression}
- B60N 2/0268: {using sensors or detectors for adapting the seat or seat part, e.g. to the position of an occupant}
- B60N 2210/24: Cameras
- B60N 2210/40: Force or pressure sensors
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 2203/011: Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- B60N: SEATS SPECIALLY ADAPTED FOR VEHICLES; VEHICLE PASSENGER ACCOMMODATION NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An entertainment device and method for a self-driving vehicle enable a passenger to play a game while watching a game execution screen of a display mounted around a seat in a state where the passenger is seated on the seat of a self-driving vehicle, and execute and proceed with the game based on a signal that senses a body pressure distribution of the passenger in a body pressure sensor mounted on the seat, and a signal that senses the touch pressure of the passenger in a touch pad mounted on the seat, thereby allowing the passenger to enjoy various games related to the body pressure and/or the touch signal while the passenger moves his or her body.

## Claims

### Claim 1

An entertainment method for a self-driving vehicle, comprising:
selecting and inputting a game type and a mode by a passenger through a game selection input section of a control unit;
applying an activation signal to a body pressure sensor module and a touch pad mounted on a seat while executing the game type and the mode selected by the passenger in a game execution control section of the control unit;
sensing a body pressure distribution and a touch pressure of the passenger in the body pressure sensor module and the touch pad;
computing a game proceeding operation of the passenger by receiving sensing signals of the body pressure sensor module and the touch pad in a game operation computing section of the control unit, and then inputting the computed result to the game execution control section; and
outputting a game execution screen and a sound according to the instruction of the game execution control section in a game output section,
wherein the game execution screen is displayed on a display based on the body pressure distribution signal sensed in the body pressure sensor when the passenger moves the upper body and the lower body in a state where the passenger is seated on the seat equipped with the body pressure sensor and the touch pad, and the touch pressure signal that touches the touch pad while moving the passenger's arm and the passenger's finger to provide various games related to the body pressure and the touch signal.

### Claim 2 (depends on 1)

The entertainment method for the self-driving vehicle of claim 1, wherein the body pressure sensor module comprises:
a first body pressure sensor module arranged in laterally symmetrical positions of a seat back to sense an upper body pressure distribution of the passenger; and
a second body pressure sensor module arranged in the laterally symmetrical positions of a seat cushion to sense a lower body pressure distribution of the passenger.

### Claim 3 (depends on 2)

The entertainment method for the self-driving vehicle of claim 2, wherein the first body pressure sensor module comprises:
a 1-1th left body pressure sensor for sensing a body pressure of a left upper back of the passenger;
a 1-2th left body pressure sensor for sensing a body pressure of a left middle back of the passenger;
a 1-3th left body pressure sensor for sensing a body pressure of a left waist of the passenger;
a 1-1th right body pressure sensor for sensing a body pressure of a right upper back of the passenger;
a 1-2th right body pressure sensor for sensing a body pressure of aright middle back of the passenger; and
a 1-3th right body pressure sensor for sensing a body pressure of aright waist of the passenger.

### Claim 4 (depends on 2)

The entertainment method for the self-driving vehicle of claim 2, wherein the second body pressure sensor module comprises:
a 2-1th left body pressure sensor for sensing a body pressure of a left hip of the passenger;
a 2-2th left body pressure sensor for sensing a body pressure of a left thigh of the passenger;
a 2-1th right body pressure sensor for sensing a body pressure of a right hip of the passenger; and
a 2-2th right body pressure sensor for sensing a body pressure of a right thigh of the passenger.

### Claim 5 (depends on 1)

The entertainment method for the self-driving vehicle of claim 1, wherein the touch pad is selected from one of a plurality of touch pads, the plurality of touch pads comprising:
first, second, and third left touch pads arranged in a left edge position of the seat back to be spaced apart from each other along a vertical direction;
first, second, and third right touch pads arranged in a right edge position of the seat back to be spaced apart from each other along the vertical direction;
first and second lower touch pads arranged in a front edge position of the seat cushion to be spaced apart from each other along a lateral direction; and
first and second upper touch pads arranged in both side portions of a headrest.

### Claim 6 (depends on 1)

The entertainment method for the self-driving vehicle of claim 1, wherein the control unit comprises:
the game selection input section for inputting a game type and a mode;
the game execution control section for applying an activation signal to the body pressure sensor module and the touch pad while executing the game type and the mode inputted through the game selection input section;
the game operation computing section for computing a game proceeding operation of a current passenger by receiving the sensing signals of the body pressure sensor module and the touch pad, and then inputting the computed result to the game execution control section;
a game output section for outputting a game execution screen and a sound according to the instruction of the game execution control section;
a seat posture control section for outputting an adjustment signal of the seat posture suitable for the game type and the mode inputted through the game selection input section;
a seat position driving section for adjusting the seat posture according to the instruction of the seat posture control section; and
a seat vibrating section for vibrating the seat in a specific situation while the game is executed according to the instruction of the game execution control section.

### Claim 7 (depends on 6)

The entertainment method for the self-driving vehicle of claim 6,
wherein the game execution control section executes the game selected by the passenger among the game types using the body pressure and the touch stored in a game storing section, and the game types using only the body pressure or the touch.

### Claim 8 (depends on 1)

The entertainment method for the self-driving vehicle of claim 1, further comprising:
outputting an adjustment signal of a seat posture suitable for the game type and the mode inputted through the game selection input section in a seat posture control section; and
adjusting the seat posture according to an instruction of the seat posture control section in a seat position driving section.

### Claim 9 (depends on 8)

The entertainment method for the self-driving vehicle of claim 8,
wherein the seat position driving section is adopted as an electric reclining device mounted on the seat back, and an electric height adjusting device mounted on the seat cushion.

### Claim 10 (depends on 1)

The entertainment method for the self-driving vehicle of claim 1, further comprising vibrating the seat in a specific situation while the game is executed according to the instruction of the game execution control section in a seat vibrating section.

### Claim 11 (depends on 1)

The entertainment method for the self-driving vehicle of claim 1, further comprising recommending whether to end the game while the passenger proceeds with the game.

### Claim 12 (depends on 11)

The entertainment method for the self-driving vehicle of claim 11, wherein recommending whether to end the game comprises:
recognizing a facial expression of the passenger in a facial expression recognizing camera while the passenger proceeds with the game;
inputting an end recommendation signal to the game execution control section in the facial expression recognizing camera, when the facial expression of the passenger expresses boredom or tiredness; and
outputting a message that recommends to end the game or recommends whether to proceed with another game to a display in the game execution control section.

### Claim 13 (depends on 11)

The entertainment method for the self-driving vehicle of claim 11, wherein recommending whether to end the game comprises:
counting a game execution time in the game execution control section; and
outputting a message that recommends to end the game or recommends whether to proceed to another game to a display in the game execution control section, when the game execution time becomes a certain time or more.