# US 2019/0095732 A1 · Information processing device and method of determining an image data displayed on the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0095732 A1
- Document ID: US20190095732A1
- Status: Published application
- Kind: A1
- Application number: 16/095,298
- Filed: 2016-04-20
- Published: 2019-03-28
- Earliest claimed: 2016-04-20
- Assignees: Nissan Motor Co., Ltd.; RENAULT s.a.s.
- Applicants: Nissan Motor Co., Ltd.; Renault S.A.S.
- Inventors: Masafumi Tsuji
- Web page: https://patentgrep.com/patent/US20190095732A1

## CPC

- G06V 20/59: inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
- B60K 35/20: Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
- B60K 35/215: characterised by the combination of multiple visual outputs, e.g. combined instruments with analogue meters and additional displays
- B60K 35/22: Display screens
- B60K 35/28: characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
- B60K 35/29: Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
- B60K 35/60: Instruments characterised by their location or relative disposition in or on vehicles (arrangements of lighting devices on dashboards B60Q3/10)
- B60K 35/652: {for left- or right-hand drive}
- B60R 11/02: for radio sets, television sets, telephones, or the like; Arrangement of controls thereof
- B60R 11/04: Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 40/161: {Detection; Localisation; Normalisation}
- B60K 35/654: {the user being the driver}
- G06T 2207/30201: Face
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An information processing device installed inside a vehicle includes a first input port inputting a first image data imaged by a first imaging device, a second input port inputting a second image data imaged by a second imaging device, a display displaying an image data, and a controller determining the image data displayed on the display in accordance with an installation location of the information processing device inside the vehicle. The controller estimates the installation location of the information processing device based on a position of a human being's face detected by the first image data and distance information to an object detected by the second image data.

## Claims

### Claim at position 1

-9. (canceled)

### Claim 10

An information processing device installed inside a vehicle, comprising:
a first input port inputting a first image data imaged by a first imaging device;
a second input port inputting a second image data imaged by a second imaging device;
a display displaying an image data; and
a controller determining the image data displayed on the display in accordance with an installation location of the information processing device inside the vehicle,
wherein the controller estimates the installation location of the information processing device based on a position of a face of a person detected by the first image data and distance information to an object detected by the second image data.

### Claim 11 (depends on 10)

The information processing device according to claim 10, wherein the image data displayed on the display is an image data of an object outside of the vehicle.

### Claim 12 (depends on 10)

The information processing device according to claim 10, wherein the controller determines an image data captured ahead of the vehicle as the image data displayed on the display when the installation location of the information processing device is estimated at an upper side as viewed from the person.

### Claim 13 (depends on 10)

The information processing device according to claim 10, wherein the controller determines navigation information or an image data of a meter panel as the image data displayed on the display when the installation location of the information processing device is estimated at a lower side as viewed from the person.

### Claim 14 (depends on 10)

The information processing device according to claim 10,
wherein the controller:
estimates that the installation location of the information processing device is in front of a center console when the position of the face of the person imaged by the first imaging device is at upper right or upper left of a captured image, the first imaging device being provided on a surface of the information processing device on which the display is provided;
estimates that the installation location of the information processing device is on a dashboard when the position of the face of the person imaged by the first imaging device is not at upper right or upper left of the captured image and a distance to an object acquired by the second imaging device is equal to or more than a predetermined distance, the object being located ahead of the vehicle, the second imaging device being provided on a surface opposite to the surface of the information processing device on which the display is provided; and
estimates that the installation location of the information processing device is in front of the dashboard when the position of the face of the person imaged by the first imaging device is not at upper right or upper left of the captured image and the distance to the object acquired by the second imaging device is less than the predetermined distance.

### Claim 15

A method of determining an image data displayed on a display of an information processing device installed inside a vehicle, the method comprising:
estimating an installation location of the information processing device based on a position of a face of a person detected by a first image data captured by a first imaging device of the information processing device and distance information to an object detected by a second image data captured by a second imaging device of the information processing device; and
determining the image data displayed on the display in accordance with the installation location of the information processing device inside the vehicle.

### Claim 16 (depends on 15)

The method according to claim 15, wherein the image data displayed on the display is an image data of an object existed outside of the vehicle.

### Claim 17 (depends on 15)

The method according to claim 15, wherein an image data captured ahead of the vehicle is determined as the image data displayed on the display when the installation location of the information processing device is estimated at an upper side as viewed from the person.

### Claim 18 (depends on 15)

The method according to claim 15, wherein navigation information or an image data of a meter panel is determined as the image data displayed on the display when the installation location of the information processing device is estimated at a lower side as viewed from the person.

### Claim 19 (depends on 15)

The method according to claim 15, further comprising:
estimating that the installation location of the information processing device is in front of a center console when the position of the face of the person imaged by the first imaging device is at upper right or upper left of a captured image, the first imaging device being provided on a surface of the information processing device on which the display is provided;
estimating that the installation location of the information processing device is on a dashboard when the position of the face of the person imaged by the first imaging device is not at upper right or upper left of the captured image and a distance to an object acquired by the second imaging device is equal to or more than a predetermined distance, the object being located ahead of the vehicle, the second imaging device being provided on a surface opposite to the surface of the information processing device on which the display is provided; and
estimating that the installation location of the information processing device is in front of the dashboard when the position of the face of the person imaged by the first imaging device is not at upper right or upper left of the captured image and the distance to the object acquired by the second imaging device is less than the predetermined distance.

### Claim 20 (depends on 15)

The method according to claim 15, comprising:
imaging the face of the person using the first imaging device provided on a surface of the information processing device on which the display is provided;
estimating the location of the information processing device based on a direction of the face of the person imaged by the first imaging device;
imaging a front side of the vehicle using the second imaging device provided on a surface opposite to the surface of the information processing device on which the display is provided; and
estimating that the location of the information processing device is in front of a meter panel when luminance of an imaging range acquired by the second imaging device varies in cooperation with a light amount selection switch of the meter panel.

### Claim 21 (depends on 15)

The method according to claim 15, comprising:
estimating the location of the information processing device as a location on a left side as viewed from the person when the face of the person imaged by the first imaging device is rightward while the vehicle is traveling straight ahead;
estimating the location of the information processing device as a location facing the person when the face of the person imaged by the first imaging device is in a front direction while the vehicle is traveling straight ahead; and
estimating the location of the information processing device as a location on a right side as viewed from the person when the face of the person imaged by the first imaging device is leftward while the vehicle is traveling straight ahead.
