# US 10,870,350 B2 · Vehicle display device for overlapping display image on real landscape

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,870,350 B2
- Document ID: US10870350B2
- Status: Granted
- Kind: B2
- Application number: 16/177,261
- Filed: 2018-10-31
- Published: 2019-05-16
- Granted: 2020-12-22
- Earliest claimed: 2017-11-10
- Assignees: Yazaki Corporation
- Applicants: Yazaki Corporation
- Inventors: Tomotake Wakatsuki; Kazuyoshi Ogasawara
- Web page: https://patentgrep.com/patent/US10870350B2

## CPC

- G02B 27/0101: {characterised by optical features (G02B27/0172 takes precedence)}
- B60K 35/235: with means for detecting the driver's gaze direction or eye points
- G02B 27/0179: {Display position adjusting means not related to the information to be displayed}
- B60K 2360/334: Projection means
- B60R 2300/205: using a head-up display
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0141: {characterised by the informative content of the display}
- G02B 2027/0181: {Adaptation to the pilot/driver}
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR

## Abstract

A vehicle display device acquires a plurality of point positions of a pair of white lines interposing a traffic lane extending forward of a vehicle from a frontward image. Interpolation formulas are created in a direction in which a plurality of point positions are continuous along the white lines, respectively. A base point is determined on any one of the interpolation formulas on the basis of distance information to an intersection forward of the vehicle. A road shape model is created such that a plurality of finite element models defined by the base point and a plurality of vertexes set on the interpolation formulas, respectively, directed from the base point to the vehicle side are arranged between a pair of interpolation formulas.

## Claims

### Claim 1

A vehicle display device that projects a display image in front of a driver of a vehicle and overlappingly displays the display image on a real landscape forward of the vehicle, the vehicle display device comprising:
a driver camera configured to capture a driver image of the driver;
a vehicle front camera configured to capture a frontward image of the real landscape forward of the vehicle; and
a processor-based controller in communication with each of the display, the driver camera, and the vehicle front camera, and configured to,
detect a viewpoint position of the driver based on the driver image;
acquire a plurality of three-dimensional coordinates of a pair of colored lines interposing a traffic lane extending forward of the vehicle from the frontward image;
create each of virtual lines in a direction in which the plurality of three-dimensional coordinates are continuous along each of the colored lines;
determine a base point on any one of the virtual lines on the basis of distance information to an indicator forward of the vehicle;
create a three-dimensional model in which a plurality of finite element models defined by the base point and a plurality of vertexes set on each of the virtual lines directed to a vehicle side from the base point are arranged between the pair of virtual lines; and
perform texture mapping by attaching a source display image serving as a source of the display image to the three-dimensional model and display, as the display image, an image obtained as the three-dimensional model is seen from a viewpoint position of the driver, wherein
the indicator represents an intersection, and
the processor-based controller is configured to determine the base point on any one of the virtual lines positioned in a left or right side of the vehicle on the basis of left or right turn information of the vehicle at the intersection and distance information to the intersection in a navigation path to a destination,
the processor-based controller is configured to determine the base point on the virtual line in the left side of the vehicle on the basis of a distance to a center of the intersection in the case of a left turn of the vehicle, and
the processor-based controller is configured to determine the base point on the virtual line in the right side of the vehicle on the basis of a distance to the intersection obtained by adding a width of a traffic lane extending in a right-turn direction from the intersection to the distance to the center of the intersection in the case of a right turn of the vehicle, or
the processor-based controller is configured to determine the base point on the virtual line in the right side of the vehicle on the basis of a distance to a center of the intersection in the case of a right turn of the vehicle, and
the processor-based controller is configured to determine the base point on the virtual line in the left side of the vehicle on the basis of a distance to the intersection obtained by adding a width of a traffic lane extending in a left-turn direction from the intersection to the distance to the center of the intersection in the case of a left turn of the vehicle.

### Claim 2 (depends on 1)

The vehicle display device according to claim 1, wherein
the processor-based controller is configured to oppositely distort the display image displayed to cancel a distortion caused by a windshield of the vehicle.