# US 2012/0259546 A1 · Apparatus and method for displaying road guide information on windshield

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0259546 A1
- Document ID: US20120259546A1
- Status: Published application
- Kind: A1
- Application number: 13/240,561
- Filed: 2011-09-22
- Published: 2012-10-11
- Earliest claimed: 2011-04-05
- Assignees: Hyundai Motor Company
- Inventors: Ju Nam Kim
- Web page: https://patentgrep.com/patent/US20120259546A1

## CPC

- G02B 27/01: Head-up displays
- G01C 21/365: {Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself}
- G01C 21/3658: {Lane guidance}
- G06V 20/588: {Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road}
- G06V 40/193: {Preprocessing; Feature extraction}
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An apparatus for displaying road guidance information on a windshield that enables a driver to accurately recognize a road associated with a destination route by overlaying road guide information of a navigation system on the actual road based on an eye location of a driver by displaying mapped results on a windshield of a vehicle in variable location, and a method thereof are provided.

## Claims

### Claim 1

An apparatus for displaying road guidance information on a windshield, the apparatus comprising:
a navigation associating means acquiring road guidance information to a destination set by a driver;
a front image recognition means recognizing a travel lane from a front road image;
an eye location detecting means detecting an eye location from a facial image of the driver;
a control means controlling a windshield display means to map the road guidance information to overlay an actual road on the windshield based on the eye location of the driver detected by the eye location detecting means and display a mapped result; and
the windshield display means mapping the road guidance information to overlay the actual road and displaying the mapped result under control of the control means.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the front image recognition means comprises:
a camera photographing the road image;
an image processor dividing the road image photographed by the camera into two regions;
a preprocessor performing lane modeling into a one dimensional straight line with respect to the two regions divided by the image processor, selecting a triangle formed by respective modeled lines, and calculating a circumscribed radius of the selected triangle; and
a curvature calculator calculating a curvature of a road using the circumscribed radius of the selected triangle calculated by the preprocessor.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the eye location detecting means selects a region for a symmetrical part of a face from a facial image of the driver, selects an upper part of a noise hole as an eye location candidate region in which an eye is located by using the nose hole among a symmetrical point displayed on the fact image as a determination reference, and filters the eye location candidate region selected from the facial image by a filter to detect an eye location.

### Claim 4 (depends on 3)

The apparatus of claim 3, wherein a region for the symmetrical part of a face is an eye brow part, an eye part, or a noise hole part.

### Claim 5 (depends on 4)

The apparatus of claim 4, wherein the nose hole part is selected as a determination reference of a symmetrical point using the fact that has few variations in brightness as compared with other parts and is located at the lowest position buts forms a symmetrical part of a short interval.

### Claim 6 (depends on 3)

The apparatus of claim 3, wherein the filter is a sobel filter.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the windshield display means is one of a Head Up Display (HUD) device, a projection device, a transparent windshield display device, or a windshield dot display device.

### Claim 8

A method for displaying road guide information on a windshield, the method comprising:
acquiring road guidance information to a destination set by a driver associated with a navigation system of a vehicle;
recognizing a front road image;
detecting an eye location from a facial image of the driver; and
mapping the road guidance information to overlay an actual road on the windshield based on the detected eye location of the driver.

### Claim 9 (depends on 8)

The method of claim 8, wherein detecting an eye location comprises:
selecting a region for a symmetrical part of a face from the facial image of the driver;
selecting an upper part of a noise hole as an eye location candidate region in which an eye is located by using the nose hole among a symmetrical point displayed on the fact image as a determination reference; and
filtering the eye location candidate region selected form the facial image to detect a contour of an eye.

### Claim 10

A non-transitory computer readable medium containing executable program instructions executed by a processor to for display road guide information on a windshield, comprising:
program instructions that acquire road guidance information to a destination set by a driver associated with a navigation system of a vehicle;
program instructions that recognize a frontal road image;
program instructions that detect an eye location from a facial image of the driver; and
program instructions that map the road guidance information and overlay the mapped road guidance information on an actual road on the windshield based on the detected eye location of the driver.

### Claim 11 (depends on 10)

The non-transitory computer readable medium of claim 10, wherein the program instructions that detect an eye location comprise:
program instructions that select a region for a symmetrical part of a face from the facial image of the driver;
program instructions that select an upper part of a noise hole as an eye location candidate region in which an eye is located by using the nose hole among a symmetrical point displayed on the fact image as a determination reference; and
program instructions that filter the eye location candidate region selected form the facial image to detect a contour of an eye.
