# US 2012/0253596 A1 · Driver assistance system and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0253596 A1
- Document ID: US20120253596A1
- Status: Published application
- Kind: A1
- Application number: 13/427,712
- Filed: 2012-03-22
- Published: 2012-10-04
- Earliest claimed: 2011-03-28
- Assignees: TK Holdings Inc.
- Inventors: Faroog IBRAHIM; Michael J. Higgins-Luthman
- Web page: https://patentgrep.com/patent/US20120253596A1

## CPC

- G08G 1/167: {Driving aids for lane monitoring, lane changing, e.g. blind spot detection}
- G06V 20/584: {of vehicle lights or traffic lights}
- G06V 20/588: {Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road}
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A driver assistance system includes a stereo vision system that includes at least one camera and at least one sensor disposed on or in a vehicle; a roadside marker detection unit configured to receive stereo image data from the stereo vision system, and to detect roadside markers from the stereo image data; and a road path estimation unit configured to estimate a road path in a direction of travel of the vehicle, based on the roadside markers detected by the roadside marker detection unit.

## Claims

### Claim 1

A driver assistance system, comprising:
a stereo vision system that includes at least one camera and at least one sensor disposed on or in a vehicle;
a roadside marker detection unit configured to receive stereo image data from the stereo vision system, and to detect roadside markers from the stereo image data; and
a road path estimation unit configured to estimate a road path in a direction of travel of the vehicle, based on the roadside markers detected by the roadside marker detection unit.

### Claim 2 (depends on 1)

The driver assistance system according to claim 1, wherein the roadside marker detection unit detects light emanating from street lights, and
wherein the road path estimation unit estimates a location of each detected street light detected and estimates the road path as substantially corresponding to a curve formed by a locus of points corresponding to locations of each detected street light.

### Claim 3 (depends on 1)

The driver assistance system according to claim 1, wherein the roadside marker detection unit detects reflectors provided on sides of a road on which the vehicle is traveling, and
wherein the road path estimation unit estimates a location of each detected reflector detected and estimates the road path as substantially corresponding to a curve formed by a locus of points corresponding to locations of each detected reflector.

### Claim 4 (depends on 1)

The driver assistance system according to claim 1, further comprising:
a vehicle movement detection unit configured to detect a linear movement of the vehicle,
wherein the road path estimation unit is configured to estimate the road path based in part on the linear movement of the vehicle detected over a predetermined time period.

### Claim 5 (depends on 4)

The driver assistance system according to claim 4, wherein the predetermined time period is a time period from a current time to X seconds in the past, X being a real number.

### Claim 6 (depends on 1)

The driver assistance system according to claim 1, wherein the roadside marker detection unit is configured to detect relative three dimensional disposition of the roadside markers from the stereo image data with respect to each other.

### Claim 7 (depends on 1)

The driver assistance system according to claim 1, wherein the road path estimation unit is configured to estimate an upwards and downwards disposition of the road path in the direction of travel of the vehicle.

### Claim 8 (depends on 1)

The driver assistance system according to claim 1, further comprising:
a display unit configured to provide a display of the estimated road path in the direction of travel of the vehicle.

### Claim 9 (depends on 8)

The driver assistance system according to claim 8, wherein the display unit is configured to provide a three-dimensional display of the estimated road path in the direction of travel of the vehicle.

### Claim 10 (depends on 1)

The driver assistance system according to claim 1, further comprising:
a vehicle detection unit configured to detect presence of other vehicles,
wherein the road path estimation unit estimates a first portion of the road path based on the roadside markers and estimates a second portion of the road path based on the detected other vehicles, and
wherein the first portion of the road path is closer to the vehicle than the second portion of the road path.

### Claim 11 (depends on 10)

The driver assistance system according to claim 10, wherein the first portion of the road path is a portion that extends out to 500 meters from the vehicle.

### Claim 12 (depends on 1)

The driver assistance system according to claim 1, further comprising:
a control unit configured to adjust headlights of the vehicle based on the estimated road path in the direction of travel of the vehicle.

### Claim 13

A non-transitory computer readable medium storing computer program code that, when executed by a computer, causes the computer to perform the functions of:
code that receives stereo image data from the stereo vision system, and that detects roadside markers from the stereo image data; and
code that estimates a road path in a direction of travel of the vehicle, based on the roadside markers detected from the stereo image data.

### Claim 14 (depends on 13)

The non-transitory computer readable medium according to claim 13, wherein the code that detects roadside marker detects light emanating from street lights, and
wherein the code that estimates a road path estimates a location of each detected street light detected and estimates the road path as substantially corresponding to a curve formed by a locus of points corresponding to locations of each detected street light.

### Claim 15 (depends on 13)

The non-transitory computer readable medium according to claim 13, wherein the code that detects roadside marker detects reflectors provided on sides of a road on which the vehicle is traveling, and
wherein the code that estimates a road path estimates a location of each detected reflector detected and estimates the road path as substantially corresponding to a curve formed by a locus of points corresponding to locations of each detected reflector.

### Claim 16 (depends on 13)

The non-transitory computer readable medium according to claim 13, wherein the computer further performs the function of:
detecting a linear movement of the vehicle,
wherein the code that estimates a road path to estimate the road path based in part on the linear movement of the vehicle detected over a predetermined time period.

### Claim 17 (depends on 16)

The non-transitory computer readable medium according to claim 16, wherein the predetermined time period is a time period from a current time to X seconds in the past, X being a real number.

### Claim 18 (depends on 13)

The non-transitory computer readable medium according to claim 13, wherein the code that detects roadside markers from the stereo image data detects relative three dimensional disposition of the roadside markers from the stereo image data with respect to each other.

### Claim 19 (depends on 13)

The non-transitory computer readable medium according to claim 13, wherein the code that estimates a road path estimates an upwards and downwards disposition of the road path in the direction of travel of the vehicle.

### Claim 20 (depends on 13)

The non-transitory computer readable medium according to claim 13, further causing the computer to perform the function of:
displaying the estimated road path in the direction of travel of the vehicle.

### Claim 21 (depends on 20)

The non-transitory computer readable medium according to claim 20, wherein the displaying is provided as a three-dimensional display of the estimated road path in the direction of travel of the vehicle.

### Claim 22 (depends on 13)

The non-transitory computer readable medium according to claim 13, the computer further performing the functions of:
code for detecting presence of other vehicles,
wherein the code for estimating a road path estimates a first portion of the road path based on the roadside markers and estimates a second portion of the road path based on the detected other vehicles, and
wherein the first portion of the road path is closer to the vehicle than the second portion of the road path.

### Claim 23 (depends on 22)

The non-transitory computer readable medium according to claim 22, wherein the first portion of the road path is a portion that extends out to 500 meters from the vehicle.

### Claim 24 (depends on 13)

The non-transitory computer readable medium according to claim 13, further causing the computer to perform the functions of:
code for causing adjustment of headlights of the vehicle based on the estimated road path in the direction of travel of the vehicle.

### Claim 25

A method of providing driver assistance when driving a vehicle, comprising:
receiving stereo image data from the stereo vision system;
detecting roadside markers from the stereo image data; and
estimating a road path in a direction of travel of the vehicle, based on the roadside markers detected from the stereo image data.
