# US 2012/0257060 A1 · Vehicle vision system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0257060 A1
- Document ID: US20120257060A1
- Status: Published application
- Kind: A1
- Application number: 13/525,767
- Filed: 2012-06-18
- Published: 2012-10-11
- Earliest claimed: 1999-08-12
- Assignees: Donnelly Corporation
- Inventors: Brent J. Bos; Kenneth Schofield
- Web page: https://patentgrep.com/patent/US20120257060A1

## CPC

- G06V 20/584: {of vehicle lights or traffic lights}
- B60Q 1/143: {combined with another condition, e.g. using vehicle recognition from camera images or activation of wipers}
- B60Q 9/008: {for anti-collision purposes}
- B60R 1/00: Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R 1/12: Mirror assemblies combined with other articles, e.g. clocks
- B60R 1/26: to the rear of the vehicle
- B60R 1/31: providing stereoscopic vision
- B60R 11/04: Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
- G01B 11/026: {by measuring distance between sensor and object (G01B11/0608 takes precedence)}
- G06T 7/593: from stereo images
- G06T 7/97: {Determining parameters from multiple pictures (depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85)}
- H04N 7/183: {for receiving images from a single remote source}
- H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence)
- H04N 25/00: Circuitry of solid-state image sensors [SSIS]; Control thereof
- B60Q 2300/41: preceding vehicle
- B60Q 2300/42: oncoming vehicle
- B60R 2011/0003: {inside the vehicle}
- B60R 2011/0026: {Windows, e.g. windscreen}
- B60R 2300/105: using multiple cameras
- B60R 2300/107: using stereoscopic cameras
- B60R 2300/30: characterised by the type of image processing
- B60R 2300/305: merging camera image with lines or icons
- B60R 2300/804: for lane monitoring
- B60R 2300/8066: for monitoring rearward traffic
- G06T 2207/10021: Stereoscopic video; Stereoscopic image sequence
- G06T 2207/10024: Color image
- G06T 2207/30252: Vehicle exterior; Vicinity of vehicle
- H04N 2013/0081: {Depth or disparity estimation from stereoscopic image signals}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- B60Q: ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A vision system for a vehicle includes at least one imaging sensor having a forward field of view with respect to a forward direction of travel of the vehicle. The imaging sensor captures image data representative of objects present in the forward field of view. A control is responsive to the imaging sensor and processes image data captured by the imaging sensor to determine an object present in the forward field of view. The control processes image data to determine a distance between the vehicle and the object determined present in the forward field of view. The control may determine the distance between the vehicle and the determined object at least in part in response to at least one of (i) size of the determined object, (ii) position of the determined object, (iii) light intensity of the determined object, and (iv) rate of approach of the determined object.

## Claims

### Claim 1

A vision system for a vehicle, said vision system comprising:
at least one imaging sensor having a forward field of view with respect to a forward direction of travel of a vehicle equipped with said vision system, wherein said at least one imaging sensor comprises a lens and a CMOS imaging array comprising a two-dimensional array of photosensing elements, and wherein said at least one imaging sensor captures image data representative of objects present in said forward field of view;
a control responsive to said at least one imaging sensor;
wherein said control processes image data captured by said at least one imaging sensor to determine an object present in said forward field of view;
wherein said control processes image data captured by said at least one imaging sensor to determine a distance between the equipped vehicle and the object determined present in said forward field of view; and
wherein said control determines the distance between the equipped vehicle and the determined object at least in part in response to at least one of (i) size of the determined object, (ii) position of the determined object, (iii) light intensity of the determined object, and (iv) rate of approach of the determined object,

### Claim 2 (depends on 1)

The vision system of claim 1, wherein said control is operable to adjust a light beam emitted by at least one headlamp of the equipped vehicle responsive to said processing of image data captured by said at least one imaging sensor,

### Claim 3 (depends on 1)

The vision system of claim 1, wherein said array of photosensing elements comprises at least 512 rows of photosensing elements and at least 512 columns of photosensing elements.

### Claim 4 (depends on 1)

The vision system of claim 1, wherein said array of photosensing elements comprises at least 262,144 photosensing elements,

### Claim 5 (depends on 1)

The vision system of claim 1, wherein the object determined present in said forward field of view comprises a headlight or a taillight of another vehicle and wherein said control is operable to adjust a light beam emitted by at least one headlamp of the equipped vehicle responsive to said processing of said image data.

### Claim 6 (depends on 1)

The vision system of claim 1, wherein said control processes image data captured by said at least one imaging sensor to identify a headlamp or taillight of another vehicle present in said forward field of view.

### Claim 7 (depends on 6)

The vision system of claim 6, wherein said control processes image data captured by said at least one imaging sensor and determines a distance between the equipped vehicle and the other vehicle.

### Claim 8 (depends on 7)

The vision system of claim 7, wherein said control determines the distance between the equipped vehicle and the other vehicle at least in part in response to at least one of (i) size of the determined headlamp or taillight, (ii) position of the determined headlamp or taillight, (iii) light intensity of the determined headlamp or taillight, and (iv) rate of approach of the determined headlamp or taillight.

### Claim 9 (depends on 1)

The vision system of claim 1, wherein red filtering is used with at least some of said photosensing elements, and wherein, responsive at least to processing of image data captured by said red filtered photosensing elements, said control is operable to at least partially distinguish the object from other objects present in said forward field of view.

### Claim 10 (depends on 9)

The vision system of claim 9, wherein, responsive at least in part to processing of image data captured by said red filtered photosensing elements, said control is operable to distinguish taillights of other vehicles ahead of the equipped vehicle.

### Claim 11 (depends on 1)

The vision system of claim 1, wherein said control adjusts a light beam emitted by at least one headlamp of the equipped vehicle responsive to said control (i) processing image data captured by said at least one imaging sensor and (ii) identifying a headlamp or taillight of another vehicle present in said forward field of view.

### Claim 12 (depends on 11)

The vision system of claim 11, wherein said control adjusts the light beam emitted by the at least one headlamp of the equipped vehicle by adjusting the at least one headlamp between a first beam and a second beam.

### Claim 13 (depends on 12)

The vision system of claim 12, wherein said first beam comprises a lower beam and said second beam comprises a higher beam.

### Claim 14 (depends on 1)

The vision system of claim 1, wherein said control is operable to control a system of the equipped vehicle responsive to said processing of image data captured by said at least one imaging sensor.

### Claim 15 (depends on 14)

The vision system of claim 14, wherein said controlled system comprises at least one of (i) a lighting system of the equipped vehicle, (ii) a brake system of the equipped vehicle and (iii) a driver assistance system of the equipped vehicle.

### Claim 16 (depends on 1)

The vision system of claim 1, wherein said control controls a brake system of the equipped vehicle responsive to determining that the object determined present in said forward field of view is within a threshold distance of the equipped vehicle.

### Claim 17 (depends on 1)

The vision system of claim 1, wherein said at least one imaging sensor is disposed behind a windshield of the equipped vehicle and said at least one imaging sensor views through the windshield of the equipped vehicle.

### Claim 18 (depends on 1)

The vision system of claim 1, wherein said at least one imaging sensor comprises at least a first imaging sensor and a second imaging sensor, and wherein said first imaging sensor is spaced from said second imaging sensor,

### Claim 19 (depends on 18)

The vision system of claim 18, wherein said first and second imaging sensors comprise imaging sensors of a stereoscopic imaging system of the equipped vehicle.

### Claim 20

A vision system for a vehicle, said vision system comprising;
at least one imaging sensor having a forward field of view with respect to a forward direction of travel of a vehicle equipped with said vision system, wherein said at least one imaging sensor comprises a lens and a CMOS imaging array comprising a two-dimensional array of photosensing elements, and wherein said at least one imaging sensor captures image data representative of objects present in said forward field of view;
a control responsive to said at least one imaging sensor;
wherein said control processes image data captured by said at least one imaging sensor to determine a headlamp or taillight of another vehicle present in said forward field of view;
wherein said control processes image data captured by said at least one imaging sensor to determine a distance between the equipped vehicle and the other vehicle; and
wherein said control determines the distance between the equipped vehicle and the other vehicle at least in part in response to at least one of (i) size of the determined headlamp or taillight, (ii) position of the determined headlamp or taillight, (iii) light intensity of the determined headlamp or taillight, and (iv) rate of approach of the determined headlamp or taillight.

### Claim 21 (depends on 20)

The vision system of claim 20, wherein said control is operable to adjust a light beam emitted by at least one headlamp of the equipped vehicle responsive to said processing of image data captured by said at least one imaging sensor.

### Claim 22 (depends on 20)

The vision system of claim 20, wherein said array of photosensing elements comprises at least 262,144 photosensing elements.

### Claim 23 (depends on 20)

The vision system of claim 20, wherein red filtering is used with at least some of said photosensing elements, and wherein, responsive at least to processing of image data captured by said red filtered photosensing elements, said control is operable to at least partially distinguish the headlamp or taillight of the other vehicle from other objects present in said forward field of view.

### Claim 24

A vision system for a vehicle, said vision system comprising:
at least one imaging sensor having a forward field of view with respect to a forward direction of travel of a vehicle equipped with said vision system, wherein said at least one imaging sensor comprises a lens and a CMOS imaging array comprising a two-dimensional array of at least 262,144 photosensing elements, and wherein said at least one imaging sensor captures image data representative of objects present in said forward field of view;
a control responsive to said at least one imaging sensor;
wherein said control processes image data captured by said at least one imaging sensor to determine a headlamp or taillight of another vehicle present in said forward field of view;
wherein said control processes image data captured by said at least one imaging sensor to determine a distance between the equipped vehicle and the other vehicle; and
wherein red filtering is used with at least some of said photosensing elements, and wherein, responsive at least to processing of image data captured by said red filtered photosensing elements, said control is operable to at least partially distinguish the determined headlamp or taillight of the other vehicle from other objects present in said forward field of view.

### Claim 25 (depends on 24)

The vision system of claim 24, wherein said control determines the distance between the equipped vehicle and the other vehicle at least in part in response to at least one of (i) size of the determined headlamp or taillight, (ii) position of the determined headlamp or taillight, (iii) light intensity of the determined headlamp or taillight, and (iv) rate of approach of the determined headlamp or taillight.

### Claim 26 (depends on 24)

The vision system of claim 24, wherein said control is operable to adjust a light beam emitted by at least one headlamp of the equipped vehicle responsive to said processing of image data captured by said at least one imaging sensor.

### Claim 27

A vision system for a vehicle, said vision system comprising:
at least one imaging sensor having a forward field of view with respect to a forward direction of travel of a vehicle equipped with said vision system, wherein said at least one imaging sensor comprises a lens and a CMOS imaging array comprising a two-dimensional array of photosensing elements, and wherein said at least one imaging sensor captures image data representative of objects present in said forward field of view;
wherein said at least one imaging sensor is disposed behind a windshield of the equipped vehicle and said at least one imaging sensor views through the windshield of the equipped vehicle;
a control responsive to said at least one imaging sensor;
wherein said control processes image data captured by said at least one imaging sensor to determine a headlamp or taillight of another vehicle present in said forward field of view; and
wherein said control processes image data captured by said at least one imaging sensor to determine a distance between the equipped vehicle and the other vehicle.

### Claim 28 (depends on 27)

The vision system of claim 27, wherein said control determines the distance between the equipped vehicle and the other vehicle at least in part in response to at least one of (i) size of the determined headlamp or taillight, (ii) position of the determined headlamp or taillight, (iii) light intensity of the determined headlamp or taillight, and (iv) rate of approach of the determined headlamp or taillight.

### Claim 29 (depends on 27)

The vision system of claim 27, wherein said array of photosensing elements comprises at least 262,144 photosensing elements.

### Claim 30 (depends on 27)

The vision system of claim 27, wherein said control is operable to adjust a light beam emitted by at least one headlamp of the equipped vehicle responsive to said processing of said image data.

### Claim 31 (depends on 27)

The vision system of claim 27, wherein red filtering is used with at least some of said photosensing elements, and wherein, responsive at least to processing of image data captured by said red filtered photosensing elements, said control is operable to at least partially distinguish the object from other objects present in said forward field of view.

### Claim 32 (depends on 31)

The vision system of claim 31, wherein, responsive at least in part to processing of image data captured by said red filtered photosensing elements, said control is operable to distinguish taillights of other vehicles ahead of the equipped vehicle.

### Claim 33 (depends on 27)

The vision system of claim 27, wherein said control adjusts a light beam emitted by at least one headlamp of the equipped vehicle responsive to said control (i) processing image data captured by said at least one imaging sensor and (ii) identifying a headlamp or taillight of another vehicle present in said forward field of view.

### Claim 34 (depends on 27)

The vision system of claim 27, wherein said control is operable to control a system of the equipped vehicle responsive to said processing of image data captured by said at least one imaging sensor, and wherein said controlled system comprises at least one of (i) a lighting system of the equipped vehicle, (ii) a brake system of the equipped vehicle and (iii) a driver assistance system of the equipped vehicle,
