# US 2019/0294179 A1 · Systems and methods for detecting low-height objects in a roadway

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0294179 A1
- Document ID: US20190294179A1
- Status: Published application
- Kind: A1
- Application number: 16/417,691
- Filed: 2019-05-21
- Published: 2019-09-26
- Earliest claimed: 2014-01-30
- Assignees: Mobileye Vision Technologies Ltd.
- Applicants: Mobileye Vision Technologies Ltd.
- Inventors: Gideon STEIN; Amnon SHASHUA
- Web page: https://patentgrep.com/patent/US20190294179A1

## CPC

- G05D 1/0276: {using signals provided by a source external to the vehicle (involving a plurality of vehicles G05D1/0287; automatically controlling vehicle speed responsive to externally generated signals B60K31/0058)}
- B60K 31/00: Vehicle fittings, acting on a single sub-unit only, for automatically controlling vehicle speed, i.e. preventing speed from exceeding an arbitrarily established velocity or maintaining speed at a particular velocity, as selected by the vehicle operator
- B60T 7/12: for automatic initiation; for initiation not subject to will of driver or passenger {(limiting speed of vehicles other than rail vehicles B60K31/00)}
- B60W 10/20: including control of steering systems
- B60W 30/00: Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
- B60W 30/09: Taking automatic action to avoid collision, e.g. braking and steering
- B60W 30/14: {Adaptive} cruise control
- B60W 30/18163: {Lane change; Overtaking manoeuvres}
- B60W 60/00276: {for two or more other traffic participants}
- B62D 6/00: Arrangements for automatically controlling steering depending on driving conditions sensed and responded to, e.g. control circuits (means for initiating a change in direction B62D1/00; steering valves B62D5/06; combined with means for inclining the vehicle body or wheels on bends B62D9/00)
- G01S 19/42: Determining position
- G05D 1/0246: {using a video camera in combination with image processing means}
- G06T 7/62: of area, perimeter, diameter or volume
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06V 20/584: {of vehicle lights or traffic lights}
- G06V 20/588: {Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road}
- G08G 1/095: Traffic lights
- G08G 1/165: {for passive traffic, e.g. including static obstacles, trees}
- G08G 1/167: {Driving aids for lane monitoring, lane changing, e.g. blind spot detection}
- H04N 7/181: {for receiving images from a plurality of remote sources}
- H04N 7/183: {for receiving images from a single remote source}
- B60W 2420/403: Image sensing, e.g. optical camera
- B60W 2552/15: Road slope, i.e. the inclination of a road segment in the longitudinal direction
- B60W 2552/30: Road curve radius
- B60W 2554/00: Input parameters relating to objects
- B60W 2554/20: Static objects
- B60W 2554/4029: Pedestrians
- B60W 2554/4041: Position
- B60W 2554/4042: Longitudinal speed
- B60W 2554/80: Spatial relation or speed relative to objects
- B60W 2554/806: Relative heading
- B60W 2555/60: Traffic rules, e.g. speed limits or right of way
- B60W 2710/207: Steering angle of wheels
- G06T 2207/30256: Lane; Road marking
- G06T 2207/30261: Obstacle
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60T: VEHICLE BRAKE CONTROL SYSTEMS OR PARTS THEREOF; BRAKE CONTROL SYSTEMS OR PARTS THEREOF, IN GENERAL (electrodynamic brake systems for vehicle, in general B60L; brakes per se, i.e. devices where braking effect occurs, including ultimate brake actuators, F16D); ARRANGEMENT OF BRAKING ELEMENTS ON VEHICLES IN GENERAL; PORTABLE DEVICES FOR PREVENTING UNWANTED MOVEMENT OF VEHICLES; VEHICLE MODIFICATIONS TO FACILITATE COOLING OF BRAKES
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B62D: MOTOR VEHICLES; TRAILERS (steering, or guiding on a desired track, of agricultural machines or implements A01B69/00; wheels, castors, axles, increasing wheel adhesion B60B; vehicle tyres, tyre inflation or tyre changing B60C; connections between vehicles of a train or the like B60D; vehicles for use on rail and road, amphibious or convertible vehicles B60F; suspension arrangements B60G; heating, cooling, ventilating or other air treating devices B60H; windows, windscreens, non-fixed roofs, doors or similar devices, protective coverings for vehicles not in use B60J; propulsion plant arrangements, auxiliary drives, transmissions, controls, instrumentation or dashboards B60K; electric equipment or propulsion of electrically-propelled vehicles B60L; power supply for electrically-propelled vehicles B60M; passenger accommodation not otherwise provided for B60N; adaptations for load transportation or to carry special loads or objects B60P; arrangement of signalling or lighting devices, the mounting or supporting thereof or circuits therefor, for vehicles in general B60Q; vehicles, vehicle fittings or vehicle parts not otherwise provided for B60R; servicing, cleaning, repairing, supporting, lifting, or manoeuvring, not otherwise provided for, B60S; brake arrangements, brake control systems or parts thereof B60T; air-cushion vehicles B60V; motor-cycles, accessories therefor B62J, B62K; testing of vehicles G01M)
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Systems and methods use cameras to provide autonomous navigation features. In one implementation, a driver-assist object detection system is provided for a vehicle. One or more processing devices associated with the system receive at least two images from a plurality of captured images via a data interface. The device(s) analyze the first image and at least a second image to determine a reference plane corresponding to the roadway the vehicle is traveling on. The processing device(s) locate a target object in the first two images, and determine a difference in a size of at least one dimension of the target object between the two images. The system may use the difference in size to determine a height of the object. Further, the system may cause a change in at least a directional course of the vehicle if the determined height exceeds a predetermined threshold.

## Claims

### Claim 1

A driver-assist object detection system for a vehicle, the system comprising:
at least one image capture device configured to capture a plurality of images representative of an area surrounding the vehicle;
a data interface; and
at least one processing device configured to:
receive, via the data interface, a first image from among the plurality of images and at least a second image from among the plurality of images;
analyze the first image and at least the second image to determine a reference plane corresponding to a road plane;
locate a target object in the first image and in the second image;
determine a difference in a size of at least one dimension of the target object between the first image and the second image;
use the determined difference in the size of the at least one dimension to determine at least a height of the target object relative to the road plane; and
cause a change in at least a directional course of the vehicle if the determined height of the object exceeds a predetermined threshold.

### Claim 2 (depends on 1)

The driver-assist object detection system of claim 1, wherein the at least one processing device is further configured to determine a road clearance height of the vehicle.

### Claim 3 (depends on 2)

The driver-assist object detection system of claim 2, wherein if the determined height of the target object is less than the road clearance height of the vehicle, the at least one processing device is further configured to:
determine that the vehicle can change directional course to drive over the object with the object oriented between the wheels of the vehicle; and
cause the steering system of the vehicle to change the directional course of the vehicle such that the vehicle drives over the object with the object oriented between the wheels of the vehicle.

### Claim 4 (depends on 1)

The driver-assist object detection system of claim 1, wherein the image capture device has a field of view of between about 35 degrees to about 55 degrees.

### Claim 5 (depends on 1)

The driver-assist object detection system of claim 1, wherein the determination of target object height is also based on a detected velocity of the vehicle.

### Claim 6 (depends on 1)

The driver-assist object detection system of claim 1, wherein the predetermined threshold is at least 2 cm from a surface of the road.

### Claim 7 (depends on 1)

The driver-assist object detection system of claim 1, wherein the at least one processor is further configured to determine the road plane as an average surface level associated with a road surface appearing in the plurality of images.

### Claim 8 (depends on 7)

The driver-assist object detection system of claim 7, wherein the road surface includes gravel.

### Claim 9 (depends on 1)

The driver-assist object detection system of claim 1, wherein the determined height of the target object is less than 10 cm relative to the road plane.

### Claim 10

A vehicle, comprising:
a body;
at least one image capture device configured to capture a plurality of images representative of an area surrounding the vehicle;
a data interface; and
at least one processing device configured to:
receive, via the data interface, a first image from among the plurality of images and at least a second image from among the plurality of images;
analyze the first image and at least the second image to determine a reference plane corresponding to a road plane;
locate a target object in the first image and in the second image;
determine a difference in a size of at least one dimension of the target object between the first image and the second image;
use the determined difference in the size of the at least one dimension to determine at least to height of the target object relative to the road plane; and
cause a change in at least a directional course of the vehicle if the determined height of the object exceeds a predetermined threshold.

### Claim 11 (depends on 10)

The vehicle of claim 10, wherein the at least one processing device is further configured to determine a road clearance height of the vehicle.

### Claim 12 (depends on 11)

The vehicle of claim 11, wherein if the determined height of the target object is less than the road clearance of the vehicle, the at least one processing device is further configured to:
determine that the vehicle can change directional course to drive over the object with the object oriented between the wheels of the vehicle; and
cause the steering system of the vehicle to change the directional course of the vehicle such that the vehicle drives over the object with the object oriented between the wheels of the vehicle.

### Claim 13 (depends on 10)

The vehicle of claim 10, wherein the image capture device has a field of view of between about 35 degrees to about 55 degrees.

### Claim 14 (depends on 10)

The vehicle of claim 10, wherein the determination of target object height is also based on a detected velocity of the vehicle.

### Claim 15 (depends on 10)

The vehicle of claim 10, wherein the predetermined threshold is at least 2 cm from the road surface.

### Claim 16 (depends on 10)

The vehicle of claim 10, wherein the at least one processor is further configured to determine the road plane as an average surface level associated with a road surface appearing in the plurality of images.

### Claim 17 (depends on 16)

The vehicle of claim 16, wherein the road surface includes gravel.

### Claim 18 (depends on 10)

The vehicle of claim 10, wherein the determined height of the detected object is less than 10 cm relative to the road plane.

### Claim 19

A method for detecting an object in a roadway, the method comprising:
capturing, via at least one image capture device, a plurality of images representative of an area surrounding the vehicle;
receiving a first image from among the plurality of images and at least a second image from among the plurality of images;
analyzing the first image and at least the second image to determine a reference plane corresponding to a road plane;
locating a target object in the first image and in the second image;
determining a difference in a size of at least one dimension of the target object between the first image and the second image;
using the determined difference in the size of the at least one dimension to determine at least to height of the target object relative to the road plane; and
causing a change in at least a directional course of the vehicle if the determined height of the object exceeds a predetermined threshold.

### Claim 20 (depends on 19)

The method of claim 19, wherein the predetermined threshold is at least 2 cm from a surface of the road.
