# US 2019/0377354 A1 · Systems and methods for navigating with sensing uncertainty

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0377354 A1
- Document ID: US20190377354A1
- Status: Published application
- Kind: A1
- Application number: 16/479,588
- Filed: 2018-03-01
- Published: 2019-12-12
- Earliest claimed: 2017-03-01
- Assignees: Mobileye Vision Technologies Ltd.
- Applicants: Mobileye Vision Technologies Ltd.
- Inventors: Shai SHALEV-SHWARTZ; Shaked SHAMMAH; Amnon SHASHUA
- Web page: https://patentgrep.com/patent/US20190377354A1

## CPC

- B60W 60/00276: {for two or more other traffic participants}
- B60W 30/0956: {the prediction being responsive to traffic or environmental parameters}
- B60W 60/00274: {considering possible movement changes}
- G01C 21/3602: {Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera}
- G05D 1/0231: {using optical position detecting means (position-fixing by using electromagnetic waves other than radio waves, e.g. optical position detecting means G01S5/16)}
- G05D 1/0257: {using a radar (radar systems designed for anti-collision purposes between land vehicles or between land vehicle and fixed obstacles G01S13/931)}
- G05D 1/0278: {using satellite positioning signals, e.g. GPS}
- G05D 1/247: using signals provided by artificial sources external to the vehicle, e.g. navigation beacons
- G05D 1/248: generated by satellites, e.g. GPS
- G05D 1/249: from positioning sensors located off-board the vehicle, e.g. from cameras
- G06F 18/29: {Graphical models, e.g. Bayesian networks}
- G06V 10/84: using probabilistic graphical models from image or video features, e.g. Markov models or Bayesian networks
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G08G 1/16: Anti-collision systems (road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08)
- B60W 2420/403: Image sensing, e.g. optical camera
- B60W 2420/408: Radar; Laser, e.g. lidar
- B60W 2552/53: Road markings, e.g. lane marker or crosswalk
- B60W 2554/00: Input parameters relating to objects
- B60W 2554/20: Static objects
- B60W 2554/4029: Pedestrians
- B60W 2554/4041: Position
- B60W 2554/4045: Intention, e.g. lane change or imminent movement
- B60W 2554/60: Traversable objects, e.g. speed bumps or curbs
- B60W 2554/802: Longitudinal distance
- B60W 2554/804: Relative longitudinal speed
- B60W 2556/50: of positioning data, e.g. GPS [Global Positioning System] data
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})

## Abstract

The present disclosure relates to navigational systems for vehicles. In one implementation, such a navigational system may receive a first output from a first sensor and a second output from a second sensor; identify a target object in the first output; determine whether the target object is included in the second output; and determine a detected driving condition associated with the target object and whether the condition triggers a navigational constraint. If the navigational constraint is not triggered, the system may cause a first navigational adjustment if the target object is included in both the first output and the second output, and may forego any navigational adjustments if the target object is included in the first output but not in the second output. If the navigational constraint is triggered and the target object is included either in the first or second output, the system may cause a second navigational adjustment.

## Claims

### Claim 1

A navigational system for a host vehicle, the navigational system comprising:
at least one processing device programmed to:
receive a first output from a first sensor onboard the host vehicle, wherein the first output is associated with a first portion of an environment of the host vehicle;
receive a second output from a second sensor onboard the host vehicle, wherein the second output is associated with a second portion of the environment of the host vehicle, and wherein the second portion at least partially overlaps with the first portion;
identify a representation of a target object in the first output;
determine whether a representation of the target object is included in the second output;
determine, based on at least one of the first output or the second output, a detected driving condition associated with the target object and whether the detected driving condition triggers at least one navigational constraint;
if the at least one navigational constraint is not triggered by the detected driving condition and a representation of the target object is included in both the first output and the second output, cause at least a first adjustment to one or more navigational actuators of the host vehicle in response to the target object;
if the at least one navigational constraint is not triggered by the detected driving condition and a representation of the target object is included in the first output, but a representation of the target object is not included in the second output, forego any adjustments to the one or more navigational actuators of the host vehicle in response to the target object; and
if the at least one navigational constraint is triggered by the detected driving condition and a representation of the target object is included either in the first output or in the second output, cause at least a second adjustment to the one or more navigational actuators of the host vehicle in response to the target object, wherein the second adjustment is different from the first adjustment.

### Claim 2 (depends on 1)

The navigational system of claim 1, wherein the target object includes another vehicle.

### Claim 3 (depends on 1)

The navigational system of claim 1, wherein the target object includes a stationary object on a roadway.

### Claim 4 (depends on 1)

The navigational system of claim 1, wherein the target object includes a pedestrian.

### Claim 5 (depends on 1)

The navigational system of claim 1, wherein the target object includes a lane marking.

### Claim 6 (depends on 1)

The navigational system of claim 1, wherein the target object is associated with an occlusion zone.

### Claim 7 (depends on 1)

The navigational system of claim 1, wherein the at least one navigational constraint is associated with a distance to a detected object.

### Claim 8 (depends on 1)

The navigational system of claim 1, wherein the at least one navigational constraint is associated with a distance to a detected pedestrian.

### Claim 9 (depends on 1)

The navigational system of claim 1, wherein the at least one navigational constraint is associated with a size of a detected occlusion zone.

### Claim 10 (depends on 1)

The navigational system of claim 1, wherein the at least one navigational constraint is associated with a distance to a detected occlusion zone.

### Claim 11 (depends on 1)

The navigational system of claim 1, wherein the at least one navigational constraint is associated with a type of an occlusion zone.

### Claim 12 (depends on 1)

The navigational system of claim 1, wherein the at least one navigational constraint includes a predetermined safety constraint.

### Claim 13 (depends on 1)

The navigational system of claim 1, wherein the at least one navigational constraint is associated with a relative speed between the host vehicle and a detected object.

### Claim 14 (depends on 1)

The navigational system of claim 1, wherein the at least one navigational constraint includes a time-to-collision to a detected object.

### Claim 15 (depends on 1)

The navigational system of claim 1, wherein the detected driving condition includes a detected object.

### Claim 16 (depends on 1)

The navigational system of claim 1, wherein the detected driving condition includes a detected vehicle.

### Claim 17 (depends on 1)

The navigational system of claim 1, wherein the detected driving condition includes a detected pedestrian.

### Claim 18 (depends on 1)

The navigational system of claim 1, wherein the detected driving condition includes a detected lane of a roadway.

### Claim 19 (depends on 1)

The navigational system of claim 1, wherein the detected driving condition includes a detected occlusion zone.

### Claim 20 (depends on 1)

The navigational system of claim 1, wherein the first sensor includes a camera.

### Claim 21 (depends on 20)

The navigational system of claim 20, wherein the second sensor includes a LIDAR.

### Claim 22 (depends on 20)

The navigational system of claim 20, wherein the second sensor includes a radar.

### Claim 23 (depends on 20)

The navigational system of claim 20, wherein the second sensor includes a Global Positioning System (GPS) sensor.

### Claim 24

A navigational system for a host vehicle, the navigational system comprising:
at least one processing device programmed to:
receive a first output from a first sensor onboard the host vehicle, wherein the first output is associated with a first portion of an environment of the host vehicle;
receive a second output from a mapping system onboard the host vehicle, wherein the second output is associated with a second portion of the environment of the host vehicle, and wherein the second portion at least partially overlaps with the first portion;
identify a representation of a target object in the first output;
determine whether a representation of the target object is included in the second output;
determine, based on at least one of the first output or the second output, a detected driving condition associated with the target object and whether the detected driving condition triggers at least one navigational constraint;
if the at least one navigational constraint is not triggered by the detected driving condition and a representation of the target object is included in both the first output and the second output, cause at least a first adjustment to one or more navigational actuators of the host vehicle in response to the target object;
if the at least one navigational constraint is not triggered by the detected driving condition and a representation of the target object is included in the first output, but a representation of the target object is not included in the second output, forego any adjustments to the one or more navigational actuators of the host vehicle in response to the target object; and
if the at least one navigational constraint is triggered by the detected driving condition and a representation of the target object is included either in the first output or in the second output, cause at least a second adjustment to the one or more navigational actuators of the host vehicle in response to the target object, wherein the second adjustment is different from the first adjustment.

### Claim 25 (depends on 24)

The navigational system of claim 24, wherein the mapping system is configured to access a database to retrieve at least one map associated with the second portion of the environment of the vehicle.

### Claim 26 (depends on 25)

The navigational system of claim 25, wherein at least a portion of the database is included in the host vehicle.

### Claim 27 (depends on 25)

The navigational system of claim 25, wherein the mapping system is further configured to wirelessly access at least a portion of the database via at least one network.

### Claim 28

A host vehicle, the host vehicle comprising:
a first sensor;
a second sensor; and
at least one processing device programmed to:
receive a first output from the first sensor, wherein the first output is associated with a first portion of an environment of the host vehicle;
receive a second output from the second sensor, wherein the second output is associated with a second portion of the environment of the host vehicle, and wherein the second portion at least partially overlaps with the first portion;
identify a representation of a target object in the first output;
determine whether a representation of the target object is included in the second output;
determine, based on at least one of the first output or the second output, a detected driving condition associated with the target object and whether the detected driving condition triggers at least one navigational constraint;
if the at least one navigational constraint is not triggered by the detected driving condition and a representation of the target object is included in both the first output and the second output, cause at least a first adjustment to one or more navigational actuators of the host vehicle in response to the target object;
if the at least one navigational constraint is not triggered by the detected driving condition and a representation of the target object is included in the first output, but a representation of the target object is not included in the second output, forego any adjustments to the one or more navigational actuators of the host vehicle in response to the target object; and
if the at least one navigational constraint is triggered by the detected driving condition and a representation of the target object is included either in the first output or in the second output, cause at least a second adjustment to the one or more navigational actuators of the host vehicle in response to the target object, wherein the second adjustment is different from the first adjustment.

### Claim 29

A method for navigating a host vehicle, the method comprising:
receiving a first output from a first sensor onboard the host vehicle, wherein the first output is associated with a first portion of an environment of the host vehicle;
receiving a second output from a second sensor onboard the host vehicle, wherein the second output is associated with a second portion of the environment of the host vehicle, and wherein the second portion at least partially overlaps with the first portion;
identifying a representation of a target object in the first output;
determining whether a representation of the target object is included in the second output;
determining, based on at least one of the first output or the second output, a detected driving condition associated with the target object and whether the detected driving condition triggers at least one navigational constraint;
if the at least one navigational constraint is not triggered by the detected driving condition and a representation of the target object is included in both the first output and the second output, causing at least a first adjustment to one or more navigational actuators of the host vehicle in response to the target object;
if the at least one navigational constraint is not triggered by the detected driving condition and a representation of the target object is included in the first output, but a representation of the target object is not included in the second output, foregoing any adjustments to the one or more navigational actuators of the host vehicle in response to the target object; and
if the at least one navigational constraint is triggered by the detected driving condition and a representation of the target object is included either in the first output or in the second output, causing at least a second adjustment to the one or more navigational actuators of the host vehicle in response to the target object, wherein the second adjustment is different from the first adjustment.
