# US 2021/0278853 A1 · Determining occupancy of occluded regions

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0278853 A1
- Document ID: US20210278853A1
- Status: Published application
- Kind: A1
- Application number: 17/328,663
- Filed: 2021-05-24
- Published: 2021-09-09
- Earliest claimed: 2019-02-28
- Assignees: Zoox, Inc.
- Applicants: Zoox, Inc.
- Inventors: Max Gier; William Anthony Silva
- Web page: https://patentgrep.com/patent/US20210278853A1

## CPC

- G05D 1/0214: {in accordance with safety or protection criteria, e.g. avoiding hazardous areas (monitoring the location of vehicles within a certain area, e.g. forbidden or allowed areas, in traffic control systems for road vehicles G08G1/13)}
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G05D 1/0088: {characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours (using knowledge based models G06N5/00)}
- G05D 1/0246: {using a video camera in combination with image processing means}
- G05D 1/0257: {using a radar (radar systems designed for anti-collision purposes between land vehicles or between land vehicle and fixed obstacles G01S13/931)}
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06V 20/584: {of vehicle lights or traffic lights}
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Techniques are discussed for controlling a vehicle, such as an autonomous vehicle, based on occluded areas in an environment. An occluded area can represent areas where sensors of the vehicle are unable to sense portions of the environment due to obstruction by another object or sensor limitation. An occluded region for an object is determined, along with one or more visible regions proximate the occluded region. Entry and/or exit regions may be determined based on known directions of traffic and/or drivable surface boundaries. Based on a threshold speed, the vehicle can designate portions of the occluded region as pseudo-visible. Additionally, if a dynamic object traverses through the occluded region from the entry region, a portion of the occluded region may be considered pseudo-visible. Pseudo-visibility may also be determined based on movement of an occluded area. The vehicle can be controlled to traverse the environment based on the pseudo-visibility.

## Claims

### Claim 1

(canceled)

### Claim 2

A system comprising:
one or more processors; and
one or more computer-readable media storing instructions executable by the one or more processors, wherein the instructions, when executed, cause the system to perform operations comprising:
determining, as an occluded region, a portion of an environment that is occluded from a sensor;
determining, based at least in part on receiving sensor data from the sensor over a period of time, a probability that at least a portion of the occluded region is free of an object; and
controlling a vehicle based at least in part on the probability that the at least the portion of the occluded region is free of the object.

### Claim 3 (depends on 2)

The system of claim 2, wherein the instructions, when executed, further cause the system to perform operations comprising:
determining a drivable region of the environment, the occluded region associated with the drivable region; and
determining, as a visible region, another portion of the environment proximate to the occluded region.

### Claim 4 (depends on 3)

The system of claim 3, wherein the visible region is a first visible region, and wherein the instructions, when executed, further cause the system to perform operations comprising:
determining that an object is visible in the first region at a first time;
determining that at least a portion of the object is in the occluded region at a second time after the first time; and
determining that the object is in a second visible region at a third time after the second time, and
wherein determining the probability is further based at least in part on determining that the object is in the second region.

### Claim 5 (depends on 2)

The system of claim 2, wherein determining the probability is further based at least in part on a speed limit associated with the occluded region.

### Claim 6 (depends on 3)

The system of claim 3, wherein the instructions, when executed, further cause the system to perform operations comprising determining a direction of traffic, and
wherein determining the probability is further based at least in part on the direction of traffic entering the occluded region and a width of a traffic lane of the drivable region.

### Claim 7 (depends on 2)

The system of claim 2, wherein the instructions, when executed, further cause the system to perform operations comprising:
discretizing the occluded region into a plurality of fields, and
wherein determining the probability is based at least in part on determining whether a value associated with a field of the plurality of fields meets or exceeds a threshold value.

### Claim 8 (depends on 2)

The system of claim 2, wherein the occluded region changes over time.

### Claim 9

A method comprising:
determining, as an occluded region, a portion of an environment that is occluded from a sensor;
determining, based at least in part on receiving sensor data from the sensor over a period of time, a probability that at least a portion of the occluded region is free of an object; and
controlling a vehicle based at least in part on the probability that the at least the portion of the occluded region is free of the object.

### Claim 10 (depends on 9)

The method of claim 9, further comprising:
determining a drivable region of the environment, the occluded region associated with the drivable region; and
determining, as a visible region, another portion of the environment proximate to the occluded region.

### Claim 11 (depends on 10)

The method of claim 10, wherein the visible region is a first visible region, the method further comprising:
determining that an object is visible in the first region at a first time;
determining that at least a portion of the object is in the occluded region at a second time after the first time; and
determining that the object is in a second visible region at a third time after the second time, and
wherein determining the probability is further based at least in part on determining that the object is in the second region.

### Claim 12 (depends on 10)

The method of claim 10, wherein determining the probability is further based at least in part on a speed limit associated with the occluded region.

### Claim 13 (depends on 10)

The method of claim 10, further comprising:
determining a direction of traffic, and
wherein determining the probability is further based at least in part on the direction of traffic entering the occluded region and a width of a traffic lane of the drivable region.

### Claim 14 (depends on 13)

The method of claim 13, the method further comprising:
discretizing the occluded region into a plurality of fields, and
wherein determining the probability is based at least in part on determining whether a value associated with a field of the plurality of fields meets or exceeds a threshold value.

### Claim 15 (depends on 10)

The method of claim 10, wherein the occluded region changes over time.

### Claim 16

One or more non-transitory computer-readable media storing instructions that, when executed, cause one or more processors to perform operations comprising:
determining, as an occluded region, a portion of an environment that is occluded from a sensor;
determining, based at least in part on receiving sensor data from the sensor over a period of time, a probability that at least a portion of the occluded region is free of an object; and
controlling a vehicle based at least in part on the probability that the at least the portion of the occluded region is free of the object.

### Claim 17 (depends on 16)

The one or more non-transitory computer-readable media of claim 16, the operations further comprising:
determining a drivable region of the environment, the occluded region associated with the drivable region; and
determining, as a visible region, another portion of the environment proximate to the occluded region.

### Claim 18 (depends on 17)

The one or more non-transitory computer-readable media of claim 17, wherein the visible region is a first visible region, the operations further comprising:
determining that an object is visible in the first region at a first time;
determining that at least a portion of the object is in the occluded region at a second time after the first time; and
determining that the object is in a second visible region at a third time after the second time, and
wherein determining the probability is further based at least in part on determining that the object is in the second region.

### Claim 19 (depends on 16)

The one or more non-transitory computer-readable media of claim 16, the operations further comprising:
discretizing the occluded region into a plurality of fields, and
wherein determining the probability is based at least in part on determining whether a value associated with a field of the plurality of fields meets or exceeds a threshold value.

### Claim 20 (depends on 16)

The one or more non-transitory computer-readable media of claim 16, wherein the occluded region changes over time.

### Claim 21 (depends on 16)

The one or more non-transitory computer-readable media of claim 16, wherein determining the probability is further based at least in part on a speed limit associated with the occluded region.
