# US 2023/0058731 A1 · Determining occupancy using unobstructed sensor emissions

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0058731 A1
- Document ID: US20230058731A1
- Status: Published application
- Kind: A1
- Application number: 17/405,826
- Filed: 2021-08-18
- Published: 2023-02-23
- Earliest claimed: 2021-08-18
- Assignees: Zoox, Inc.
- Applicants: Zoox, Inc.
- Inventors: Scott M. Purdy
- Web page: https://patentgrep.com/patent/US20230058731A1

## CPC

- B60W 30/09: Taking automatic action to avoid collision, e.g. braking and steering
- B60W 30/0956: {the prediction being responsive to traffic or environmental parameters}
- G01S 7/4808: {Evaluating distance, position or velocity data}
- G01S 17/04: Systems determining the presence of a target
- G01S 17/42: Simultaneous measurement of distance and other co-ordinates (indirect measurement G01S17/46)
- G01S 17/931: of land vehicles
- B60W 2420/403: Image sensing, e.g. optical camera
- B60W 2420/408: Radar; Laser, e.g. lidar
- B60W 2554/00: Input parameters relating to objects
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES

## Abstract

Techniques for determining occupancy using unobstructed sensor emissions. For instance, a vehicle may receive sensor data from one or more sensors. The sensor data may represent at least locations to points within an environment. Using the sensor data, the vehicle may determine areas within the environment that are obstructed by objects (e.g., locations where objects are located). The vehicle may also use the sensor data to determine areas within the environment that are unobstructed by objects (e.g., locations where objects are not located). In some examples, the vehicle determines the unobstructed areas as including areas that are between the vehicle and the identified objects. This is because sensor emissions from the sensor(s) passed through these areas and then reflected off of objects located farther distances from the vehicle. The vehicle may then generate a map indicating at least the obstructed areas and the unobstructed areas within the environment.

## Claims

### Claim 1

A system comprising:
one or more processors; and
one or more computer-readable media storing instructions that, when executed by the one or more processors, cause the system to perform operations comprising:
determining a first area within an environment at which a first plurality hypothetical objects may be located;
determining a second area within the environment at which a second plurality of hypothetical objects may be located;
receiving sensor data from one or more sensors of a vehicle, where the sensor data is determined based on at least one sensor emission passing through the first area and reflecting from a real object at the second area;
determining, based at least in part on the sensor data, that the first area is an unobstructed area not containing at least one of the first plurality of hypothetical objects;
determining, based at least in part on the sensor data, an orientation and location for the real object located at the second area; and
controlling the vehicle based at least in part on the second area including the real object.

### Claim 2 (depends on 1)

The system as recited in claim 1, wherein determining the orientation associated with the real object comprises at least:
determining, based at least in part on the sensor data, that an emission path associated with a point passes in proximity to the real object without reflecting off the real object; and
determining the orientation associated with the real object based at least in part on the emission path passing in proximity to the real object without reflecting off the real object.

### Claim 3 (depends on 1)

The system as recited in claim 1, the operations further comprising:
determining a third area within the environment at which a third plurality of hypothetical objects may be located, the third area being located farther from the vehicle than the second area;
determining, based at least in part on the sensor data, that at least one sensor emission does not pass through the third area; and
determining, based at least in part on the at least one sensor emission not passing through the area, that one or more of the third plurality of hypothetical objects may still be located at the third area,
and wherein controlling the vehicle is further based at least in part on determining that the one or more of the third plurality of hypothetical objects may still be located at the third area.

### Claim 4 (depends on 1)

The system as recited in claim 1, the operations further comprising:
determining a type of the environment associated with the first area;
determining, based at least in part on the type of the environment, a type of hypothetical object that may be located at the first area; and
determining the first plurality of hypothetical objects based at least in part on the type of hypothetical object that may be located at the first area.

### Claim 5

A method comprising:
determining a plurality of hypothetical objects that may be at a location within an environment;
receiving sensor data from one or more sensors of a vehicle;
determining, based at least in part on the sensor data, that at least some of the plurality of hypothetical objects are not located at the location; and
controlling the vehicle based at least in part on determining that the at least some of the plurality of hypothetical objects are not located at the location.

### Claim 6 (depends on 5)

The method as recited in claim 5, further comprising:
determining a hypothetical orientation for a hypothetical object from the plurality of hypothetical objects;
determining, based at least in part on the sensor data, a real orientation of a real object; and
updating, based at least in part on the real orientation, the location to include an additional location with the environment,
and wherein controlling the vehicle is based at least in part on the additional location.

### Claim 7 (depends on 5)

The method as recited in claim 5, wherein:
determining that at least some of the plurality of hypothetical objects are not located at the location comprises at least determining, based at least in part on the sensor data, that a real object is located at the location; and
the method further comprises:
determining, based at least in part on the sensor data, that an emission path associated with a point passes in proximity to the real object without reflecting off the real object and
determining an orientation of the real object based at least in part on the emission path passing in proximity to the real object without reflecting off the real object.

### Claim 8 (depends on 5)

The method as recited in claim 5, further comprising:
determining a type of the environment associated with the location; and
determining a type of hypothetical object that may be located at the location based at least in part on the type of the environment,
and wherein determining the plurality of hypothetical objects that may be at the location within the environment is based at least in part on the type of hypothetical object.

### Claim 9 (depends on 5)

The method as recited in claim 5, further comprising:
determining a type of the environment associated with the location;
determining a type of hypothetical object that may be located at the location based at least in part on the type of the environment;
determining a first position associated with a first hypothetical object from the plurality of hypothetical objects based at least in part on the type of hypothetical object; and
determining a second position associated with a second hypothetical object from the plurality of hypothetical objects based at least in part on the type of hypothetical object.

### Claim 10 (depends on 5)

The method as recited in claim 5, wherein determining that at least some of the plurality of hypothetical objects are not located at the location comprises at least:
determining, based at least in part on the sensor data, that at least one sensor emission passes through the location without reflecting off a real object; and
determining that at least some of the plurality of hypothetical objects are not located at the location based at least in part on the sensor emission passing through the location without reflecting off the real object.

### Claim 11 (depends on 5)

The method as recited in claim 5, further comprising:
determining, based at least in part on the sensor data, an additional location of a real object within the environment;
determining that the additional location is along a path of the vehicle; and
determining that the location is also along the path of the vehicle and obstructed by the real object,
and wherein determining the plurality of hypothetical objects that may be at the location within the environment is based at least in part on the location also being along the path of the vehicle and obstructed by the real object.

### Claim 12 (depends on 5)

The method as recited in claim 5, further comprising:
determining an additional plurality of hypothetical objects that may be at an additional location within the environment;
determining, based at least in part on the sensor data, that at least one sensor emission passes through the additional location and reflects from a real object at the location; and
determining that the additional location is unobstructed by the additional plurality of hypothetical objects.

### Claim 13 (depends on 12)

The method as recited in claim 12, further comprising generating a map indicating at least:
the location within the environment is obstructed by the real object; and
the additional location within the environment is unobstructed.

### Claim 14 (depends on 5)

The method as recited in claim 5, further comprising:
determining an additional plurality of hypothetical objects that may be at an additional location within the environment, the additional location being farther from the vehicle than the location; and
determining, based at least in part on the sensor data, that at least one sensor emission does not pass through the location and to the additional location; and
determining, based at least in part on the at least one sensor emission not passing through the location and to the additional location, that one or more of the additional plurality of hypothetical objects may still be located at the additional location,
and wherein controlling the vehicle is further based at least in part on determining that the one or more of the additional plurality of hypothetical objects may still be located at the additional location.

### Claim 15 (depends on 5)

The method as recited in claim 5, wherein receiving the sensor data from the one or more sensors of the vehicle comprises receiving lidar data from one or more lidar sensors of the vehicle.

### Claim 16

One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:
determining a plurality of hypothetical objects that may be at a location within an environment;
receiving sensor data from one or more sensors of a vehicle;
determining, based at least in part on the sensor data, that at least some of the plurality of hypothetical objects are not located at the location; and
controlling the vehicle based at least in part on determining that the at least some of the plurality of hypothetical objects are not located at the location.

### Claim 17 (depends on 16)

The one or more non-transitory computer-readable media as recited in claim 16, the operations further comprising:
determining a hypothetical orientation for a hypothetical object from the plurality of hypothetical objects;
determining, based at least in part on the sensor data, a real orientation of a real object; and
updating, based at least in part on the real orientation, the location to include an additional location with the environment,
and wherein controlling the vehicle is based at least in part on the additional location.

### Claim 18 (depends on 16)

The one or more non-transitory computer-readable media as recited in claim 16, the operations further comprising:
determining a type of the environment associated with the location; and
determining a type of hypothetical object that may be located at the location based at least in part on the type of the environment,
and wherein determining the plurality of hypothetical objects that may be at the location within the environment is based at least in part on the type of hypothetical object.

### Claim 19 (depends on 16)

The one or more non-transitory computer-readable media as recited in claim 16, the operations further comprising:
determining a type of the environment associated with the location;
determining a type of hypothetical object that may be located at the location based at least in part on the type of the environment;
determining a first position associated with a first hypothetical object from the plurality of hypothetical objects based at least in part on the type of hypothetical object; and
determining a second position associated with a second hypothetical object from the plurality of hypothetical objects based at least in part on the type of hypothetical object.

### Claim 20 (depends on 16)

The one or more non-transitory computer-readable media as recited in claim 16, wherein determining that at least some of the plurality of hypothetical objects are not located at the location comprises at least:
determining, based at least in part on the sensor data, that at least one sensor emission passes through the location without reflecting off a real object; and
determining that at least some of the plurality of hypothetical objects are not located at the location based at least in part on the sensor emission passing through the location without reflecting off the real object.
