# US 2018/0322650 A1 · Systems and Methods to Track Vehicles Proximate Perceived By an Autonomous Vehicle

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0322650 A1
- Document ID: US20180322650A1
- Status: Published application
- Kind: A1
- Application number: 16/039,864
- Filed: 2018-07-19
- Published: 2018-11-08
- Earliest claimed: 2017-03-30
- Assignees: Uber Technologies, Inc.
- Applicants: Uber Technologies, Inc.
- Inventors: Brian C. Becker; J. Andrew Bagnell; Arunprasad Venkatraman; Karthik Lakshmanan
- Web page: https://patentgrep.com/patent/US20180322650A1

## CPC

- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- G06T 7/277: involving stochastic approaches, e.g. using Kalman filters
- G06T 7/60: Analysis of geometric attributes
- G06V 10/457: {by analysing connectivity, e.g. edge linking, connected component analysis or slices}
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G08B 13/19608: {Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position}
- G06T 2207/20084: Artificial neural networks [ANN]
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS

## Abstract

The present disclosure provides systems and methods for tracking vehicles or other objects that are perceived by an autonomous vehicle. A vehicle filter can employ a motion model that models the location of the tracked vehicle using a vehicle bounding shape and an observation model that generates an observation bounding shape from sensor observations. A dominant vertex or side from each respective bounding shape can be identified and used to update or otherwise correct one or more predicted shape locations associated with the vehicle bounding shape based on a shape location associated with the observation bounding shape.

## Claims

### Claim at position 1

-20. (canceled)

### Claim 21

A computer-implemented method for tracking vehicles that are perceived by an autonomous vehicle, the method comprising:
obtaining, by one or more computing devices included in the autonomous vehicle, state data descriptive of a previous state of a tracked vehicle that is perceived by the autonomous vehicle, wherein the previous state of the tracked vehicle comprises at least one previous location of the tracked vehicle or a vehicle bounding shape associated with the tracked vehicle;
predicting, by the one or more computing devices, one or more first locations for a first portion of the vehicle bounding shape based at least in part on the state data;
obtaining, by the one or more computing devices, observation data descriptive of one or more sensor observations;
determining, by the one or more computing devices, a second location of a second portion of an observation bounding shape associated with the tracked vehicle based at least in part on the observation data; and
determining, by the one or more computing devices, at least one estimated current location of the first portion of the vehicle bounding shape associated with the tracked vehicle based at least in part on a comparison of the one or more first locations for the first portion of the vehicle bounding shape to the second location of the second portion of the observation bounding shape.

### Claim 22 (depends on 21)

The computer-implemented method of claim 21, wherein determining, by the one or more computing devices, the at least one estimated current location of the first portion of the vehicle bounding shape associated with the tracked vehicle comprises assigning, by the one or more computing devices, a respective weight to each of the one or more first locations based at least in part on the comparison of the one or more first locations for the vehicle bounding shape to the second location of the observation bounding shape, the respective weight assigned to each first location indicative of an amount of agreement between such first location and the second location of the observation bounding shape.

### Claim 23 (depends on 21)

The computer-implemented method of claim 21, wherein predicting, by the one or more computing devices, the one or more first locations for the first portion of the vehicle bounding shape comprises:
predicting, by the one or more computing devices, one or more first shape locations for the vehicle bounding shape; and
respectively identifying, by the one or more computing devices, a nearest unoccluded vertex of each of the one or more first shape locations.

### Claim 24 (depends on 23)

The computer-implemented method of claim 23, wherein predicting, by the one or more computing devices, the one or more first locations for the first portion of the vehicle bounding shape further comprises, for each of the one or more first shape locations:
identifying, by the one or more computing devices, a dominant side that includes the nearest unoccluded vertex and corresponds to a length of the tracked vehicle.

### Claim 25 (depends on 23)

The computer-implemented method of claim 23, wherein respectively identifying, by the one or more computing devices, the nearest unoccluded vertex of each of the one or more first shape locations comprises:
obtaining, by the one or more computing devices, an occlusion map that describes occluded and unoccluded areas; and
for each of the one or more first shape locations, iteratively analyzing, by the one or more computing devices, in order of proximity to the autonomous vehicle, one or more nearest vertices of such bounding shape relative to the occlusion map until an unoccluded vertex is identified.

### Claim 26 (depends on 23)

The computer-implemented method of claim 23, wherein the method further comprises:
when the respective nearest unoccluded vertex cannot be identified for one of the first shape locations:
selecting, by the one or more computing devices, a nearest occluded vertex; and
increasing, by the one or more computing devices, a covariance value associated with the vehicle bounding shape.

### Claim 27 (depends on 21)

The computer-implemented method of claim 21, wherein:
obtaining, by the one or more computing devices, the observation data descriptive of the one or more sensor observations comprises obtaining, by the one or more computing devices, the observation data descriptive of a plurality of observed points; and
determining, by the one or more computing devices, the second location of the second portion of the observation bounding shape comprises fitting, by the one or more computing devices, the observation bounding shape around the plurality of observed points such that the fitted observation bounding shape includes all of the plurality of observed points and minimizes a collective distance from the plurality of points to respective closest sides of the observation bounding shape.

### Claim 28 (depends on 21)

The computer-implemented method of claim 21, wherein determining, by the one or more computing devices, the second location of the second portion of the observation bounding shape associated with the tracked vehicle comprises:
identifying, by the one or more computing devices, the second vertex that corresponds to the first vertex of the vehicle bounding polygon; and
selecting, by the one or more computing devices, the second side for the observation bounding shape that includes the second vertex and is closest in orientation to a predicted heading associated with at least one of the one or more first shape locations.

### Claim 29 (depends on 21)

The computer-implemented method of claim 21, wherein:
the vehicle bounding shape has a first size defined by one or more first values respectively for one or more size parameters;
the observation bounding shape has a second size defined by one or more second values respectively for the one or more size parameters; and
the method further comprises:
comparing, by the one or more computing devices, the second value for each size parameter to the first value for such size parameter; and
for at least one size parameter for which the second value is greater than the first value, updating, by the one or more computing devices, the first value for such size parameter to equal the second value.

### Claim 30 (depends on 29)

The computer-implemented method of claim 29, wherein the vehicle bounding shape comprises a vehicle bounding rectangle, the observation bounding shape comprises an observation bounding rectangle, and the one or more size parameters comprise a width and a length.

### Claim 31 (depends on 21)

The computer-implemented method of claim 21, wherein the first portion of the vehicle bounding shape comprises a first vertex or a first side of the vehicle bounding shape.

### Claim 32 (depends on 31)

The computer-implemented method of claim 31, wherein the second portion of the observation bounding shape comprises a second vertex or a second side of the observation bounding shape.

### Claim 33

A computer system, comprising:
one or more processors; and
one or more non-transitory computer-readable media that collectively store instructions that, when executed by the one or more processors, cause the computer system to perform operations, the operations comprising:
predicting, by the one or more computing devices, one or more first shape locations for a vehicle bounding shape associated with a tracked vehicle that is perceived by an autonomous vehicle;
identifying, by the one or more computing devices, a first dominant portion for each of the one or more first shape locations predicted for the vehicle bounding shape;
obtaining, by the one or more computing devices, observation data descriptive of one or more sensor observations;
determining, by the one or more computing devices, a second shape location for an observation bounding shape associated with the tracked vehicle based at least in part on the observation data;
identifying, by the one or more computing devices, a second dominant portion for the observation bounding shape; and
determining, by the one or more computing devices, at least one estimated shape location for the vehicle bounding shape based at least in part on a comparison of a first location of the first dominant portion for each of the one or more first shape locations to a second location of the second dominant portion for the observation bounding shape.

### Claim 34 (depends on 33)

The computer system of claim 33, wherein determining, by the one or more computing devices, the at least one estimated shape location for the vehicle bounding shape based at least in part on the comparison of the first location of the first dominant portion for each of the one or more first shape locations to the second location of the second dominant portion for the observation bounding shape comprises assigning, by the one or more computing devices, a respective weight to each of the one or more first shape locations based at least in part on the comparison, the respective weight assigned to each first shape location indicative of an amount of agreement between the first location of the first dominant portion identified for such first shape location and the second location of the second dominant portion for the observation bounding shape.

### Claim 35 (depends on 33)

The computer system of claim 33, wherein identifying, by the one or more computing devices, the first dominant portion for each of the one or more first shape locations predicted for the vehicle bounding shape comprises identifying, by the one or more computing devices, a nearest unoccluded vertex for each of the one or more first shape locations.

### Claim 36 (depends on 33)

The computer system of claim 33, wherein the operations further comprise:
identifying, by the one or more computing devices, a first dominant side for each of the one or more first shape locations predicted for the vehicle bounding shape; and
identifying, by the one or more computing devices, a second dominant side for the observation bounding shape;
wherein determining, by the one or more computing devices, the at least one estimated shape location for the vehicle bounding shape based at least in part on the comparison comprises determining, by the one or more computing devices, the at least one estimated shape location for the vehicle bounding shape based at least in part on the comparison and further based at least in part on a second comparison of a first orientation of the first dominant side for each of the one or more first shape locations to a second orientation of the second dominant side for the observation bounding shape.

### Claim 37 (depends on 36)

The computer system of claim 36, wherein identifying, by the one or more computing devices, the second dominant side for the observation bounding shape comprises identifying, by the one or more computing devices, the second dominant side that includes the second dominant portion and has the second orientation that is closest to an expected heading.

### Claim 38

An autonomous vehicle, comprising:
a tracking system configured to track vehicles perceived by the autonomous vehicle, wherein the tracking system comprises:
a motion model configured to predict one or more first shape locations for a vehicle bounding shape associated with a tracked vehicle; and
an observation model configured to provide a second shape location of an observation bounding shape associated with the tracked vehicle based at least in part on observation data derived from one or more sensors;
one or more processors; and
one or more non-transitory computer-readable media that collectively store instructions that, when executed by the one or more processors, cause the one or more processors to perform operations, the operations comprising:
identifying a first dominant portion for each of the one or more first shape locations predicted for the vehicle bounding shape;
identifying a second dominant portion for the observation bounding shape;
performing, for each of the one or more first shape locations, a comparison of the first dominant portion to the second dominant portion; and
determining at least one estimated current location of the first dominant portion for the vehicle bounding shape based at least in part on the comparison.

### Claim 39 (depends on 38)

The autonomous vehicle of claim 38, wherein:
the motion model comprises a machine-learned motion model; and
the observation model comprises a machine-learned observation model.

### Claim 40 (depends on 38)

The autonomous vehicle of claim 38, wherein at least one of the motion model and the observation model comprises a boosted random forest model.
