# US 2024/0253667 A1 · Methods and systems for long-term trajectory prediction by extending a prediction horizon

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0253667 A1
- Document ID: US20240253667A1
- Status: Published application
- Kind: A1
- Application number: 18/160,385
- Filed: 2023-01-27
- Published: 2024-08-01
- Earliest claimed: 2023-01-27
- Assignees: Ford Global Technologies, LLC
- Applicants: Ford Global Technologies, LLC
- Inventors: Elena Corina Grigore; Andrew Hartnett; Jagjeet Singh; Constantin Savtchenko
- Web page: https://patentgrep.com/patent/US20240253667A1

## CPC

- B60W 60/0027: {using trajectory prediction for other traffic participants}
- B60W 40/04: Traffic conditions
- B60W 2554/80: Spatial relation or speed relative to objects
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT

## Abstract

Systems and methods for planning a trajectory for a vehicle are disclosed. The methods include generating first predicted states of an object in an environment of the vehicle at one or more first time steps during a first prediction horizon using a machine learning model and sensor data about the environment. The first predicted states are used as an input to a physical model to generate second predicted states of the object at one or more second time steps during a second prediction horizon where the one or more second time steps are after the one or more first time steps. A trajectory for the vehicle is generated using the first predicted states or the second predicted states of the object.

## Claims

### Claim 1

A method for planning a trajectory for a vehicle, the method comprising, by a processor:
generating, using a machine learning model and sensor data about an environment, first predicted states of an object at one or more first time steps during a first prediction horizon;
using the first predicted states of the object as an input to a physical model to generate second predicted states of the object at one or more second time steps during a second prediction horizon, the one or more second time steps being after the one or more first time steps; and
generating, using the first predicted states or the second predicted states of the object, the trajectory for the vehicle.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
receiving the sensor data; and
determining, based on the sensor data, one or more features of the object, the one or more features comprising past or current observed states of the object.

### Claim 3 (depends on 1)

The method of claim 1, wherein the first predicted states of the object comprise at least a predicted path of the object during the first prediction horizon.

### Claim 4 (depends on 1)

The method of claim 1, further comprising selecting, based on one or more features of the object, the physical model from a plurality of physical models.

### Claim 5 (depends on 1)

The method of claim 1, wherein the first prediction horizon is about 4-12 seconds.

### Claim 6 (depends on 1)

The method of claim 1, wherein the second prediction horizon is about 8-15 seconds.

### Claim 7 (depends on 1)

The method of claim 1, further comprising determining a reference path for the object.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
selectively disabling the machine learning model; and
generating, using the physical model and sensor data about an environment, a third predicted state of the object.

### Claim 9 (depends on 1)

The method of claim 1, wherein the machine learning model is a deep learning model.

### Claim 10

A system for planning a trajectory for a vehicle, the system comprising:
at least one processor;
programming instructions stored in a memory and configured to cause the processor to:
generate, using a machine learning model and sensor data about an environment, first predicted states of an object at one or more first time steps during a first prediction horizon;
use the first predicted states of the object as an input to a physical model to generate second predicted states of the object at one or more second time steps during a second prediction horizon, the one or more second time steps being after the one or more first time steps; and
generate, using the first predicted states or the second predicted states of the object, the trajectory for the vehicle.

### Claim 11 (depends on 10)

The system of claim 10, further comprising programming instructions configured to cause the processor to:
receive the sensor data; and
determine, based on the sensor data, one or more features of the object, the one or more features comprising past or current observed states of the object.

### Claim 12 (depends on 10)

The system of claim 10, wherein the first predicted states of the object comprise at least a predicted path of the object during the first prediction horizon.

### Claim 13 (depends on 10)

The system of claim 10, further comprising programming instructions configured to cause the processor to select, based on one or more features of the object, the physical model from a plurality of physical models.

### Claim 14 (depends on 10)

The system of claim 10, wherein the first prediction horizon is about 4-12 seconds.

### Claim 15 (depends on 10)

The system of claim 10, wherein the second prediction horizon is about 8-15 seconds.

### Claim 16 (depends on 10)

The system of claim 10, further comprising programming instructions configured to cause the processor to determine a reference path for the object.

### Claim 17 (depends on 10)

The system of claim 10, further comprising programming instructions configured to cause the processor to:
selectively disable the machine learning model; and
generate, using the physical model and sensor data about an environment, a third predicted state of the object.

### Claim 18 (depends on 10)

The system of claim 10, wherein the machine learning model is a deep learning model.

### Claim 19

A computer program product comprising a non-transitory computer-readable medium that stores instructions that, when executed by a computing device, will cause the computing device to perform operations comprising:
generating, using a machine learning model and sensor data about an environment, first predicted states of an object at one or more first time steps during a first prediction horizon;
using the first predicted states of the object as an input to a physical model to generate second predicted states of the object at one or more second time steps during a second prediction horizon, the one or more second time steps being after the one or more first time steps; and
generating, using the first predicted states or the second predicted states of the object, a trajectory for a vehicle.

### Claim 20 (depends on 19)

The computer program product of claim 19, further comprising instructions to perform operations comprising:
receiving the sensor data; and
determining, based on the sensor data, one or more features of the object, the one or more features comprising past or current observed states of the object.
