# US 2022/0032960 A1 · Game-theoretic planning for risk-aware interactive agents

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0032960 A1
- Document ID: US20220032960A1
- Status: Published application
- Kind: A1
- Application number: 16/942,560
- Filed: 2020-07-29
- Published: 2022-02-03
- Earliest claimed: 2020-07-29
- Assignees: Toyota Research Institute, Inc.; The Board of Trustees of the Leland Stanford Junior University
- Applicants: Toyota Research Institute, Inc.; The Board of Trustees of the Leland Stanford Junior University
- Inventors: Mingyu WANG; Negar ZAHEDI MEHR; Adrien David GAIDON; Mac SCHWAGER
- Web page: https://patentgrep.com/patent/US20220032960A1

## CPC

- G05D 1/0088: {characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours (using knowledge based models G06N5/00)}
- B60W 30/0956: {the prediction being responsive to traffic or environmental parameters}
- B60W 30/16: Control of distance between vehicles, e.g. keeping a distance to preceding vehicle
- B60W 30/18159: {Traversing an intersection}
- B60W 30/18163: {Lane change; Overtaking manoeuvres}
- B60W 60/0011: {involving control alternatives for a single driving scenario, e.g. planning several paths to avoid obstacles}
- B60W 60/0025: {specially adapted for specific operations}
- B60W 60/0027: {using trajectory prediction for other traffic participants}
- G01C 21/34: Route searching; Route guidance
- H04W 4/023: {using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds}
- H04W 4/029: Location-based management or tracking services
- B60W 30/0953: {the prediction being responsive to vehicle dynamic parameters}
- B60W 40/09: Driving style or behaviour
- B60W 2556/65: Data transmitted between vehicles
- G01C 21/3453: {Special cost functions, i.e. other than distance or default speed limit of road segments}
- G05D 1/0214: {in accordance with safety or protection criteria, e.g. avoiding hazardous areas (monitoring the location of vehicles within a certain area, e.g. forbidden or allowed areas, in traffic control systems for road vehicles G08G1/13)}
- H04W 4/40: for vehicles, e.g. vehicle-to-pedestrians [V2P]
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

A method for risk-aware game-theoretic trajectory planning is described. The method includes modeling an ego vehicle and at least one other vehicle as risk-aware agents in a game-theoretic driving environment. The method also includes ranking upcoming planned trajectories according to a risk-aware cost function of the ego vehicle and a risk-sensitivity of the other vehicle associated with each of the upcoming planned trajectories. The method further includes selecting a vehicle trajectory according to the ranking of the upcoming planned trajectories based on the risk-aware cost function and the risk-sensitivity of the other vehicle associated with each of the upcoming planned trajectories to reach a target destination according to a mission plan.

## Claims

### Claim 1

A method for risk-aware game-theoretic trajectory planning, the method comprising:
modeling an ego vehicle and at least one other vehicle as risk-aware agents in a game-theoretic driving environment;
ranking upcoming planned trajectories according to a risk-aware cost function of the ego vehicle and a risk-sensitivity of the other vehicle associated with each of the upcoming planned trajectories; and
selecting a vehicle trajectory according to the ranking of the upcoming planned trajectories based on the risk-aware cost function and the risk-sensitivity of the other vehicle associated with each of the upcoming planned trajectories to reach a target destination according to a mission plan.

### Claim 2 (depends on 1)

The method of claim 1, in which modeling comprises:
approximating a feedback Nash equilibria of a risk-aware game-theoretic trajectory planning;
deriving, at each iteration, a linearized approximation of system dynamics and a quadratic approximation of the risk-aware cost function; and
solving a backward recursion for finding the feedback Nash equilibria of the risk-aware game-theoretic trajectory planning.

### Claim 3 (depends on 1)

The method of claim 1, in which ranking the upcoming planned trajectories comprises:
computing risk-sensitive cost functions associated with the upcoming planned trajectories relative to the other vehicle; and
planning the vehicle trajectory of the ego vehicle based on the risk-sensitive cost functions associated with the planned trajectories relative to the other vehicle and the risk-sensitivity of the other vehicle.

### Claim 4 (depends on 3)

The method of claim 3, further comprising accelerating a speed of the ego vehicle to successfully merge into a target lane of a multilane roadway including the other vehicle.

### Claim 5 (depends on 3)

The method of claim 3, further comprising decelerating a speed of the ego vehicle to successfully merge into a target lane of a multilane roadway including the other vehicle.

### Claim 6 (depends on 5)

The method of claim 5, in which the ego vehicle is on an on-ramp of the multilane roadway and the target lane is a first lane of the multilane roadway.

### Claim 7 (depends on 1)

The method of claim 1, further comprising discarding an upcoming planned trajectory if the risk-aware cost function of the upcoming planned trajectory is greater than a predetermined value.

### Claim 8 (depends on 1)

The method of claim 1, further comprising discarding an upcoming planned trajectory if the risk-sensitivity of the other vehicle corresponding to the upcoming planned trajectory is less than a predetermined value.

### Claim 9 (depends on 1)

The method of claim 1, further comprising determining the risk-sensitivity of the other vehicle using vehicle-to-vehicle (V2V) communication between the ego vehicle and the other vehicle.

### Claim 10

A non-transitory computer-readable medium having program code recorded thereon for risk-aware game-theoretic trajectory planning, the program code being executed by a processor and comprising:
program code to model an ego vehicle and at least one other vehicle as risk-aware agents in a game-theoretic driving environment;
program code to rank upcoming planned trajectories according to a risk-aware cost function of the ego vehicle and a risk-sensitivity of the other vehicle associated with each of the upcoming planned trajectories; and
program code to select a vehicle trajectory according to the ranking of the upcoming planned trajectories based on the risk-aware cost function and the risk-sensitivity of the other vehicle associated with each of the upcoming planned trajectories to reach a target destination according to a mission plan.

### Claim 11 (depends on 10)

The non-transitory computer-readable medium of claim 10, in which the program code to model comprises:
program code to approximate a feedback Nash equilibria of the risk-aware game-theoretic trajectory planning;
program code to derive, at each iteration, a linearized approximation of system dynamics and a quadratic approximation of the risk-aware cost function; and
program code to solve a backward recursion for finding the feedback Nash equilibria of the risk-aware game-theoretic trajectory planning.

### Claim 12 (depends on 10)

The non-transitory computer-readable medium of claim 10, in which the program code to rank the upcoming planned trajectories comprises:
program code to compute risk-sensitive cost functions associated with the upcoming planned trajectories relative to the other vehicle; and
program code to plan the vehicle trajectory of the ego vehicle based on the risk-sensitive cost functions associated with the upcoming planned trajectories relative to the other vehicle and the risk-sensitivity of the other vehicle.

### Claim 13 (depends on 12)

The non-transitory computer-readable medium of claim 12, further comprising program code to accelerate a speed of the ego vehicle to successfully merge into a target lane of a multilane roadway including the other vehicle.

### Claim 14 (depends on 12)

The non-transitory computer-readable medium of claim 12, further comprising program code to decelerate a speed of the ego vehicle to successfully merge into a target lane of a multilane roadway including the other vehicle.

### Claim 15 (depends on 14)

The non-transitory computer-readable medium of claim 14, in which the ego vehicle is on an on-ramp of the multilane roadway and the target lane is a first lane of the multilane roadway.

### Claim 16 (depends on 10)

The non-transitory computer-readable medium of claim 10, further comprising program code to discard an upcoming planned trajectory if the risk-aware cost function of the upcoming planned trajectory is greater than a predetermined value and/or if the risk-sensitivity of the other vehicle corresponding to the upcoming planned trajectory is less than a predetermined value.

### Claim 17

A system for risk-aware game-theoretic trajectory planning, the system comprising:
a game-theoretic risk model configured to model an ego vehicle and at least one other vehicle as risk-aware agents in a game-theoretic driving environment;
a risk-aware cost function module configured to rank upcoming planned trajectories according to a risk-aware cost function of the ego vehicle and a risk-sensitivity of the other vehicle associated with each of the upcoming planned trajectories; and
a vehicle trajectory selection module configured to select a vehicle trajectory according to the ranking of the upcoming planned trajectories based on the risk-aware cost function and the risk-sensitivity of the other vehicle associated with each of the upcoming planned trajectories to reach a target destination according to a mission plan.

### Claim 18 (depends on 17)

The system of claim 17, further comprising an ego perception module to determine a current trajectory of the ego vehicle and the current trajectory of the other vehicle.

### Claim 19 (depends on 18)

The system of claim 18, further comprising a vehicle trajectory planner to plan the upcoming planned trajectories of the ego vehicle according to the current trajectory of the ego vehicle and the current trajectory of the other vehicle.

### Claim 20 (depends on 17)

The system of claim 17, in which the game-theoretic risk model is configured:
to approximate a feedback Nash equilibria of the risk-aware game-theoretic trajectory planning;
to derive, at each iteration, a linearized approximation of system dynamics and a quadratic approximation of the risk-aware cost function; and
to solve a backward recursion for finding the feedback Nash equilibria of the risk-aware game-theoretic trajectory planning.
