# US 2021/0173401 A1 · Human Supervision of an Automated Driving System

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0173401 A1
- Document ID: US20210173401A1
- Status: Published application
- Kind: A1
- Application number: 17/157,288
- Filed: 2021-01-25
- Published: 2021-06-10
- Earliest claimed: 2017-06-30
- Assignees: Uatc, LLC
- Applicants: Uatc, LLC
- Inventors: Noah Zych
- Web page: https://patentgrep.com/patent/US20210173401A1

## CPC

- G05D 1/0077: {using redundant signals or controls}
- G05D 1/0214: {in accordance with safety or protection criteria, e.g. avoiding hazardous areas (monitoring the location of vehicles within a certain area, e.g. forbidden or allowed areas, in traffic control systems for road vehicles G08G1/13)}
- B60W 50/082: {Selecting or switching between different modes of propelling}
- G05D 1/0088: {characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours (using knowledge based models G06N5/00)}
- G06Q 10/06315: {Needs-based resource requirements planning or analysis}
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

The present disclosure provides systems and methods that enable human supervision of a highly capable automated driving system. In particular, the systems and methods of the present disclosure enable a human (e.g., a passenger, driver/operator, or remote supervisor of an autonomous vehicle) to easily and quickly transition control of the autonomous vehicle from a primary motion plan that controls the vehicle towards a primary destination to a secondary motion plan that controls the vehicle to a safe state. As such, the systems and methods of the present disclosure enable advanced human supervision of autonomous vehicle behavior in which a human can cause an autonomous vehicle to operate in a risk-reduced manner or otherwise maneuver to a safe state, without requiring the human to actually assume manual control of the vehicle.

## Claims

### Claim at position 1

-20. (canceled)

### Claim 21

A computing system, comprising:
one or more processors; and
one or more non-transitory computer-readable media that collectively store instructions that, when executed by the one or more processors, cause the computing system to perform operations, the operations comprising:
receiving data representing a first motion plan for an autonomous vehicle and a second motion plan for the autonomous vehicle,
wherein the first motion plan is determined based at least in part on sensor data, and wherein the second motion plan is determined based at least in part on the sensor data and is separately determinable from the first motion plan;
prior to receiving an input from a passenger of the autonomous vehicle, issuing one or more first control signals to control the autonomous vehicle according to the first motion plan;
determining that the input is received from the passenger of the autonomous vehicle; and
in response to determining that the input is received, issuing one or more second control signals to abort the first motion plan and to control the autonomous vehicle according to the second motion plan.

### Claim 22 (depends on 21)

The computing system of claim 21, wherein the first motion plan controls the autonomous vehicle towards a first destination and the second motion plan controls the autonomous vehicle towards a second destination that is different than the first destination.

### Claim 23 (depends on 21)

The computing system of claim 21, wherein:
the second motion plan comprises an emergency motion plan; and
the input from the passenger of the autonomous vehicle comprises an input indicative of an emergency event.

### Claim 24 (depends on 21)

The computing system of claim 21, wherein:
the first motion plan is one of a plurality of first motion plans respectively for a plurality of time periods;
the second motion plan is one of a plurality of second motion plans respectively for the plurality of time periods;
issuing one or more first control signals comprises issuing the one or more first control signals to control the autonomous vehicle according to the first motion plans for each time period prior to receipt of the input from the passenger of the autonomous vehicle; and
issuing one or more second control signals comprises issuing the one or more second control signals to control the autonomous vehicle according to the second motion plans for each time period subsequent to receipt of the input from the passenger of the autonomous vehicle.

### Claim 25 (depends on 24)

The computing system of claim 24, wherein the plurality of second motion plans respectively control the autonomous vehicle to a plurality of different locations.

### Claim 26 (depends on 25)

The computing system of claim 25, wherein the input from the passenger corresponds to one of the plurality of different locations, and wherein the one or more second controls signals are issued to control the autonomous vehicle according to the second motion plan that corresponds to the input.

### Claim 27 (depends on 21)

The computing system of claim 21, wherein control of the autonomous vehicle according to the second motion plan brings the autonomous vehicle to rest while remaining within a current lane.

### Claim 28 (depends on 21)

The computing system of claim 21, wherein control of the autonomous vehicle according to the second motion plan causes the autonomous vehicle to exit a current lane.

### Claim 29 (depends on 21)

The computing system of claim 21, wherein the first motion plan is determined based at least in part on a first set of cost functions, and the second motion plan is determined based at least in part on a second set of cost functions.

### Claim 30 (depends on 21)

The computing system of claim 21, wherein the second motion plan controls the autonomous vehicle to a safe state.

### Claim 31 (depends on 30)

The computing system of claim 30, wherein the first motion plan comprises a first trajectory that moves the autonomous vehicle towards a first destination, and the second motion plan comprises a second trajectory that moves the autonomous vehicle to the safe state.

### Claim 32

An autonomous vehicle, the autonomous vehicle comprising:
one or more processors; and
one or more non-transitory computer-readable media that collectively store instructions that, when executed by the one or more processors, cause the one or more processors to perform operations, the operations comprising:
receiving data representing a first motion plan for the autonomous vehicle and a second motion plan for the autonomous vehicle, wherein the first motion plan is determined based at least in part on sensor data, and wherein the second motion plan is determined based at least in part on the sensor data and is separately determinable from the first motion plan;
prior to receiving an input from a passenger of the autonomous vehicle, issuing one or more first control signals to control the autonomous vehicle according to the first motion plan;
determining that the input is received from the passenger of the autonomous vehicle; and
in response to determining that the input is received, issuing one or more second control signals to abort the first motion plan and to control the autonomous vehicle according to the second motion plan.

### Claim 33 (depends on 32)

The autonomous vehicle of claim 32, wherein the first motion plan is determined via a first motion planning module and the second motion plan is determined via a second motion planning module.

### Claim 34 (depends on 32)

The autonomous vehicle of claim 32, wherein the second motion plan controls the autonomous vehicle to a safe state.

### Claim 35 (depends on 32)

The autonomous vehicle of claim 32, wherein:
the second motion plan comprises an emergency motion plan; and
the input from the passenger of the autonomous vehicle comprises an input indicative of an emergency event.

### Claim 36 (depends on 32)

The autonomous vehicle of claim 32, wherein the second motion plan is one of a plurality of second motion plans, wherein the plurality of second motion plans respectively control the autonomous vehicle to a plurality of different locations, and wherein the input from the passenger corresponds to one of the plurality of different locations.

### Claim 37 (depends on 32)

The autonomous vehicle of claim 32, wherein control of the autonomous vehicle according to the second motion plan brings the autonomous vehicle to rest while remaining within a current lane.

### Claim 38 (depends on 32)

The autonomous vehicle of claim 32, wherein control of the autonomous vehicle according to the second motion plan causes the autonomous vehicle to exit a flow of traffic.

### Claim 39 (depends on 32)

The autonomous vehicle of claim 32, wherein the first motion plan controls the autonomous vehicle towards a first destination and the second motion plan controls the autonomous vehicle towards a second destination that is different than the first destination.

### Claim 40

A computer implemented method implemented comprising:
receiving, by a computing system comprising one or more computing devices, data representing the first motion plan for an autonomous vehicle and the second motion plan for the autonomous vehicle,
wherein the first motion plan is determined based at least in part on sensor data, and wherein the second motion plan is determined based at least in part on the sensor data and is separately determinable from the first motion plan;
prior to receiving an input from a user of the autonomous vehicle, issuing one or more first control signals to control the autonomous vehicle according to the first motion plan;
determining that the input is received from the user of the autonomous vehicle; and
in response to determining that the input is received, issuing one or more second control signals to abort the first motion plan and to control the autonomous vehicle according to the second motion plan.
