# US 2021/0197798 A1 · Action-based reference systems for vehicle control

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0197798 A1
- Document ID: US20210197798A1
- Status: Published application
- Kind: A1
- Application number: 16/732,087
- Filed: 2019-12-31
- Published: 2021-07-01
- Earliest claimed: 2019-12-31
- Assignees: Zoox, Inc.
- Applicants: Zoox, Inc.
- Inventors: Joseph Funke; Steven Cheng Qian; Marin Kobilarov
- Web page: https://patentgrep.com/patent/US20210197798A1

## CPC

- B60W 30/06: Automatic manoeuvring for parking
- G05D 1/0212: {with means for defining a desired trajectory (involving a plurality of land vehicles G05D1/0287)}
- B62D 15/0285: {Parking performed automatically}
- G01C 21/16: by integrating acceleration or speed, i.e. inertial navigation
- G01C 21/3461: {Preferred or disfavoured areas, e.g. dangerous zones, toll or emission zones, intersections, manoeuvre types or segments such as motorways, toll roads or ferries}
- G05D 1/0214: {in accordance with safety or protection criteria, e.g. avoiding hazardous areas (monitoring the location of vehicles within a certain area, e.g. forbidden or allowed areas, in traffic control systems for road vehicles G08G1/13)}
- G05D 1/027: {comprising intertial navigation means, e.g. azimuth detector (inertial navigation G01C21/16; inertial navigation combined with non-inertial navigation instruments G01C21/165)}
- G08G 1/141: {with means giving the indication of available parking spaces}
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- B62D: MOTOR VEHICLES; TRAILERS (steering, or guiding on a desired track, of agricultural machines or implements A01B69/00; wheels, castors, axles, increasing wheel adhesion B60B; vehicle tyres, tyre inflation or tyre changing B60C; connections between vehicles of a train or the like B60D; vehicles for use on rail and road, amphibious or convertible vehicles B60F; suspension arrangements B60G; heating, cooling, ventilating or other air treating devices B60H; windows, windscreens, non-fixed roofs, doors or similar devices, protective coverings for vehicles not in use B60J; propulsion plant arrangements, auxiliary drives, transmissions, controls, instrumentation or dashboards B60K; electric equipment or propulsion of electrically-propelled vehicles B60L; power supply for electrically-propelled vehicles B60M; passenger accommodation not otherwise provided for B60N; adaptations for load transportation or to carry special loads or objects B60P; arrangement of signalling or lighting devices, the mounting or supporting thereof or circuits therefor, for vehicles in general B60Q; vehicles, vehicle fittings or vehicle parts not otherwise provided for B60R; servicing, cleaning, repairing, supporting, lifting, or manoeuvring, not otherwise provided for, B60S; brake arrangements, brake control systems or parts thereof B60T; air-cushion vehicles B60V; motor-cycles, accessories therefor B62J, B62K; testing of vehicles G01M)
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})

## Abstract

Techniques for controlling a vehicle on and off a route structure in an environment are discussed herein. A vehicle computing system controls the vehicle along a route based on a route-based reference system. The vehicle computing system may determine to operate off the route, such as to operate in reverse, park, etc. The vehicle computing system may modify vehicle operations to an inertial-based reference system to navigate to a location off the route. The vehicle computing system may determine a vehicle trajectory to the location off the route based on a reference trajectory between a location on the route and the location off the route and a corridor associated therewith. The vehicle computing system may transition between the route-based reference system and the inertial-based reference system, based on a determination to operate on or off the route.

## Claims

### Claim 1

An autonomous vehicle comprising:
a sensor;
one or more processors; and
one or more computer-readable media storing instructions that, when executed by the one or more processors, cause the autonomous vehicle to perform operations comprising:
controlling the autonomous vehicle through an environment based at least in part on a route to a destination, wherein the autonomous vehicle is controlled based at least in part on a route-based reference system;
determining that the autonomous vehicle operating on the route is within a threshold distance of the destination;
identifying, based at least in part on sensor data from the sensor, a stopping location for a vehicle cease forward movement, wherein the stopping location is located off the route and satisfies a condition for stopping;
determining an initial location associated with initiating a stopping action, wherein the initial location is associated with the route;
determining a vehicle trajectory from the initial location to the stopping location, wherein the vehicle trajectory is determined based at least in part on an inertial-based reference system;
determining that the autonomous vehicle is within a threshold distance of the initial location; and
based at least in part on the autonomous vehicle being within the threshold distance, controlling the vehicle based at least in part on an inertial-based reference system and the vehicle trajectory.

### Claim 2 (depends on 1)

The autonomous vehicle of claim 1, wherein determining the vehicle trajectory comprises:
determining a reference trajectory between the initial location and the stopping location; and
determining, based at least in part on the reference trajectory, a corridor between the initial location and the stopping location, the corridor indicative of a region of drivable surfaces on either side of the reference trajectory;
wherein the vehicle trajectory comprises an optimized trajectory determined based at least in part on the reference trajectory and the corridor.

### Claim 3 (depends on 2)

The autonomous vehicle of claim 2, wherein the reference trajectory is determined based at least in part on at least one of:
a Bezier curve;
a series of clothoids; or
a cubic spline curve.

### Claim 4 (depends on 2)

The autonomous vehicle of claim 2, wherein determining the corridor comprises:
identifying a first area on a first side of the reference trajectory, the first area extending a distance in a first direction from the reference trajectory from the initial location toward the stopping location;
identifying a second area on a second side of the reference trajectory, the second area extending the distance in a second direction from the reference trajectory from the initial location toward the stopping location; and
performing at least one of:
based at least in part on determining that an object is located in at least one of the first area or the second area, removing a section of the at least one of the first area or the second area, wherein the section is associated with the object and the corridor comprises the first area and the second area with the section removed; or
based at least in part on determining that the object is not located in the at least one of the first area or the second area, determining that the corridor comprises the first area and the second area.

### Claim 5 (depends on 1)

The autonomous vehicle of claim 1, wherein the threshold distance is a first threshold distance and wherein the condition comprises at least one of:
the stopping location being within a second threshold distance of the destination;
the stopping location being clear of objects; or
a length and a width of the stopping location being visible to the autonomous vehicle.

### Claim 6

A method comprising:
determining a first location associated with a vehicle following a first trajectory, the first trajectory based at least in part on a route associated with a first reference system associated with a route-based reference system;
identifying a second location for the vehicle to move in an environment, the second location being unassociated with the route;
determining that a condition associated with controlling the vehicle off the route to the second location is satisfied; and
determining, based at least in part on the condition being satisfied, a second trajectory from the first location to the second location, wherein the vehicle trajectory is determined based at least in part on a second reference system associated with an inertial-based reference system.

### Claim 7 (depends on 6)

The method of claim 6, further comprising:
controlling the vehicle based at least in part on the vehicle trajectory and the second reference system.

### Claim 8 (depends on 6)

The method of claim 6, wherein determining the vehicle trajectory comprises:
determining a reference trajectory between the first location and the second location; and
determining, based at least in part on the reference trajectory, a corridor between the first location and the second location, the corridor indicative of a drivable surface on either side of the reference trajectory,
wherein the vehicle trajectory comprises an optimized trajectory determined based at least in part on the reference trajectory and the corridor.

### Claim 9 (depends on 8)

The method of claim 8, wherein determining the corridor comprises:
identifying a first area on a first side of the reference trajectory, the first area extending a distance in a first direction from the reference trajectory from the first location toward the second location;
identifying a second area on a second side of the reference trajectory, the second area extending the distance in a second direction from the reference trajectory from the first location toward the second location;
receiving sensor data from a sensor associated with the vehicle; and
performing at least one of:
determining, based at least in part on the sensor data, that an object is located in at least one of the first area or the second area; and
based at least in part on determining that he object is located in the at least one of the first area or the second area, removing a section of the at least one of the first area or the second area, wherein the section is associated with the object and the corridor comprises the first area and the second area with the section removed; or
determining, based at least in part on the sensor data, that the object is not located in the at least one of the first area or the second area; and
based at least in part on determining that the object is not located in the at least one of the first area or the second area, determining that the corridor comprises the first area and the second area.

### Claim 10 (depends on 8)

The method of claim 8, wherein the reference trajectory is determined based at least in part on at least one of:
a Bezier curve;
a series of clothoids; or
a cubic spline curve.

### Claim 11 (depends on 6)

The method of claim 6, wherein the condition is satisfied at a first time, the method further comprising:
determining a first cost associated with the second trajectory;
determining a third trajectory associated with the vehicle continuing along the route based at least in part on the first reference system;
determining a second cost associated with the third trajectory;
determining that the second cost is less than the second cost; and
controlling the vehicle based at least in part on the third trajectory and the first reference system.

### Claim 12 (depends on 6)

The method of claim 6, further comprising:
determining a first cost associated with the first trajectory, wherein the first trajectory is associated with a route-based action;
determining a second cost associated with the second trajectory, wherein the second trajectory is associated with an off-route action;
determining that the second cost is less than the first cost; and
controlling the vehicle based at least in part on the second trajectory based at least in part on determining that the second cost is less than the first cost.

### Claim 13 (depends on 12)

The method of claim 12, wherein the off-route action comprises at least one of:
a reversing action;
a parking action;
a pull-over action; or
a return to route action.

### Claim 14 (depends on 6)

The method of claim 6, wherein determining that the condition is satisfied comprises at least one of:
determining that the vehicle is within a first threshold distance of the second location;
determining that the second location is within a second threshold distance of a destination;
determining that the second location is clear of objects; or
determining that the second location is visible to the vehicle.

### Claim 15

One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause one or more computing devices to perform operations comprising:
determining a first location associated with a vehicle operating on a route in an environment, the route based at least in part on a first reference system associated with a route-based reference system;
determining a second location for the vehicle to move in the environment, the second location being unassociated with the route;
determining that a condition associated with controlling the vehicle to move to the second location is satisfied; and
determining, based at least in part on the condition being satisfied, a vehicle trajectory from the first location to the second location, wherein the vehicle trajectory is determined based at least in part on a second reference system associated with an inertial-based reference system.

### Claim 16 (depends on 15)

The one or more non-transitory computer-readable media of claim 15, wherein determining that the condition is satisfied comprises at least one of:
determining that the vehicle is within a first threshold distance of the second location;
determining that the second location is within a second threshold distance of a destination;
determining that the second location is clear of objects; or
determining that the second location is visible to the vehicle.

### Claim 17 (depends on 15)

The one or more non-transitory computer-readable media of claim 15, wherein the second location is identified at a first time, the operations further comprising:
receiving sensor data from a sensor associated with the vehicle;
determining, at a second time after the first time, an object in the environment at a location proximate the second location;
determining an object trajectory associated with the object;
determining, based at least in part on the object trajectory, that the object will be within a threshold distance of the second location at a third time after the second time;
determining, based at least in part on determining that the object will be within the threshold distance at the third time, that the condition is not satisfied; and
controlling the vehicle based at least in part on the route-based reference system.

### Claim 18 (depends on 17)

The one or more non-transitory computer-readable media of claim 17, wherein the vehicle trajectory is a first vehicle trajectory, the operations further comprising:
determining that the vehicle is proximate a third location on the route;
identifying a fourth location for the vehicle to move off the route;
determining that the fourth location satisfies the condition;
determining a second trajectory between the third location and the fourth location, the second trajectory being based at least in part on the inertial-based reference system; and
controlling the vehicle to the fourth location based at least in part on the second trajectory.

### Claim 19 (depends on 15)

The one or more non-transitory computer-readable media of claim 15, wherein determining the vehicle trajectory comprises:
determining a reference trajectory between the first location and the second location; and
determining, based at least in part on the reference trajectory, a corridor between the first location and the second location,
wherein the vehicle trajectory comprises an optimized trajectory determined based at least in part on the reference trajectory and the corridor.

### Claim 20 (depends on 19)

The one or more non-transitory computer-readable media of claim 19, wherein the reference trajectory is determined based at least in part on at least one of:
a cubic spline curve;
a Bezier curve; or
a series of clothoids.
