# US 2021/0078593 A1 · Operation of an autonomous vehicle based on availability of navigational information

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0078593 A1
- Document ID: US20210078593A1
- Status: Published application
- Kind: A1
- Application number: 17/008,311
- Filed: 2020-08-31
- Published: 2021-03-18
- Earliest claimed: 2019-09-12
- Assignees: Motional AD LLC
- Applicants: Motional Ad LLC
- Inventors: Jong Ho LEE; Rahul AHLUWALIA; Jonathan WIESKAMP
- Web page: https://patentgrep.com/patent/US20210078593A1

## CPC

- B60W 60/001: {Planning or execution of driving tasks}
- G01S 19/485: {whereby the further system is an optical system or imaging system}
- B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention
- B60W 60/0053: {from vehicle to occupant}
- G01C 21/3407: {specially adapted for specific applications}
- G01C 21/3492: {employing speed data or traffic data, e.g. real-time or historical (traffic control systems for road vehicles involving transmission of navigation instructions to the vehicle G08G1/0968)}
- G01C 21/3833: {characterised by the source of data}
- G01C 21/3837: {Data obtained from a single source}
- G05D 1/0011: {associated with a remote control arrangement}
- G05D 1/223: Command input arrangements on the remote controller, e.g. joysticks or touch screens
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- B60W 2420/408: Radar; Laser, e.g. lidar
- B60W 2555/00: Input parameters relating to exterior conditions, not covered by groups B60W2552/00, B60W2554/00
- B60W 2556/40: High definition maps
- B60W 2556/50: of positioning data, e.g. GPS [Global Positioning System] data
- G01S 19/42: Determining position
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

The subject matter described in this specification is directed to a computer system and techniques for operating an autonomous vehicle (AV) based on the availability of navigation information. In one example, while the AV is in an autonomous mode, first data is obtained from a first sensor and second data is obtained from a second sensor. A location of the AV is determined based on the first data and the second data. If navigational information is not available for the determined location, an alert is provided that the AV will exit the autonomous mode.

## Claims

### Claim 1

A system comprising:
one or more computer processors; and
one or more non-transitory storage media storing instructions which, when executed by the one or more computer processors, cause performance of operations comprising:
while a vehicle is operating in an autonomous mode:
obtaining first data from a first sensor;
obtaining second data from a second sensor;
determining a location based on the first data obtained from the first sensor and the second data obtained from the second sensor;
in accordance with a determination that navigational information is not available for the determined location, providing an alert that the vehicle will exit the autonomous mode; and
in accordance with a determination that the navigational information is available for the determined location, forgoing providing the alert that the vehicle will exit the autonomous mode.

### Claim 2 (depends on 1)

The system of claim 1, wherein the instructions further cause performance of operations comprising:
in accordance with the determination that the navigational information is available for the determined location, navigating the vehicle based at least in part on the first data and the second data.

### Claim 3 (depends on 1)

The system of claim 1, wherein the instructions further cause performance of operations comprising:
in accordance with a determination that navigational information is not available for the determined location, navigating the vehicle without the second data from the second sensor.

### Claim 4 (depends on 1)

The system of claim 1, wherein navigational information is not available for the determined location when the determined location corresponds to a region without a semantic map.

### Claim 5 (depends on 1)

The system of claim 1, wherein the instructions further cause performance of operations comprising:
after providing the alert that the vehicle will exit the autonomous mode:
ceasing the autonomous mode; and
initiating an operator assisted mode.

### Claim 6 (depends on 5)

The system of claim 5, wherein the instructions further cause performance of operations comprising:
while the vehicle is operating in the operator assisted mode:
receiving one or more commands for navigating the vehicle from a navigation system remote from the vehicle.

### Claim 7 (depends on 5)

The system of claim 5, wherein the instructions further cause performance of operations comprising:
while the vehicle is operating in the operator assisted mode:
capturing one or more features of the environment surrounding the vehicle; and
providing the one or more captured features to a server to update a semantic map of the environment.

### Claim 8 (depends on 5)

The system of claim 5, wherein the instructions further cause performance of operations comprising:
while the vehicle is operating in the operator assisted mode:
obtaining third data from the first sensor;
obtaining fourth data from the second sensor;
determining a second location based on the third data obtained from the first sensor and the fourth data obtained from the second sensor;
in accordance with a determination that navigational information is not available for the determined second location:
maintaining the operator assisted mode; and
in accordance with a determination that the navigational information is available for the determined second location:
ceasing the operator assisted mode; and
initiating the autonomous mode.

### Claim 9 (depends on 1)

The system of claim 1, wherein the instructions further cause performance of operations comprising:
after providing the alert that the vehicle will exit the autonomous mode:
in accordance with a determination that operator control is detected:
initiating an operator assisted mode; and
in accordance with a determination that no operator control is detected:
maintaining the autonomous mode; and
navigating the vehicle based on a safe trajectory.

### Claim 10 (depends on 9)

The system of claim 9, wherein the safe trajectory has a destination at a safe stop location where navigational information is available.

### Claim 11 (depends on 1)

The system of claim 1, wherein the location determined based on the first data obtained from the first sensor and the second data obtained from the second sensor is a predicted future location of the vehicle.

### Claim 12

A method, comprising:
while a vehicle is operating in an autonomous mode:
obtaining first data from a first sensor;
obtaining second data from a second sensor;
determining a location based on the first data obtained from the first sensor and the second data obtained from the second sensor;
in accordance with a determination that navigational information is not available for the determined location, providing an alert that the vehicle will exit the autonomous mode; and
in accordance with a determination that the navigational information is available for the determined location, forgoing providing the alert that the vehicle will exit the autonomous mode.

### Claim 13 (depends on 12)

The method of claim 12, further comprising:
in accordance with the determination that the navigational information is available for the determined location, navigating the vehicle based at least in part on the first data and the second data.

### Claim 14 (depends on 12)

The method of claim 12, further comprising:
in accordance with a determination that navigational information is not available for the determined location, navigating the vehicle without the second data from the second sensor.

### Claim 15 (depends on 12)

The method of claim 12, wherein navigational information is not available for the determined location when the determined location corresponds to a region without a semantic map.

### Claim 16 (depends on 12)

The method of claim 12, further comprising:
after providing the alert that the vehicle will exit the autonomous mode:
ceasing the autonomous mode; and
initiating an operator assisted mode.

### Claim 17 (depends on 16)

The method of claim 16, further comprising:
while the vehicle is operating in the operator assisted mode:
receiving one or more commands for navigating the vehicle from a navigation system remote from the vehicle.

### Claim 18 (depends on 16)

The method of claim 16, further comprising:
while the vehicle is operating in the operator assisted mode:
capturing one or more features of the environment surrounding the vehicle; and
providing the one or more captured features to a server to update a semantic map of the environment.

### Claim 19 (depends on 12)

The method of claim 12, further comprising:
after providing the alert that the vehicle will exit the autonomous mode:
in accordance with a determination that operator control is detected:
initiating an operator assisted mode; and
in accordance with a determination that no operator control is detected:
maintaining the autonomous mode; and
navigating the vehicle based on a safe trajectory.

### Claim 20

One or more non-transitory storage media storing instructions which, when executed by one or more computing devices, cause performance of operations comprising:
while a vehicle is operating in an autonomous mode:
obtaining first data from a first sensor;
obtaining second data from a second sensor;
determining a location based on the first data obtained from the first sensor and the second data obtained from the second sensor;
in accordance with a determination that navigational information is not available for the determined location, providing an alert that the vehicle will exit the autonomous mode; and
in accordance with a determination that the navigational information is available for the determined location, forgoing providing the alert that the vehicle will exit the autonomous mode.
