# US 2025/0083690 A1 · Systems and Methods for Validating a Localization System of an Autonomous Vehicle

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0083690 A1
- Document ID: US20250083690A1
- Status: Published application
- Kind: A1
- Application number: 18/463,998
- Filed: 2023-09-08
- Published: 2025-03-13
- Earliest claimed: 2023-09-08
- Assignees: Aurora Operations, Inc.
- Applicants: Aurora Operations, Inc.
- Inventors: Michael Samples; Robert Michael Zlot
- Web page: https://patentgrep.com/patent/US20250083690A1

## CPC

- B60W 60/001: {Planning or execution of driving tasks}
- B60W 50/0205: {Diagnosing or detecting failures; Failure detection models}
- G07C 5/04: using counting means or digital clocks
- B60W 2050/0215: {Sensor drifts or sensor failures}
- B60W 2420/408: Radar; Laser, e.g. lidar
- B60W 2520/10: Longitudinal speed
- B60W 2556/40: High definition maps
- B60W 2556/50: of positioning data, e.g. GPS [Global Positioning System] data
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G07C: TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE

## Abstract

A localization system can be validated by: obtaining log data descriptive of a plurality of environmental and operational conditions associated with operation of the autonomous vehicle in an environment; augmenting the log data with one or more simulated anomalies; simulating operation of the localization system using the augmented data as input; obtaining simulation result data descriptive of a state of the localization system subsequent simulating the operation of the localization system; and determining a metric associated with the localization system based on the simulation result data.

## Claims

### Claim 1

A computer-implemented method for validating a localization system of an autonomous vehicle, comprising:
(a) obtaining log data descriptive of a plurality of environmental and operational conditions associated with operation of the autonomous vehicle in an environment;
(b) augmenting the log data with one or more simulated anomalies;
(c) simulating operation of the localization system using the augmented data as input;
(d) obtaining simulation result data descriptive of a state of the localization system subsequent to (c); and
(e) determining a metric associated with the localization system based on the simulation result data.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the log data comprises localization result data descriptive of an output or state of the localization system during operation of the autonomous vehicle in the environment.

### Claim 3 (depends on 2)

The computer-implemented method of claim 2, wherein determining the metric associated with the localization system is based on a comparison between the localization result data and simulation result data.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein (c) comprises dropping one or more inputs to the localization system.

### Claim 5 (depends on 4)

The computer-implemented method of claim 4, wherein the one or more inputs comprise outputs of at least one of: (i) a lane alignment system, (ii) a surfel registration system, (iii) a sensor velocity system, (iv) an IMU, (v) one or more wheel encoders, (vi) a GNSS, (vii) a RADAR system, or (viii) a LIDAR system.

### Claim 6 (depends on 1)

The computer-implemented of claim 1, wherein (c) comprises disabling at least one of: (i) a lane alignment system, (ii) a surfel registration system, (iii) a sensor velocity system, (iv) an IMU, (v) one or more wheel encoders, (vi) a GNSS, (vii) a RADAR system, or (viii) a LIDAR system.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein (c) comprises degrading one or more inputs to the localization system.

### Claim 8 (depends on 7)

The computer-implemented method of claim 7, wherein degrading one or more inputs to the localization system comprises at least one of: (i) disabling outputs of one or more sensors in a sensor system; (ii) utilizing one or more incorrect calibrations on a sensor; (iii) simulating one or more occlusions; (iv) simulating latency at the one or more inputs; (v) simulating one or more boundary conditions; or (vi) injecting a checkpoint fault.

### Claim 9 (depends on 1)

The computer-implemented method of claim 1, wherein (c) comprises augmenting map data provided to the localization system.

### Claim 10 (depends on 9)

The computer-implemented method of claim 9, wherein the augmented map data comprises one or more of out-of-date map data, map data representing new construction or vegetation, misaligned map data, map data comprising missing surfel registrations, or map data depicting inaccurate travelway regions.

### Claim 11 (depends on 1)

The computer-implemented method of claim 1, wherein the simulation result data is descriptive of one or more anomalous outputs of the localization filter.

### Claim 12 (depends on 1)

The computer-implemented method of claim 1, wherein (e) comprises:
determining one or more subsystem metrics associated with one or more subsystems of the localization system; and
determining the metric associated with the localization filter based on the one or more subsystem metrics.

### Claim 13 (depends on 1)

The computer-implemented method of claim 1, wherein the metric is indicative of whether the localization system localized the autonomous vehicle with a threshold confidence.

### Claim 14 (depends on 1)

The computer-implemented method of claim 1, wherein the method further comprises:
(f) determining that the metric associated with the localization filter satisfies a threshold; and
(g) in response to determining that the metric associated with the localization filter satisfies the threshold, validating the localization filter.

### Claim 15

An autonomous vehicle control system, comprising:
one or more processors; and
one or more non-transitory, computer-readable media storing instructions that cause the one or more processors to perform operations comprising:
(a) obtaining log data descriptive of a plurality of environmental and operational conditions associated with operation of the autonomous vehicle in an environment;
(b) augmenting the log data with one or more simulated anomalies;
(c) simulating operation of the localization system using the augmented data as input;
(d) obtaining simulation result data descriptive of a state of the localization system subsequent to (c); and
(e) determining a metric associated with the localization system based on the simulation result data.

### Claim 16 (depends on 15)

The autonomous vehicle control system of claim 15, wherein the log data comprises localization result data descriptive of an output or state of the localization system during operation of the autonomous vehicle in the environment.

### Claim 17 (depends on 16)

The autonomous vehicle control system of claim 16, wherein determining the metric associated with the localization system is based on a comparison between a result of the one or more first testing instances and the simulation result data.

### Claim 18 (depends on 15)

The autonomous vehicle control system of claim 15, wherein (c) comprises dropping one or more inputs to the localization system, wherein the one or more inputs comprise outputs of at least one of: (i) a lane alignment system, (ii) a surfel registration system, (iii) a sensor velocity system, (iv) an IMU, (v) one or more wheel encoders, (vi) a GNSS, (vii) a RADAR system, or (viii) a LIDAR system.

### Claim 19

An autonomous vehicle, comprising:
one or more processors; and
one or more non-transitory, computer-readable media storing instructions that cause the one or more processors to perform operations comprising:
(a) obtaining log data descriptive of a plurality of environmental and operational conditions associated with operation of the autonomous vehicle in an environment;
(b) augmenting the log data with one or more simulated anomalies;
(c) simulating operation of the localization system using the augmented data as input;
(d) obtaining simulation result data descriptive of a state of the localization system subsequent to (c); and
(e) determining a metric associated with the localization system based on the simulation result data.

### Claim 20 (depends on 19)

The autonomous vehicle of claim 19, wherein the log data comprises localization result data descriptive of an output or state of the localization system during operation of the autonomous vehicle in the environment.
