# US 2019/0378363 A1 · Management of data and software for autonomous vehicles

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0378363 A1
- Document ID: US20190378363A1
- Status: Published application
- Kind: A1
- Application number: 16/434,780
- Filed: 2019-06-07
- Published: 2019-12-12
- Earliest claimed: 2018-06-11
- Assignees: Apex.Al, Inc.
- Applicants: Apex.Al, Inc.
- Inventors: Jan Becker
- Web page: https://patentgrep.com/patent/US20190378363A1

## CPC

- G07C 5/0841: {Registering performance data (recording measured values G01D; information storage G11B)}
- G06Q 20/123: {Shopping for digital content}
- G06Q 30/08: Auctions
- H04L 67/12: specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- H04L 67/34: {involving the movement of software or configuration parameters (network booting or remote initial program loading [RIPL] G06F9/4416)}
- H04W 4/38: for collecting sensor information
- H04W 4/44: for communication between vehicles and infrastructures, e.g. vehicle-to-cloud [V2C] or vehicle-to-home [V2H]
- G07C: TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

Management of data and software for autonomous vehicles. In an embodiment, sensor data is received. The sensor data is collected by one or more sensor systems of one or more vehicles, and submitted by a first user via at least one network. The sensor data is automatically analyzed to detect any problems with the sensor data and to enhance the sensor data, prior to publishing a description of the sensor data in an online marketplace. A graphical user interface is generated that comprises one or more screens of the online marketplace, via which a second user may view the description of the sensor data and purchase the sensor data for download via the at least one network.

## Claims

### Claim 1

A method comprising using at least one hardware processor to:
receive sensor data, collected by one or more sensor systems of one or more vehicles, and submitted by a first user via at least one network;
automatically analyze the sensor data to detect one or more characteristics of the sensor data and to enhance the sensor data, prior to publishing a description of the sensor data in an online marketplace; and
generate a graphical user interface comprising one or more screens of the online marketplace via which a second user may view the description of the sensor data and purchase the sensor data for download via the at least one network.

### Claim 2 (depends on 1)

The method of claim 1, wherein detecting one or more characteristics comprises detecting an interruption in the sensor data.

### Claim 3 (depends on 1)

The method of claim 1, wherein detecting one or more characteristics comprises:
detecting one or both of a type and configuration of sensors used to capture the sensor data; and
determining whether or not the sensors properly captured data throughout the entire sensor data.

### Claim 4 (depends on 1)

The method of claim 1, wherein detecting one or more characteristics comprises parsing the sensor data to determine whether or not the sensor data adheres to a particular format.

### Claim 5 (depends on 4)

The method of claim 4, wherein the particular format is Robot Operating System (ROS) bag format.

### Claim 6 (depends on 1)

The method of claim 1, further comprising using the at least one hardware processor to, when at least one characteristic is detected by the analysis of the sensor data and the at least one characteristic comprises a problem:
notify the first user about the problem; and
receive corrected sensor data from the first user via the at least one network.

### Claim 7 (depends on 1)

The method of claim 1, wherein enhancing the sensor data comprises:
analyzing the one or more characteristics of the sensor data to detect one or more events in the sensor data; and
associating the detected one or more events with the sensor data.

### Claim 8 (depends on 7)

The method of claim 7, wherein associating the detected one or more events with the sensor data comprises adding an indication of the one or more events to the description of the sensor data.

### Claim 9 (depends on 1)

The method of claim 1, wherein enhancing the sensor data comprises:
computing one or more metrics of the sensor data; and
associating the computed one or more metrics with the sensor data.

### Claim 10 (depends on 9)

The method of claim 9, wherein associating the computed one or more metrics with the sensor data comprises adding an indication of the one or more metrics to the description of the sensor data.

### Claim 11 (depends on 9)

The method of claim 9, wherein computing one or more metrics of the sensor data comprises comparing the sensor data to one or more other sensor data to determine a metric of how up-to-date the sensor data is.

### Claim 12 (depends on 1)

The method of claim 1, wherein enhancing the sensor data comprises:
identifying a geographic location and time associated with the sensor data;
retrieving environmental conditions, associated with the geographic location and time, from an external system, via the at least one network; and
associating the environmental conditions with the sensor data.

### Claim 13 (depends on 1)

The method of claim 1, wherein enhancing the sensor data comprises removing data that identifies one or more of a person, a location, and a vehicle from the sensor data.

### Claim 14 (depends on 13)

The method of claim 13, wherein removing data that identifies a location from the sensor data comprises pruning a beginning portion of the sensor data and an ending portion of the sensor data from the sensor data.

### Claim 15 (depends on 1)

The method of claim 1, further comprising using the at least one hardware processor to:
receive one or more criteria from the second user;
determine that the sensor data satisfies the one or more criteria; and
notify the second user that the sensor data is available for purchase.

### Claim 16 (depends on 1)

The method of claim 1, further comprising using the at least one hardware processor to:
receive one or more criteria from the first user;
receive a search or request for sensor data from the second user, wherein the search or request for sensor data satisfies the one or more criteria; and
notify the first user about the searched or requested sensor data.

### Claim 17 (depends on 16)

The method of claim 16, wherein the request comprises a bid price for the requested sensor data.

### Claim 18 (depends on 15)

The method of claim 15, wherein the one or more criteria comprise one or more of a geographical location within which the sensor data was collected, a characteristic of the sensor data, an event represented in the sensor data, or a metric of the sensor data.

### Claim 19 (depends on 1)

The method of claim 1, further comprising using the at least one hardware processor to provide a free sample of the sensor data to the second user.

### Claim 20 (depends on 19)

The method of claim 19, further comprising using the at least one hardware processor to:
analyze a pattern of the second user's access to free samples of sensor data via the online marketplace over a time period; and
in response to the pattern of the second user's access matching a pattern that indicates an attempt to compose a data file from the free samples, restricting the second user's future access to free samples.

### Claim 21 (depends on 19)

The method of claim 19, wherein the free sample consists of a portion of the sensor data.

### Claim 22 (depends on 19)

The method of claim 19, wherein the free sample comprises a lower-resolution version of at least a portion of the sensor data.

### Claim 23 (depends on 1)

The method of claim 1, further comprising using the at least one hardware processor to:
receive a software module, submitted by a third user, via the at least one network, wherein the software module comprises instructions for controlling an autonomous system of a vehicle;
automatically analyze the software module to derive information about the software module; and
generate a graphical user interface comprising one or more screens of the online marketplace via which another user may view a description of the software module and purchase the software module for download via the at least one network.

### Claim 24 (depends on 23)

The method of claim 23, wherein analyzing the software module comprises determining whether or not the software module is compatible with an application programming interface (API) of software for interacting with the autonomous system of the vehicle.

### Claim 25 (depends on 24)

The method of claim 24, wherein the software for interacting with the autonomous system of the vehicle is Apex.OS™.

### Claim 26 (depends on 23)

The method of claim 23, wherein analyzing the software module comprises computing a metric for the software module, and wherein the description of the software module comprises the computed metric.

### Claim 27 (depends on 26)

The method of claim 26, wherein the computed metric comprises a functional safety compliance metric.

### Claim 28 (depends on 26)

The method of claim 26, wherein the computed metric comprises a functional performance metric.

### Claim 29 (depends on 26)

The method of claim 26, wherein the computed metric comprises a computational performance metric.

### Claim 30 (depends on 23)

The method of claim 23, wherein analyzing the software module comprises testing the software module using a plurality of types of sensors, and wherein the description of the software module comprises each one of the plurality of types of sensors for which the software module was successfully tested.

### Claim 31 (depends on 1)

The method of claim 1, further comprising using the at least one hardware processor to:
receive a description of a service, submitted by a fourth user, via the at least one network, wherein the service is related to autonomous vehicles; and
generate a graphical user interface comprising one or more screens of the online marketplace via which another user may view a description of the service and purchase the service.

### Claim 32 (depends on 1)

The method of claim 1, further comprising using the at least one hardware processor to:
receive a virtual map, submitted by a fifth user, via the at least one network; and
generate a graphical user interface comprising one or more screens of the online marketplace via which another user may view a description of the virtual map and purchase the virtual map for download via the at least one network.

### Claim 33 (depends on 32)

The method of claim 32, further comprising using the at least one hardware processor to:
analyze the virtual map to determine whether or not the virtual map comprises a three-dimensional point cloud; and,
when the virtual map is determined to comprise a three-dimensional point cloud, add an indication that the virtual map comprises a three-dimensional point cloud to the description of the virtual map.

### Claim 34 (depends on 32)

The method of claim 32, further comprising using the at least one hardware processor to:
receive a request for a virtual map of a geographical region that satisfies one or more criteria, via the at least one network;
extract a portion, comprising the geographical region and satisfying the one or more criteria, from an existing virtual map that comprises the geographical region and at least one other geographical region; and
provide the extracted portion, in response to the request, via the at least one network.

### Claim 35 (depends on 32)

The method of claim 32, further comprising using the at least one hardware processor to:
receive a request for a virtual map of a geographical region that satisfies one or more criteria, via the at least one network;
generate a composite map, comprising the geographical region and satisfying the one or more criteria, from two or more existing virtual maps that each comprise a portion of the geographical region; and
provide the composite map, in response to the request, via the at least one network.

### Claim 36 (depends on 1)

The method of claim 1, further comprising using the at least one hardware processor to:
compute one or more aggregate metrics for a plurality of the sensor data; and
provide the one or more aggregate metrics for purchase or analysis via one or more screens of the online marketplace.

### Claim 37

A system comprising:
at least one hardware processor; and
one or more software modules configured to, when executed by the at least one hardware processor,
receive sensor data, collected by one or more sensor systems of one or more vehicles, and submitted by a first user via at least one network,
automatically analyze the sensor data to detect one or more characteristics with the sensor data and to enhance the sensor data, prior to publishing a description of the sensor data in an online marketplace, and
generate a graphical user interface comprising one or more screens of the online marketplace via which a second user may view the description of the sensor data and purchase the sensor data for download via the at least one network.

### Claim 38

A non-transitory computer-readable medium having instructions stored therein, wherein the instructions, when executed by a processor, cause the processor to:
receive sensor data, collected by one or more sensor systems of one or more vehicles, and submitted by a first user via at least one network;
automatically analyze the sensor data to detect one or more characteristics with the sensor data and to enhance the sensor data, prior to publishing a description of the sensor data in an online marketplace; and
generate a graphical user interface comprising one or more screens of the online marketplace via which a second user may view the description of the sensor data and purchase the sensor data for download via the at least one network.
