US 10,832,414 B2 · Sensor data segmentation

Abstract

A system may include one or more processors configured to receive a plurality of images representing an environment. The images may include image data generated by an image capture device. The processors may also be configured to transmit the image data to an image segmentation network configured to segment the images. The processors may also be configured to receive sensor data associated with the environment including sensor data generated by a sensor of a type different than an image capture device. The processors may be configured to associate the sensor data with segmented images to create a training dataset. The processors may be configured to transmit the training dataset to a machine learning network configured to run a sensor data segmentation model, and train the sensor data segmentation model using the training dataset, such that the sensor data segmentation model is configured to segment sensor data.

Claims20

Dependent claims

A system comprising:

one or more processors;
and
one or more computer readable storage media communicatively coupled to the one or more processors and storing instructions executable by the one or more processors to:
receive image data;
store, based at least in part on the image data, a segmented image;
receive sensor data from at least one of a light detection and ranging (LIDAR) sensor, a radio detection and ranging (RADAR) sensor, or a sound navigation and ranging (SONAR) sensor;
associate the sensor data with the segmented image as part of a training dataset;
and
train a sensor data segmentation model using the training dataset such that, upon receiving input comprising at least one of additional LIDAR sensor data, additional RADAR sensor data, or additional SONAR sensor data, the sensor data segmentation model is configured to output at least one of segmented additional LIDAR sensor data, segmented additional RADAR sensor data, or segmented additional SONAR sensor data.

6 more elements

A method comprising:

receiving image data;
receiving first sensor data generated by at least one of a light detection and ranging (LIDAR) sensor, a radio detection and ranging (RADAR) sensor, or a sound navigation and ranging (SONAR) sensor;
segmenting the image data to store segmented images;
associating the first sensor data with the segmented images to create a training dataset;
and
training a sensor data segmentation model using the training dataset such that, upon receiving input comprising at least one of additional LIDAR sensor data, additional RADAR sensor data, or additional SONAR sensor data, the sensor data segmentation model is configured to output at least one of segmented additional LIDAR sensor data, segmented additional RADAR sensor data, or segmented additional SONAR sensor data.

3 more elements

One or more non-transitory computer-readable storage media having computer-executable instructions stored thereupon which, when executed by one or more processors, cause the one or more processors to perform operations comprising:

receiving image data;
storing, based at least in part on the image data, a segmented image;
receiving sensor data generated by a sensor comprising at least one of a light detection and ranging (LIDAR) sensor, a radio detection and ranging (RADAR) sensor, or a sound navigation and ranging (SONAR) sensor;
associating the sensor data with the segmented image to create a training dataset;
and
training a sensor data segmentation model using the training dataset such that, upon receiving input comprising at least one of additional LIDAR sensor data, additional RADAR sensor data, or additional SONAR sensor data, the sensor data segmentation model is configured to output at least one of segmented additional LIDAR data, segmented additional RADAR sensor data, or segmented additional SONAR sensor data.

3 more elements

Dependencies are inferred from the claim text.

Sensor data segmentation

Life of this patent

Sensor data segmentation

Life of this patent

Abstract

Claims20