System and method for actively selecting and labeling images for semantic segmentation
AssigneeTusimple, Inc.
InventorsZhipeng Yan, Zehua Huang, Pengfei Chen, Panqu Wang
Life of this patent
Estimating the term…
Abstract
A system and method for actively selecting and labeling images for semantic segmentation are disclosed. A particular embodiment includes: receiving image data from an image generating device; performing semantic segmentation or other object detection on the received image data to identify and label objects in the image data and produce semantic label image data; determining the quality of the semantic label image data based on prediction probabilities associated with regions or portions of the image; and identifying a region or portion of the image for manual labeling if an associated prediction probability is below a pre-determined threshold.
Claims20
A system comprising:
- a processor configured to:
- receive image data corresponding to an image from an image generating device;
- perform object detection on the received image data to produce semantic label image data by identifying and labeling objects in a plurality of regions of the image;
- determine prediction probabilities associated with the plurality of regions of the image, wherein the prediction probabilities indicate likelihood that the objects in the plurality of regions are identified relative to training data;
- identify a region of the image for manual labeling in response to determining that a prediction probability associated with the region of the image is below a pre-determined threshold;
- and
- generate a map that shows portions of the image data having prediction probabilities below the pre-determined threshold, and wherein the portions include the identified region.
A method comprising:
- receiving image data corresponding to an image from an image generating device;
- performing object detection on the received image data to produce semantic label image data by identifying and labeling objects in a plurality of regions of the image;
- determining prediction probabilities associated with the plurality of regions of the image, wherein the prediction probabilities indicate likelihood that the objects in the plurality of regions are identified relative to training data;
- identifying a region of the image for manual labeling in response to determining that a prediction probability associated with the region of the image is below a pre-determined threshold;
- and
- generating a map that shows portions of the image data having prediction probabilities below the pre-determined threshold, and wherein the portions include the identified region.
A non-transitory machine-useable storage medium embodying instructions which, when executed by a machine, cause the machine to:
- receive image data corresponding to an image from an image generating device;
- perform object detection on the received image data to produce semantic label image data by identifying and labeling objects in a plurality of regions of the image;
- determine prediction probabilities associated with the plurality of regions of the image, wherein the prediction probabilities indicate likelihood that the objects in the plurality of regions are identified relative to training data;
- identify a region of the image for manual labeling in response to determining that a prediction probability associated with the region of the image is below a pre-determined threshold;
- and
- generate a map that shows portions of the image data having prediction probabilities below the pre-determined threshold, and wherein the portions include the identified region.
Dependencies are inferred from the claim text.