US 2019/0318207 A1 · RARE INSTANCE CLASSIFIERS

Abstract

In some implementations, an image classification system of an autonomous or semi-autonomous vehicle is capable of improving multi-object classification by reducing repeated incorrect classification of objects that are considered rarely occurring objects. The system can include a common instance classifier that is trained to identify and recognize general objects (e.g., commonly occurring objects and rarely occurring objects) as belonging to specified object categories, and a rare instance classifier that is trained to compute one or more rarity scores representing likelihoods that an input image is correctly classified by the common instance classifier. The output of the rare instance classifier can be used to adjust the classification output of the common instance classifier such that the likelihood of input images being incorrectly classified is reduced.

Claims20

Dependent claims

A method of training a rare instance neural network, the method comprising:

receiving a plurality of labeled training images;
identifying a subset of the labeled training images that are likely to be misclassified by a common instance neural network that has been trained on the labeled training images to classify images into object categories;
generating, from the subset of the labeled training images, training data for a rare instance neural network, the rare instance neural network being configured to process an input image to generate a rarity output that includes a rarity score that represents a likelihood that the input image will be incorrectly classified by the trained common instance neural network;
and
training the rare instance neural network on the training data to generate rarity scores for the subset of labeled training images that indicate that the subset of labeled training images are likely to be incorrectly classified by the common instance neural network.

2 more elements

A system comprising:

one or more computers;
and
one or more storage devices storing instructions that, when executed by the one or more computers, cause the one or more computers to perform operations comprising:
receiving a plurality of labeled training images;
identifying a subset of the labeled training images that are likely to be misclassified by a common instance neural network that has been trained on the labeled training images to classify images into object categories;
generating, from the subset of the labeled training images, training data for a rare instance neural network, the rare instance neural network being configured to process an input image to generate a rarity output that includes a rarity score that represents a likelihood that the input image will be incorrectly classified by the trained common instance neural network;
and
training the rare instance neural network on the training data to generate rarity scores for the subset of labeled training images that indicate that the subset of labeled training images are likely to be incorrectly classified by the common instance neural network.

5 more elements

One or more non-transitory computer-readable storage media encoded with computer program instructions that, when executed by one or more computers, cause the one or more computers to perform operations comprising:

receiving a plurality of labeled training images;
identifying a subset of the labeled training images that are likely to be misclassified by a common instance neural network that has been trained on the labeled training images to classify images into object categories;
generating, from the subset of the labeled training images, training data for a rare instance neural network, the rare instance neural network being configured to process an input image to generate a rarity output that includes a rarity score that represents a likelihood that the input image will be incorrectly classified by the trained common instance neural network;
and
training the rare instance neural network on the training data to generate rarity scores for the subset of labeled training images that indicate that the subset of labeled training images are likely to be incorrectly classified by the common instance neural network.

2 more elements

Dependencies are inferred from the claim text.

Rare instance classifiers

Life of this patent

Rare instance classifiers

Life of this patent

Abstract

Claims20