Back to results
US 9,177,226 B2Granted
Object detection in images based on affinity determinations
AssigneeGoogle Inc.
InventorsAndrew Rabinovich, Dragomir Anguelov
Life of this patent
Estimating the term…
Abstract
A hierarchy of clusters is determined, where each leave of the hierarchy corresponds to one of the images in a group, and each cluster in the hierarchy identifies images in the group that are deemed similar to one another. The hierarchy identifies a similarity between each of the plurality of clusters.
Claims18
A computer-implemented method comprising:
- receiving a collection of images representative of a class;
- computing a respective part-based affinity between each pair of images in the collection of images, including:
- partitioning a first image of the pair of images into a plurality of partitions;
- determining a respective affinity for each partition of the first image, wherein the affinity is based at least in part on a measure of similarity between the partition and a location in a second image of the pair of images having a highest measure of similarity with the partition of the first image;
- determining a part-based affinity between the first image and the second image based at least in part on a sum of the respective affinities of the plurality of partitions of the first image with corresponding locations in the second image;
- generating a plurality of clusters of the images in the collection of images, wherein the plurality of clusters of images are based on the respective determined part-based affinities between each pair of images in the collection of images;
- selecting images in each cluster as being representative of a particular subclass of a plurality of subclasses of the class;
- and
- training a respective deformable parts model using images selected for each of the plurality of subclasses.
6 more elements
A system comprising:
- one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
- receiving a collection of images representative of a class;
- computing a respective part-based affinity between each pair of images in the collection of images, including:
- partitioning a first image of the pair of images into a plurality of partitions;
- determining a respective affinity for each partition of the first image, wherein the affinity is based at least in part on a measure of similarity between the partition and a location in a second image of the pair of images having a highest measure of similarity with the partition of the first image;
- determining a part-based affinity between the first image and the second image based at least in part on a sum of the respective affinities of the plurality of partitions of the first image with corresponding locations in the second image;
- generating a plurality of clusters of the images in the collection of images, wherein the plurality of clusters of images are based on the respective determined part-based affinities between each pair of images in the collection of images;
- selecting images in each cluster as being representative of a particular subclass of a plurality of subclasses of the class;
- and
- training a respective deformable parts model using images selected for each of the plurality of subclasses.
7 more elements
A computer program product, encoded on one or more non-transitory computer storage media, comprising instructions that when executed by one or more computers cause the one or more computers to perform operations comprising:
- receiving a collection of images representative of a class;
- computing a respective part-based affinity between each pair of images in the collection of images, including:
- partitioning a first image of the pair of images into a plurality of partitions;
- determining a respective affinity for each partition of the first image, wherein the affinity is based at least in part on a measure of similarity between the partition and a location in a second image of the pair of images having a highest measure of similarity with the partition of the first image;
- determining a part-based affinity between the first image and the second image based at least in part on a sum of the respective affinities of the plurality of partitions of the first image with corresponding locations in the second image;
- generating a plurality of clusters of the images in the collection of images, wherein the plurality of clusters of images are based on the respective determined part-based affinities between each pair of images in the collection of images;
- selecting images in each cluster as being representative of a particular subclass of a plurality of subclasses of the class;
- and
- training a respective deformable parts model using images selected for each of the plurality of subclasses.
6 more elements
Dependencies are inferred from the claim text.