US 9,852,363 B1 · Generating labeled images

Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating labeled images. One of the methods includes selecting a plurality of candidate videos from videos identified in a response to a search query derived from a label for an object category; selecting one or more initial frames from each of the candidate videos; detecting one or more initial images of objects in the object category in the initial frames; for each initial frame including an initial image of an object in the object category, tracking the object through surrounding frames to identify additional images of the object; and selecting one or more images from the one or more initial images and one or more additional images as database images of objects belonging to the object category.

Claims20

Dependent claims

A method of generating labeled images of objects belonging to a particular object category, the method comprising:

obtaining data identifying the particular object category;
identifying database images of the objects belonging to the particular object category, comprising:
generating a search query derived from a label for the particular object category;
selecting a plurality of candidate videos from videos identified in response to submission of the search query;
selecting one or more initial frames from each of the candidate videos;
detecting one or more initial images of objects belonging to the particular object category in the one or more initial frames;
for each initial frame including an initial image of an object belonging to the particular object category, tracking the object through surrounding frames to identify one or more additional images of the object;
and
selecting one or more images from the one or more initial images and one or more additional images as the database images of objects belonging to the particular object category;
and
storing the database images as images of objects belong to the particular object category.

8 more elements

A system comprising:

one or more processors and one or more computer storage media storing instructions that are operable and when executed by the one or more processors, cause the one or more processors to perform operations comprising:
obtaining data identifying the particular object category;
identifying database images of the objects belonging to the particular object category, comprising:
generating a search query derived from a label for the particular object category;
selecting a plurality of candidate videos from videos identified in response to submission of the search query;
selecting one or more initial frames from each of the candidate videos;
detecting one or more initial images of objects belonging to the particular object category in the one or more initial frames;
for each initial frame including an initial image of an object belonging to the particular object category, tracking the object through surrounding frames to identify one or more additional images of the object;
and
selecting one or more images from the one or more initial images and one or more additional images as the database images of objects belonging to the particular object category;
and
storing the database images as images of objects belong to the particular object category.

9 more elements

A non-transitory computer-readable storage medium encoded with a computer program, the computer program comprising instructions that, upon execution by a computer, cause the computer to perform operations comprising:

obtaining data identifying the particular object category;
identifying database images of the objects belonging to the particular object category, comprising:
generating a search query derived from a label for the particular object category;
selecting a plurality of candidate videos from videos identified in response to submission of the search query;
selecting one or more initial frames from each of the candidate videos;
detecting one or more initial images of objects belonging to the particular object category in the one or more initial frames;
for each initial frame including an initial image of an object belonging to the particular object category, tracking the object through surrounding frames to identify one or more additional images of the object;
and
selecting one or more images from the one or more initial images and one or more additional images as the database images of objects belonging to the particular object category;
and
storing the database images as images of objects belong to the particular object category.

8 more elements

Dependencies are inferred from the claim text.

Generating labeled images

Life of this patent

Generating labeled images

Life of this patent

Abstract

Claims20