Query by image
AssigneeGoogle Inc.
InventorsUlrich Buddemeier, Gabriel Taubman, Hartwig Adam, Charles J. Rosenberg, Hartmut Neven, David Petrou, Fernando Brucher
Life of this patent
Estimating the term…
Abstract
Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing queries made up of images. In one aspect, a method includes indexing images by image descriptors. The method further includes associating descriptive n-grams with the images. In another aspect, a method includes receiving a query, identifying text describing the query, and performing a search according to the text identified for the query.
Claims20
A method performed by data processing apparatus, the method comprising:
- receiving an image as a query from a user device associated with a user;
- deriving a textual query corresponding to the received image, wherein deriving the textual query for the image includes:
- using the image to determine a group of images that are similar to the received image;
- for each similar image of the group of similar images, identifying one or more n-grams associated with the similar image;
- and
- selecting one or more of the identified n-grams as a textual query for the received image;
- obtaining search results responsive to the textual query;
- and
- providing for presentation on the user device one or more of the obtained search results.
A system comprising:
- one or more computers operable to perform operations comprising:
- receiving an image as a query from a user device associated with a user;
- deriving a textual query corresponding to the received image, wherein deriving the textual query for the image includes:
- using the image to determine a group of images that are similar to the received image;
- for each similar image of the group of similar images, identifying one or more n-grams associated with the similar image;
- and
- selecting one or more of the identified n-grams as a textual query for the received image;
- obtaining search results responsive to the textual query;
- and
- providing for presentation on the user device one or more of the obtained search results.
A non-transitory computer-readable storage medium storing instructions that, when executed by data processing apparatus cause the data processing apparatus to perform operations comprising:
- receiving an image as a query from a user device associated with a user;
- deriving a textual query corresponding to the received image, wherein deriving the textual query for the image includes:
- using the image to determine a group of images that are similar to the received image;
- for each similar image of the group of similar images, identifying one or more n-grams associated with the similar image;
- and
- selecting one or more of the identified n-grams as a textual query for the received image;
- obtaining search results responsive to the textual query;
- and
- providing for presentation on the user device one or more of the obtained search results.
Dependencies are inferred from the claim text.