Image-based search engine for mobile phones with camera
AssigneeGoogle Inc.
InventorsHartmut Neven, Sr., Hartmut Neven
Life of this patent
Estimating the term…
Abstract
An image-based information retrieval system is disclosed that includes a mobile telephone and a remote server. The mobile telephone has a built-in camera and a communication link for transmitting an image from the built-in camera to the remote server. The remote server has an optical character recognition engine for generating a first confidence value based on an image from the mobile telephone, an object recognition engine for generating a second confidence value based on an image from the mobile telephone, a face recognition engine for generating a third confidence value based on an image from the mobile telephone, and an integrator module for receiving the first, second, and third confidence values and generating a recognition output.
Claims20
A method for updating object representations in an image database, the method comprising:
- receiving an image of an object from a client device associated with a user, the receiving of the image constituting a first user query for information related to the object;
- recognizing the object using an image recognition engine and an image database, the image database storing object identifiers in association with objects;
- associating, from the image database, an object identifier with the recognized object;
- transmitting to the client device associated with the user, information related to the recognized object;
- receiving an indication of whether the user accepted the transmitted information as being relevant to the object;
- and
- responsive to a computed confidence measure of the recognition of the object exceeding a given threshold, storing the image of the object in the image database in association with the object identifier;
- wherein the confidence measure is computed at least in part based on the indication that the user accepted the transmitted information as being relevant to the object.
A recognition computer server system for updating object representations in an image database, the recognition computer server system adapted to perform actions comprising:
- receiving an image of an object from a client device associated with a user, the receiving of the image constituting a first user query for information related to the object;
- recognizing the object using an image recognition engine and an image database, the image database storing object identifiers in association with objects;
- associating, from the image database, an object identifier with the recognized object;
- transmitting to the client device associated with the user, information related to the recognized object;
- receiving an indication of whether the user accepted the transmitted information as being relevant to the object;
- and
- responsive to a computed confidence measure of the recognition of the object exceeding a given threshold, storing the image of the object in the image database in association with the object identifier;
- wherein the confidence measure is computed at least in part based on the indication that the user accepted the transmitted information as being relevant to the object.
Dependencies are inferred from the claim text.