Using sensor inputs from a computing device to determine search query
AssigneeGoogle Inc.
InventorsLaura Garcia-Barrio, David Petrou, Hartwig Adam
Life of this patent
Estimating the term…
Abstract
An image input is obtained from a computing device when an image sensor of the computing device is directed to a scene. At least an object of interest in the scene is determined, and a label is determined for the object of interest. A search input is received from the computing device, where the search input is obtained from a mechanism other than the image sensor. An ambiguity is determined from the search input. A search query is determined that augments or replaces the ambiguity based at least in part on the label. A search result is based on the search query.
Claims20
A method, the method being implemented by one or more processors and comprising:
- receiving an image input from a computing device, wherein the image input is obtained from an image sensor of the computing device when the image sensor of the computing device is directed to a scene;
- determining at least an object of interest in the scene;
- determining a label for the object of interest;
- receiving a search input from the computing device, wherein the search input is obtained from a mechanism other than the image sensor;
- identifying an ambiguity in the search input;
- determining a search query that augments or replaces the ambiguity based at least in part on the label;
- and
- providing a search result based on the search query.
A computer system comprising:
- one or more processors;
- a memory that stores instructions;
- wherein the one or more processors access instructions stored in the memory to:
- receive an image input from a computing device, wherein the image input is obtained from an image sensor of the computing device when the image sensor of the computing device is directed to a scene;
- determine at least an object of interest in the scene;
- determine a label for the object of interest;
- receive a search input from the computing device, wherein the search input is obtained from a mechanism other than the image sensor;
- identify an ambiguity in the search input;
- determine a search query that augments or replaces the ambiguity based at least in part on the label;
- and
- provide a search result based on the search query.
A computer-readable medium that stores instructions, that when executed by one or more processors, cause the one or more processors to perform operations comprising:
- receiving an image input from a computing device, wherein the image input is obtained from an image sensor of the computing device when the image sensor of the computing device is directed to a scene;
- determining at least an object of interest in the scene;
- determining a label for the object of interest;
- receiving a search input from the computing device, wherein the search input is obtained from a mechanism other than the image sensor;
- identifying an ambiguity in the search input;
- determining a search query that augments or replaces the ambiguity based at least in part on the label;
- and
- providing a search result based on the search query.
Dependencies are inferred from the claim text.