Identification of Objects in a Scene Using Gaze Tracking Techniques
AssigneeMicrosoft Technology Licensing, LLC
InventorJohn C. Gordon
Life of this patent
Estimating the term…
Abstract
Techniques and systems for identifying objects using gaze tracking techniques are described. A computing system may determine or infer that an individual is requesting to identify an object that is unknown to the individual based at least partly on images of the individual, images of a scene including the object, or both. In some cases, images of the individual may be used to determine a gaze path of the individual and the unknown object may be within the gaze path of the individual. Additionally, a computing system may send a request to identify the object to at least one individual. One or more of the responses received from the at least one individual may be provided in order to identify the object.
Claims20
A computing device comprising:
- one or more processors;
- and
- one or more computer-readable storage media storing instructions that are executable by the one or more processors to perform operations comprising:
- obtaining a first image of an eye of an individual;
- determining a gaze path of the individual based at least partly on the first image;
- obtaining a second image of at least a portion of a scene, wherein the scene includes one or more objects;
- determining a position of an object included in the scene based at least partly on the second image;
- determining that the object is within the gaze path of the individual based at least partly on the position of the object;
- receiving input to identify the object;
- sending communications to computing devices of a group of individuals, the communications including a request to identify the object;
- receiving a response from a computing device of a member of the group, the response including an identifier of the object;
- and
- providing output including the identifier of the object.
A computing system comprising:
- one or more processors;
- one or more computer-readable storage media storing instructions that are executable by the one or more processors to perform operations comprising:
- determining a gaze path of an individual;
- determining a position of an object included in a scene;
- determining that the object is within the gaze path of the individual based at least partly on the position of the object;
- receiving input data including at least one of audible input, visual input, or sensor input;
- determining that the input data corresponds to a request to identify the object;
- receiving an identifier of the object from an additional computing device of an additional individual;
- and
- generating output data including the identifier of the object.
A computer-implemented method comprising:
- receiving, by a computing device including a processor and memory and from an additional computing device, information related to a request to identify an object;
- determining, by the computing device, that the object is absent from a database of object information;
- identifying, by the computing device, a group of individuals from among a plurality of groups of individuals;
- sending, by the computing device, communications to computing devices of the group, the communications including a request to identify the object and an image of the object;
- receiving, by the computing device, responses from at least a portion of the computing devices of the group, the responses including a plurality of identifiers of the object;
- selecting, by the computing device, an identifier from among the plurality of the identifiers based at least partly on a number of occurrences of the identifier in the responses;
- and
- providing, by the computing device to the additional computing device, additional information including the identifier of the object.
Dependencies are inferred from the claim text.