Gestural object selection
AssigneeAmazon Technologies, Inc.
InventorRamy S. Sadek
Life of this patent
Estimating the term…
Abstract
A posture for a user is derived and used in conjunction with a known physical location of a tangible object or a presented virtual object to determine when the user selects at least a portion of the object. The derived posture comprises a model having a user origin and a gestural terminus, from which a designation vector intersecting with the selected object is determined. The designation vector may extend from a user origin of the dominant eye through a gestural terminus comprising a tip of an outstretched finger. For example, the user may point to a chair in the room to select the physical chair, or point to a picture of a chair presented via a display device to select the picture.
Claims28
A system comprising:
- a processor;
- a projector coupled to the processor and configured to generate structured light within an environment;
- a camera coupled to the processor and configured to capture at least a portion of the structured light within the environment;
- memory, accessible by the processor;
- a spatial analysis module stored in the memory and configured to generate spatial data about one or more objects within the environment;
- and
- a tracking and control module stored in the memory and configured to:
- identify an object within the environment as a user based at least in part upon the spatial data;
- derive a posture of the user based at least in part upon the spatial data;
- determine a physical location of a user origin associated with the user relative to the posture of the user;
- determine a location of a gestural terminus of the user based at least in part on the posture of the user;
- determine a designation vector based at least in part upon the physical location of the user origin and the location of the gestural terminus, a magnitude of the designation vector being proportionate to a distance between the physical location of the user origin and the location of the gestural terminus;
- determine a portion of a representation of a second object that corresponds to the designation vector;
- and
- designate the portion of the representation of the second object as a selection made by the user.
One or more non-transitory computer-readable storage media storing computer-executable instructions that, when executed, cause one or more processors to perform acts comprising:
- receiving data about a user and one or more objects within an environment, the data being generated based in part on one or more images of the environment captured by a camera that is separate and spaced from the user;
- deriving, based at least in part upon the data, a posture of the user in the environment;
- determining a physical location of a user origin associated with the user relative to the posture of the user;
- determining a location of a gestural terminus of the user based at least in part on the posture of the user;
- determining a designation vector based at least in part upon the physical location of the user origin and the location of the gestural terminus, the designation vector including a magnitude that is proportionate to a distance between the physical location of the user origin and the location of the gestural terminus;
- and
- determining at least a portion of a representation of an object of the one or more objects within the environment that corresponds to the designation vector.
One or more non-transitory computer-readable storage media storing computer-executable instructions that, when executed, cause one or more processors to perform acts comprising:
- receiving data about a user and one or more objects within an environment, the data being generated based in part on one or more images of the environment captured by a camera that is separate and spaced from the user;
- determining, based at least in part upon the data, a location of a user origin of the user within the environment, the user origin comprising a reference point associated with an anatomy of the user;
- determining a location of a gestural terminus within the environment, the gestural terminus comprising one or more spatial points associated with a gesturing appendage of the user;
- determining a designation vector based at least in part upon the location of the user origin of the user and the location of the gestural terminus of the user, a magnitude of the designation vector being proportionate to a distance between the location of the user origin and the location of the gestural terminus;
- and
- determining at least a portion of a physical object that corresponds to the designation vector and that is determined to be selected by the user.
Dependencies are inferred from the claim text.