Indirect motion mapping pipeline and pinch centroid
AssigneeApple Inc.
InventorsDaniel J. Brewer, Chase B. Lortie, David J. Meyer, Julian K. Shutzberg, Tian Qiu, Yirong Tang
Life of this patent
Estimating the term…
Abstract
Processing gesture input includes obtaining hand tracking data for a hand from one or more sensors, wherein the hand performs a pinch in the hand tracking data, determining a hand position and a hand orientation for the hand from the hand tracking data, applying a predefined offset from the hand position based on the hand orientation to determine a pinch centroid, and determining an input location based on the pinch centroid. The pinch centroid is used in an indirect motion mapping pipeline to determine characteristics of user input based on user motion.
Claims20
A method comprising:
- obtaining sensor data of a hand performing a pinch;
- determining location information for one or more hand joints and one or more finger joints;
- determining a hand position and a hand orientation for the hand from the sensor data based on a location of one or more hand joints;
- applying an offset comprising a predefined distance from a hand location corresponding to the hand position and in a direction away from the hand location based on the hand orientation to determine a pinch centroid;
- and
- causing movement of a user interface component based on a location of the pinch centroid.
A non-transitory computer readable medium comprising computer readable code executable by one or more processors to:
- obtain sensor data of a hand performing a pinch;
- determining location information for one or more hand joints and one or more finger joints;
- determine a hand position and a hand orientation for the hand from the sensor data based on a location of one or more hand joints;
- apply an offset comprising a predefined distance from a hand location corresponding to the hand position and in a direction away from the hand location based on the hand orientation to determine a pinch centroid;
- and
- cause movement of a user interface component based on a location of the pinch centroid.
A system comprising:
- one or more processors;
- and
- one or more computer readable media comprising computer readable code executable by the one or more processors to:
- obtain sensor data of a hand performing a pinch;
- determining location information for one or more hand joints and one or more finger joints;
- determine a hand position and a hand orientation for the hand from the sensor data based on a location of one or more hand joints;
- apply an offset comprising a predefined distance from a hand location corresponding to the hand position and in a direction away from the hand location based on the hand orientation to determine a pinch centroid;
- and
- cause movement of a user interface component based on a location of the pinch centroid.
Dependencies are inferred from the claim text.