Extended reality gesture recognition proximate tracked object
AssigneeMicrosoft Technology Licensing, LLC
InventorErik Alexander Hill
Life of this patent
Estimating the term…
Abstract
Generally discussed herein are examples of gesture-based extended reality (XR) with object recognition and tracking. A method, implemented by an extended reality (XR) device can include recognizing and tracking one or more objects in the image data, recognizing a gesture in the image data, analyzing the image data to determine whether a condition is satisfied, the condition indicating a recognized and tracked object of the one or more objects proximate which the recognized gesture is to be made, and in response to determining that the condition is satisfied, performing an augmentation of the image data based on satisfaction of the condition.
Claims20
A wearable device comprising:
- a camera facing away from a body of a user when in use;
- processing circuitry configured to receive image data from the camera;
- and
- a memory device coupled to the processing circuity and having a program stored thereon for execution by the processing circuitry to perform operations comprising:
- recognizing and tracking one or more real objects, separate from the user, in the image data;
- recognizing a gesture by the user or a person in the image data;
- analyzing the image data to determine whether a condition is satisfied, the condition indicating a recognized and tracked object, of the one or more objects, being proximate which the recognized gesture;
- and
- in response to determining that the condition is satisfied, performing an augmentation of the image data based on satisfaction of the condition.
A method implemented by an extended reality (XR) device, the method comprising:
- recognizing and tracking one or more real objects, separate from a user, in image data from a camera of the XR device, the camera facing away from a body of the user wearing the XR device;
- recognizing a gesture by the user or a person in the image data;
- analyzing the image data to determine whether a condition is satisfied, the condition indicating a recognized and tracked objects, of the one or more objects, being proximate the recognized gesture;
- and
- in response to determining that the condition is satisfied, performing an augmentation of the image data based on satisfaction of the condition.
A non-transitory machine-readable medium including instructions that, when executed by an extended reality (XR) device, cause the XR device to perform operations comprising:
- recognizing and tracking one or more real objects, separate from a user in image data from a camera of the XR device, the camera facing away from a body of the user wearing the XR device;
- recognizing a gesture by the user or a person in the image data;
- analyzing the image data to determine whether a condition is satisfied, the condition indicating a recognized and tracked object, of the one or more objects, being proximate the recognized gesture;
- and
- in response to determining that the condition is satisfied, performing an augmentation of the image data based on satisfaction of the condition.
Dependencies are inferred from the claim text.