Back to results
US 2025/0029341 A1Published application
Object identification in extended reality using gesture recognition
AssigneeTacitly Inc.
InventorsJeffrey A. DeJarnette, William C. Kuker, Dylan Beebe
Life of this patent
Estimating the term…
Abstract
A system and method identifies objects in an XR environment using gesture recognition. For example, a user may point to an object in the XR environment, which triggers a small U.I. tag to pop up with additional information about the object. The system and method can be used in various applications, including identifying items in a medical code cart during a simulated or actual medical emergency situation.
Claims20
An extended reality system comprising:
- a controller programmed with a digital twin of a physical object;
- a display operably connected to the controller and programmed to display the digital twin of the physical object;
- and
- a gesture recognition system operably connected to the controller and configured to sense a pointing gesture by a user and output a signal to the controller indicative of the pointing gesture, wherein the pointing gesture is directed toward the digital twin of the physical object,
- the controller programmed to generate a U.I. tag including information about the physical object when the controller receives the signal indicative of the pointing gesture.
2 more elements
An extended reality system comprising:
- a physical object equipped with sensors or markers that generate or otherwise transmit signals indicative of physical properties of the physical object;
- a controller configured to receive the signals indicative of the physical properties, and programmed to output a digital twin of a physical object;
- a display operably connected to the controller and programmed to display the digital twin of the physical object;
- and
- a gesture recognition system operably connected to the controller and configured to sense a pointing gesture by a user and output a signal to the controller indicative of the pointing gesture, wherein the pointing gesture is directed toward the digital twin of the physical object,
- the controller programmed to generate a U.I. tag including an identity of the physical object when the controller receives the signal indicative of the pointing gesture.
3 more elements
A method of identifying objects in an extended reality (XR) environment, comprising:
- recognizing a pointing gesture directed toward or to a physical object;
- and
- in response to the step of recognizing, displaying a U.I. tag including information about the physical object on a display of an extended reality viewing system.
Dependencies are inferred from the claim text.