Back to results
US 11,079,858 B2Granted
Controller movement tracking with light emitters
AssigneeMentor Acquisition One, LLC
InventorsRobert Michael Lohse, John D. Haddick
Life of this patent
Estimating the term…
Abstract
A head-worn computer includes a camera system positioned to capture a surrounding environment in front of a user, a processor that identifies a position of a plurality of light emitters mounted on a hand-held controller from images captured by the camera system and tracks the position of the plurality of light emitters as the hand-held controller moves in the surrounding environment and interprets the tracked position as positional changes of the hand-held controller. The processor uses the position of the plurality of light emitters as markers in three dimensional space, the markers used as an anchor for virtual content presented in a see-through display of the head-worn computer.
Claims20
A wearable head device, comprising:
- a camera system configured to capture images of a surrounding environment of a user of the wearable head device;
- a see-through display;
- and
- a processor configured to perform:
- predicting a position and movement of a hand-held controller based on input from an inertial measurement unit (IMU), the hand-held controller comprising the IMU, and further based on one or more images captured by the camera system of a plurality of light emitters,
- monitoring a first form of movement based on the input from the IMU, the first form of movement comprising one or more of a rotational movement and a rotational rate of change,
- monitoring a second form of movement based on the one or more images captured by the camera system, the second form of movement different from the first form of movement,
- determining, based on the predicted position and movement of the hand-held controller, a position of virtual content in the see-through display of the wearable head device, and
- presenting the virtual content at the determined position in the see-through display of the wearable head device,
- wherein the plurality of light emitters is mounted on the hand-held controller,
- wherein the plurality of light emitters comprises a first plurality of light emitters of a first color and a second plurality of light emitters of a second color, different from the first color, and
- wherein a first tracking sensitivity associated with the first plurality of light emitters is greater than a second tracking sensitivity associated with the second plurality of light emitters.
9 more elements
A method comprising:
- predicting a position and movement of a hand-held controller based on input from an inertial measurement unit (IMU) of the hand-held controller, and further based on one or more images captured by a camera system of a plurality of light emitters, wherein the camera system is configured to capture images of a surrounding environment of a user of a wearable head device;
- monitoring a first form of movement based on the input from the IMU, the first form of movement comprising one or more of a rotational movement and a rotational rate of change;
- monitoring a second form of movement based on the one or more images captured by the camera system, the second form of movement different from the first form of movement;
- determining, based on the predicted position and movement of the hand-held controller, a position of virtual content in a see-through display of the wearable head device;
- and
- presenting the virtual content at the determined position in the see-through display of the wearable head device,
- wherein the plurality of light emitters is mounted on the hand-held controller,
- wherein the plurality of light emitters comprises a first plurality of light emitters of a first color and a second plurality of light emitters of a second color, different from the first color, and
- wherein a first tracking sensitivity associated with the first plurality of light emitters is greater than a second tracking sensitivity associated with the second plurality of light emitters.
6 more elements
A non-transitory computer readable medium comprising instructions that, when executed by one or more processors, cause the one or more processors to perform a method comprising:
- predicting a position and movement of a hand-held controller based on input from an inertial measurement unit (IMU) of the hand-held controller, and further based on one or more images captured by a camera system of a plurality of light emitters, wherein the camera system is configured to capture images of a surrounding environment of a user of a wearable head device;
- monitoring a first form of movement based on the input from the IMU, the first form of movement comprising one or more of a rotational movement and a rotational rate of change;
- monitoring a second form of movement based on the one or more images captured by the camera system, the second form of movement different from the first form of movement;
- determining, based on the predicted position and movement of the hand-held controller, a position of virtual content in a see-through display of the wearable head device;
- and
- presenting the virtual content at the determined position in the see-through display of the wearable head device,
- wherein the plurality of light emitters is mounted on the hand-held controller,
- wherein the plurality of light emitters comprises a first plurality of light emitters of a first color and a second plurality of light emitters of a second color, different from the first color, and
- wherein a first tracking sensitivity associated with the first plurality of light emitters is greater than a second tracking sensitivity associated with the second plurality of light emitters.
6 more elements
Dependencies are inferred from the claim text.