Visual tracking of peripheral devices
AssigneeMagic Leap, Inc.
InventorsZachary C. Nienstedt, Samuel A. Miller, Barak Freedman, Lionel Ernest Edwin, Eric C. Browy, William Hudson Welch, Ron Liraz Lidji
Life of this patent
Estimating the term…
Abstract
An augmented reality (AR) system includes a wearable device comprising a display inside the wearable device and operable to display virtual content and an imaging device mounted to the wearable device. The AR system also includes a handheld device comprising handheld fiducials affixed to the handheld device and a computing apparatus configured to perform localization of the handheld device with respect to the wearable device.
Claims20
An augmented reality (AR) system, the AR system comprising:
- a wearable device comprising:
- a display inside the wearable device and operable to display virtual content;
- and
- an imaging device mounted to the wearable device;
- a peripheral device comprising peripheral fiducials affixed to the peripheral device, wherein the imaging device is operable to capture a fiducial image containing a number of peripheral fiducials of the peripheral fiducials;
- and
- a computing apparatus configured to:
- determine the number of peripheral fiducials in the fiducial image;
- determine the number of peripheral fiducials is greater than or equal to a first value;
- and
- perform, responsive to the number of peripheral fiducials being greater than or equal to the first value, localization of the peripheral device with respect to the wearable device using only the fiducial image.
A method of performing localization of a peripheral device with respect to a wearable device, the method comprising:
- obtaining, by a wearable imaging device mounted on the wearable device, fiducial data indicative of movement of the peripheral device;
- obtaining, by a peripheral imaging device mounted on the peripheral device, peripheral fiducial data indicative of movement of the wearable device;
- and
- updating a position and an orientation of the peripheral device using the fiducial data and the peripheral fiducial data.
Dependencies are inferred from the claim text.