Visual tracking of peripheral devices
AssigneeMagic Leap, Inc.
InventorsZachary C. Nienstedt, Samuel A. Miller, Barak Freedman, Lionel Ernest Edwin, Eric C. Browy, William Hudson Welch, Ron Liraz Lidji
Life of this patent
Estimating the term…
Abstract
An augmented reality (AR) system includes a wearable device comprising a display inside the wearable device and operable to display virtual content and an imaging device mounted to the wearable device. The AR system also includes a handheld device comprising handheld fiducials affixed to the handheld device and a computing apparatus configured to perform localization of the handheld device with respect to the wearable device.
Claims20
An augmented reality (AR) system comprising:
- a wearable device comprising:
- a display disposed inside the wearable device and operable to display virtual content;
- and
- wearable fiducials affixed to the wearable device;
- a peripheral device comprising an imaging device mounted to the peripheral device that captures a fiducial image containing a number of wearable fiducials;
- and
- a computing apparatus configured to perform localization of the peripheral device with respect to the wearable device based on:
- solely the fiducial image when the number of wearable fiducials is determined to be greater than or equal to a first value;
- or
- a combination of peripheral sensor data and the fiducial image when the number of wearable fiducials is determined to be less than the first value.
An augmented reality (AR) system comprising:
- a wearable device comprising:
- a display disposed inside the wearable device and operable to display virtual content;
- and
- a wearable imaging device mounted to the wearable device;
- a peripheral device comprising:
- a peripheral imaging device mounted to the peripheral device;
- and
- peripheral fiducials affixed to the peripheral device, wherein the wearable imaging device is operable to capture a fiducial image containing a number of peripheral fiducials;
- and
- a computing apparatus configured to perform localization of the peripheral device with respect to the wearable device based on:
- solely the fiducial image when the number of peripheral fiducials is determined to be greater than or equal to a first value;
- or
- a combination of peripheral sensor data and the fiducial image when the number of peripheral fiducials is determined to be less than the first value.
A method of performing localization of a peripheral device with respect to a wearable device, the method comprising:
- obtaining, by a wearable imaging device mounted on the wearable device, a fiducial image containing a number of peripheral fiducials affixed to the peripheral device;
- determining the number of peripheral fiducials in the fiducial image;
- and
- updating a position and an orientation of the peripheral device based on:
- solely the fiducial image when the number of peripheral fiducials is determined to be greater than or equal to a first value;
- or
- a combination of peripheral sensor data and the fiducial image when the number of peripheral fiducials is determined to be less than the first value.
Dependencies are inferred from the claim text.