Systems and methods for real-time alignment of a virtual image on an augmented reality display
AssigneesZsolt MiháLyfi, Gergely Dobos, KáRoly PéTer Bukvai, PéTer LáSzló TáLos, AndráS FehéRváRi, GáBor NéMeth
InventorsGERGELY HORVÁTH, ZSOLT MIHÁLYFI, GERGELY DOBOS
Life of this patent
Estimating the term…
Abstract
The present disclosure provides a method and augmented reality (AR) device for the real-time alignment of a virtual image on a real-world environment visible to a wearer through the display of the AR device. The method includes the calculation of a pixel offset value based on the distance from a distance measurement sensor of the device to a target object, a fixed distance between an imaging device of the AR device and an eye of the user, and a physical angle between the optical axis and the target object.
Claims20
A method for real-time alignment of a virtual image over a real-world environment on an augmented-reality (AR) device display, comprising:
- capturing at a first time, by a first imaging device, electromagnetic data of a target object in the user field-of-view (FOV), wherein the electromagnetic data comprises wavelengths of light that are not perceptible to the human eye;
- generating, based on the electromagnetic data, a first image that is visible to the human eye and projecting said first image on the AR device display;
- determining, by a first measurement sensor, a first distance (D) to the target object in the user FOV;
- determining, based on the first distance (D) and a fixed distance (d) between the first imaging device and an eye of the user, an angle (φ) between the optical axis and the target object;
- computing a pixel offset value to be applied to the first image such that it is projected on the AR device display aligned with the target object in the real-world environment;
- and
- re-projecting the first image on the display by the pixel offset value such that the first image is aligned with the target object in the real-world environment.
An augmented-reality (AR) display device comprising:
- one or more at least partially transparent lens located such that when the headset is worn by a user it overlays on the user's eye;
- means for projecting an image on to the one or more at least partially transparent lens;
- a first imaging device configured for capturing electromagnetic data at least comprising wavelengths of light that are not perceptible to the human eye;
- a first measurement sensor configured for determining a first distance (D) to a target object in the user's field-of-view (FOV);
- and
- one or more processors configured to execute the following steps:
- generating, based on the electromagnetic data captured by the first imaging device, a first image that is visible to the human eye;
- determining, based on the first distance (D) and a fixed distance (d) between the first imaging device and an eye of the user, an angle (φ) between the optical axis and the target object;
- computing a pixel offset value to be applied to the first image such that it is projected on one of the at least partially transparent lenses aligned with the target object in the real-world environment;
- and
- re-positioning the first image from the optical axis by the pixel offset value such that the first image is aligned with the target object in the real-world environment.
A non-transitory computer-readable medium comprising instructions that when executed by a computer processor cause the computer processor to:
- capture at a first time, by a first imaging device, electromagnetic data of a target object in the user field-of-view (FOV), wherein the electromagnetic data comprises wavelengths of light that are not perceptible to the human eye;
- generate, based on the electromagnetic data, a first image that is visible to the human eye and projecting said first image on the AR device display;
- determine, by a first measurement sensor, a first distance (D) to the target object in the user FOV;
- determining, based on the first distance (D) and a fixed distance (d) between the first imaging device and an eye of the user, an angle (φ) between the optical axis and the target object;
- compute a pixel offset value to be applied to the first image such that it is projected on the AR device display aligned with the target object in the real-world environment;
- and
- re-project the first image on the display by the pixel offset value such that the first image is aligned with the target object in the real-world environment.
Dependencies are inferred from the claim text.