Methods and systems for augmented reality
AssigneeEssilor International
InventorsAude Bouchier, Jean-Paul Cano, Samuel Archambeau
Life of this patent
Estimating the term…
Abstract
A method and system for image display with a head-mounted device, which use a see-through tunable diffractive mirror, such as a see-through tunable holographic mirror or see-through tunable LCD array mirror, which mirror is useful in providing augmented reality.
Claims19
A head-mounted device to be worn by a wearer, configured for display and visualization, by the wearer, of computer-generated images, the head-mounted device comprising:
- an image source;
- a see-through tunable diffractive mirror, situated in front of one eye of the wearer;
- a controller configured to tune the mirror;
- an ophthalmic lens;
- and
- at least one scene camera,
- wherein the image source is configured for emission of a light beam towards the mirror, wherein the emitted light beam is reflected onto the mirror and thereby is directed towards the eye of the wearer, to cause visualization of a computer-generated image by the wearer,
- wherein the head-mounted device is configured to:
- determine a distance and/or gaze direction of visualization by the wearer, of an object in a natural vision field, based on data collected from the scene camera;
- and
- tune the mirror to adjust the distance and/or gaze direction of visualization by the wearer, of the computer-generated image, as a function of the distance and/or gaze direction determined by the head-mounted device,
- wherein the at least one scene camera is a plenoptic camera provided with a micro-lens array placed in front of a sensor matrix configured to analyze a scene in natural vision, in which each micro-lens corresponds to a group of pixels so that beams from the scene are distributed by each micro-lens onto the pixel groups according to their direction and distance of the object in the scene, in order to obtain an image containing the position, distance, and direction of the object in natural vision,
- the head-mounted device being configured to integrate into the scene the adjusted computer-generated image, which evolves within the scene,
- wherein the ophthalmic lens is configured to correct a wearer's ametropia in natural vision, the ophthalmic lens being a multifocal lens selected from bifocal lenses and progressive addition lenses,
- wherein the mirror is provided on the ophthalmic lens, being provided on a front face, on a rear face, or within the bulk of the ophthalmic lens,
- wherein the mirror comprises at least an area for near vision and an area for far vision corresponding to distinct values of distance of visualization of the displayed computer-generated image by the wearer, and
- wherein the mirror is tuned to adjust the wearer's vision for the visualization of the displayed computer-generated image, the mirror being tuned to correct the wearer's ametropia for the visualization of the computer-generated image by the wearer.
A method for integrating into a scene in natural vision a computer-generated image by a see-through head-mounted device to be worn by a wearer, with a see-through tunable diffractive mirror of the head-mounted device, wherein the head-mounted device comprises an image source and at least one scene camera which is a plenoptic camera provided with a micro-lens array placed in front of a sensor matrix configured to analyze the scene in natural vision, in which each micro-lens corresponds to a group of pixels, and wherein the image source is configured for emission of a light beam towards the mirror, wherein the emitted light beam is reflected onto the mirror and thereby is directed towards an eye of the wearer, to cause visualization of a computer-generated image by the wearer, the method comprising:
- adjusting a distance and/or gaze direction of visualization, by the wearer, of the computer-generated image, as a function of a determined distance and/or gaze direction of visualization, by the wearer, of an object in a natural vision field, based on data collected from the scene camera so that beams from the scene are distributed by each micro-lens onto the pixel groups according to their direction and distance of the object in the scene, in order to obtain an image containing the position, distance, and direction of the object in natural vision and so that the adjusted computer-generated image evolves within the scene,
- wherein an ophthalmic lens of the head-mounted device corrects a wearer's ametropia in natural vision and is a multifocal lens selected from bifocal lenses and progressive addition lenses,
- wherein the mirror, which is provided on the ophthalmic lens on a front face, on a rear face, or within the bulk of the ophthalmic lens, comprises at least an area for near vision and an area for far vision corresponding to distinct values of distance of visualization of the displayed computer-generated image by the wearer, and
- wherein the mirror is tuned to adjust the wearer's vision for the visualization of the displayed computer-generated image, the mirror being tuned to correct the wearer's ametropia for the visualization of the computer-generated image by the wearer.
A method for the display and visualization of computer-generated images, the method comprising:
- tuning a see-through tunable diffractive mirror of a head-mounted device, the head-mounted device including an image source, the mirror, which is situated in front of one eye of a wearer, a controller configured to tune the mirror, and at least one scene camera which is a plenoptic camera provided with a micro-lens array placed in front of a sensor matrix configured to analyze a scene in natural vision, in which each micro-lens corresponds to a group of pixels, wherein the image source is configured for emission of a light beam towards the mirror, wherein the emitted light beam is reflected onto the mirror and thereby is directed towards the eye of the wearer, to cause visualization of a computer-generated image by the wearer, wherein the tuning comprises
- determining a distance and/or gaze direction of visualization, by the wearer, of an object in the natural vision field, based on data collected from the scene camera so that beams from the scene are distributed by each micro-lens onto the pixel groups according to their direction and distance of the object in the scene, in order to obtain an image containing the position, distance, and direction of the object in natural vision, and
- tuning the mirror to adjust the distance and/or gaze direction of visualization, by the wearer, of the computer-generated image, as a function of the distance and/or gaze direction determined by the determining,
- wherein an ophthalmic lens of the head-mounted device corrects a wearer's ametropia in natural vision and is a multifocal lens selected from bifocal lenses and progressive addition lenses,
- wherein the mirror, which is provided on the ophthalmic lens on a front face, on a rear face, or within the bulk of the ophthalmic lens, comprises at least an area for near vision and an area for far vision corresponding to distinct values of distance of visualization of the displayed computer-generated image by the wearer, and
- wherein the mirror is tuned to correct the wearer's ametropia for the visualization of the computer-generated image by the wearer.
Dependencies are inferred from the claim text.