Apparatuses, method and systems coupling visual accommodation and visual convergence to the same plane at any depth of an object of interest
AssigneeMeta View, Inc.
InventorsRaymond Chun Hing Lo, Stefano Baldassi
Life of this patent
Estimating the term…
Abstract
Aspects of the disclosed apparatuses, methods and systems provide three dimensional gradient and dynamic light fields for display in 3D technologies, in particular 3D augmented reality (AR) devices, by coupling visual accommodation and visual convergence to the same plane at any depth of an object of interest in real time.
Claims26
A method of adjusting a focal plane of a vision system, the vision system including a display and an optical element, the method comprising:
- displaying an image from one or more displays to a viewer of the vision system via the optical element;
- sensing information indicative of a position of one eye or both eyes of a viewer;
- processing the sensed information to determine the position of the one eye or both eyes of the viewer;
- and
- determining a point of convergence of the gaze of the viewer from the determined position;
- automatically adjusting the focal plane of the vision system displaying the image in response to the determined convergence point;
- and
- rendering depth dependent disparity or blur within the displayed image corresponding to a portion of the image lying outside of the adjusted focal plane to create a realistic or natural depth of focus experienced by the viewer, wherein rendering depth dependent disparity or blur within the displayed image corresponding to the adjusted focal plane to create a realistic or natural depth of focus experienced by the viewer further includes:
- determining one or more pixels of the display corresponding to a portion of the image that lies outside of the determined focal plane;
- and
- rendering a match disparity for the determined one or more pixels based on an offset distance measured between the two eyes of the viewer.
A vision system comprising:
- a display;
- an optical element operable to direct light of an image provided by the display to a viewer of the vision system;
- a sensor device;
- and
- a storage device including one or more applications including instructions;
- one or more processing devices operable to control the display, receive information generated by the sensor device, access the one or more applications stored by the storage device, and execute the instructions of the one or more applications, the instructions causing the one or more processing devices to:
- render an image on the one or more displays;
- process the information from the sensor device to determine a position of one eye or both eyes of the viewer;
- determine a point of convergence of the gaze of the viewer from the determined position;
- adjust a focal plane of the vision system to display the image in response to the determined convergence point;
- and
- render depth dependent disparity or blur within the displayed image corresponding to a portion of the image lying outside of the adjusted focal plane to create a realistic or natural depth of focus experienced by the viewer, wherein the instructions causing the one or more processing devices to render depth dependent disparity or blur within the displayed image corresponding to the portion of the image lying outside of the adjusted focal plane to create a realistic or natural depth of focus experienced by the viewer further includes instructions to cause the one or more processing devices to:
- determine one or more pixels of the display corresponding to a portion of the image that lies outside of the determined focal plane;
- and
- render a match disparity for the determined pixels based on an offset distance measured between the two eyes of the viewer.
A computer program product stored on a non-transitory storage medium, the computer program product including instructions that when executed by one or more processing devices cause the one or more processing devices to:
- render an image;
- process information detected by a sensor corresponding to one eye or both eyes of a viewer of a vision system to determine a position of the one eye or both eyes of the viewer;
- determine a point of convergence of the gaze of the viewer from the determined position;
- adjust a focal plane of the vision system displaying the image in response to the determined convergence point;
- and
- render depth dependent disparity or blur within the displayed image corresponding to the portion of the image lying outside of the adjusted focal plane to create a realistic or natural depth of focus experienced by the viewer, wherein rendering depth dependent disparity or blur within the displayed image corresponding to the portion of the image lying outside of the adjusted focal plane to create a realistic or natural depth of focus experienced by the viewer further includes instructions that when executed by one or more processing devices cause the one or more processing devices to:
- determine one or more pixels of the display corresponding to a portion of the image that lies outside of the determined focal plane;
- and
- render a match disparity for the determined pixels based on an offset distance measured between the two eyes of the viewer.
Dependencies are inferred from the claim text.