Back to results
US 10,769,852 B2Granted
Method for simulating natural perception in virtual and augmented reality scenes
OwnerTerrence Edward McArdle, Benjamin Zeis Newhouseinventors
Life of this patent
Estimating the term…
Abstract
A preferred method for dynamically displaying virtual and augmented reality scenes can include determining input parameters, calculating virtual photometric parameters, and rendering a VAR scene with a set of simulated photometric parameters.
Claims20
A method for dynamically displaying virtual and augmented reality (VAR) scenes comprising:
- capturing a plurality of real images comprising a plurality of real photometric parameters with a camera of a device;
- determining visual input parameters for the device based on the plurality of real images by calculating a graphical projection of a three-dimensional VAR scene of the plurality of real images without synthetic components to be shown on a digital display of the device, calculating a visual locus of the three-dimensional VAR scene for the digital display of the device, and computing a discretized ray direction of the three-dimensional VAR scene for each image of the plurality of real images through the visual locus;
- storing the plurality of real images, the plurality of real photometric parameters of the plurality of real images, and locations of the plurality of real images within the three-dimensional VAR scene on the device;
- based on the plurality of real photometric parameters of the plurality of real images, determining a plurality of virtual photometric parameters, wherein the plurality of virtual photometric parameters comprise at least one of:
- a first component for focus measured as focal length or aperture size;
- or a second component for a response to various forms of polarized light;
- generating a map of the three-dimensional VAR scene of the plurality of real images by capturing a pair of image values for each of the plurality of real images along a corresponding discretized ray direction in the three-dimensional VAR scene as each image is captured, identifying the virtual photometric parameters that intersect at each discretized ray direction for the plurality of real images, and, for each discretized ray direction, computing a plurality of intrinsic photographic inputs to define a parameterized photometric simulation function;
- and
- rendering the three-dimensional VAR scene of the plurality of real images with a plurality of simulated virtual photometric parameters by determining a value of each pixel for the three-dimensional VAR scene using the parameterized photometric simulation function and rendering a plurality of pixels into an output image that comprises some of the plurality of real images without synthetic components depicted within the VAR scene.
6 more elements
A non-transitory computer readable storage medium comprising instructions that, when executed by at least one processor, cause a computing device to:
- capture a plurality of real images comprising a plurality of real photometric parameters with a camera of the computing device;
- determine visual input parameters for the computing device based on the plurality of real images by calculating a graphical projection of a three-dimensional virtual and augmented reality (VAR) scene of the plurality of real images without synthetic components to be shown on a digital display of the computing device, calculating a visual locus of the three-dimensional VAR scene for the digital display of the computing device, and computing a discretized ray direction of the three-dimensional VAR scene for each image of the plurality of real images through the visual locus;
- store the plurality of real images, the plurality of real photometric parameters of the plurality of real images, and locations of the plurality of real images within the three-dimensional VAR scene on the computing device;
- based on the plurality of real photometric parameters of the plurality of real images, determine a plurality of virtual photometric parameters, wherein the plurality of virtual photometric parameters comprise at least one of a first component for focus measured as focal length or aperture size or a second component for a response to various forms of polarized light;
- generate a map of the three-dimensional VAR scene of the plurality of real images by capturing a pair of image values for each of the plurality of real images along a corresponding discretized ray direction in the three-dimensional VAR scene as each image is captured, identifying the virtual photometric parameters that intersect at each discretized ray direction for the plurality of real images, and, for each discretized ray direction, computing a plurality of intrinsic photographic inputs to define a parameterized photometric simulation function;
- and
- render the three-dimensional VAR scene of the plurality of real images with a plurality of simulated virtual photometric parameters by determining a value of each pixel for the three-dimensional VAR scene using the parameterized photometric simulation function and rendering a plurality of pixels into an output image that comprises some of the plurality of real images without synthetic components depicted within the VAR scene.
4 more elements
A non-transitory computer readable storage medium comprising instructions that, when executed by at least one processor, cause a system to:
- receive a plurality of real images comprising a plurality of real photometric parameters with a camera of a client device;
- determine visual input parameters for the client device based on the plurality of real images by calculating a graphical projection of a three-dimensional virtual and augmented reality (VAR) scene of the plurality of real images without synthetic components to be shown on a digital display of the client device, calculating a visual locus of the three-dimensional VAR scene for the digital display of the client device, and computing a discretized ray direction of the three-dimensional VAR scene for each image of the plurality of real images through the visual locus;
- store the plurality of real images, the plurality of real photometric parameters of the plurality of real images, and locations of the plurality of real images within the three-dimensional VAR scene on the system;
- based on the plurality of real photometric parameters of the plurality of real images, determine a plurality of virtual photometric parameters, wherein the plurality of virtual photometric parameters comprise at least one of:
- a first component for focus measured as focal length or aperture size;
- or a second component for a response to various forms of polarized light;
- generate a map of the three-dimensional VAR scene of the plurality of real images by capturing a pair of image values for each of the plurality of real images along a corresponding discretized ray direction in the three-dimensional VAR scene as each image is captured, identifying the virtual photometric parameters that intersect at each discretized ray direction for the plurality of real images, and, for each discretized ray direction, computing a plurality of intrinsic photographic inputs to define a parameterized photometric simulation function;
- and
- generate, for display on the client device, the three-dimensional VAR scene of the plurality of real images with a plurality of simulated virtual photometric parameters by determining a value of each pixel for the three-dimensional VAR scene using the parameterized photometric simulation function and generating a plurality of pixels for an output image that comprises some of the plurality of real images without synthetic components depicted within the VAR scene.
6 more elements
Dependencies are inferred from the claim text.