Generating lighting map using ambient light sensor and tracking camera
AssigneeVarjo Technologies Oy
InventorsVille Timonen, Tuomas Tölli
Life of this patent
Estimating the term…
Loading patent…
AssigneeVarjo Technologies Oy
InventorsVille Timonen, Tuomas Tölli
Estimating the term…
Disclosed is head-mounted display (HMD) apparatus with an ambient light sensor (ALS), tracking camera (TC), video-see-through (VST) camera, and processor(s) configured to: capture average red-green-blue (RGB) illuminance (A) of region of real-world environment (RE) from HMD pose; capture grayscale image (GI) of RE from HMD pose, wherein pixel values indicate intensities (i); calculate average TC intensity (I) for part of FOV of TC that overlaps with FOV of ALS, based on intensities (i); calculate average illuminance (J) for said part of FOV of TC that overlaps with FOV of ALS, based on intensities (i) and pre-determined response (r) of ALS; calculate corrected average RGB illuminance (AC) for region from HMD pose, based on A and ratio of I and J; and determine RGB illuminance for each pixel of GI, based on AC, ratio of intensity (i) of said pixel in GI to I.
A head-mounted display (HMD) apparatus comprising:
A method implemented by a head-mounted display (HMD) apparatus comprising an ambient light sensor, a tracking camera, a video-see-through (VST) camera, at least one processor, wherein the method comprises:
Dependencies are inferred from the claim text.