Environment matching for mixed reality
AssigneeMeta Platforms Technologies, LLC
InventorsJun Miao, Guodong Rong, Honghong Peng, Ruidong Zhu, Jeanne Vu, Jiangtao Kuang, Alex Dongseok Shin, Zilong Li
Life of this patent
Estimating the term…
Abstract
Systems and methods for Mixed Reality (MR) applications in a head-mounted display. In implementations, an ambient light sensor (ALS) or world-side camera capture an ambient light measurement of an environment of a world-side scene. In some aspects, based on the ambient light measurement, one or more processing logic may be configured to adjust a brightness and/or color temperature of pass-through images and virtual images to harmonize a user's viewing experience while using the head-mounted display.
Claims20
A head-mounted display comprising:
- a world-side camera configured to capture pass-through images;
- a photodetector configured to capture an ambient light measurement of an environment of a world-side scene;
- a display configured to emit display light to an eyebox region;
- and
- one or more processing logic configured to:
- receive the pass-through images from the world-side camera;
- receive the ambient light measurement from the photodetector;
- adjust the pass-through images subsequent to receiving the pass-through image from the world-side camera, wherein adjusting the pass-through images includes adjusting at least one of a color or brightness of the pass-through images based on the ambient light measurement;
- adjust virtual images by adjusting one or more virtual images to harmonize with the adjusted pass-through images;
- and
- drive the adjusted pass-through images and adjusted virtual images on to the display.
A method comprising:
- capturing, pass-through images of a world-side of a head-mounted display (HMD);
- initiating an ambient light measurement of an environment of the world-side with a photodetector of the HMD;
- generating adjusted pass-through images by adjusting at least one of a color or brightness of the pass-through images based on the ambient light measurement, wherein generating the adjusted pass-through images is performed subsequent to capturing the pass-through images;
- generating adjusted virtual images by adjusting one or more virtual images to harmonize with the adjusted pass-through images;
- and
- driving the adjusted pass-through images and the adjusted virtual images onto a display of the HMD.
A non-transitory computer readable medium including instructions stored thereon which when executed by one or more processors, cause a head-mounted display to:
- capture pass-through images of a world-side of a head-mounted display (HMD);
- initiate an ambient light measurement of an environment of the world-side with a photodetector of the HMD;
- generate adjusted pass-through images by adjusting at least one of a color warmth or brightness of the pass-through images based on the ambient light measurement, wherein generating the adjusted pass-through images is performed subsequent to capturing the pass-through images;
- generate adjusted virtual images by adjusting one or more virtual images to harmonize with the adjusted pass-through images;
- and
- drive the adjusted pass-through images and the adjusted virtual images onto a display of the HMD.
Dependencies are inferred from the claim text.