Foveated camera for video augmented reality and head mounted display
AssigneeMicrosoft Technology Licensing, LLC
InventorBrian K. Guenter
Life of this patent
Estimating the term…
Abstract
Using a foveated camera for video augmented reality via a head mounted display is provided. A camera may be placed in a binning mode; a full frame binned image may be captured using the camera and the binning mode of the camera may be turned off. A region of interest may be selected within the full frame; the region of interest may be captured at a higher resolution than the resolution of the camera when in binning mode; the region of interest may be composited with the full frame binned image; and the composited image may be displayed.
Claims20
A method, comprising:
- providing a head-mounted display comprising a right lens, a left lens, and a camera;
- placing the camera in a binning mode;
- capturing a full frame binned image using the camera and turning off the binning mode of the camera;
- selecting a region of interest within the full frame;
- capturing the region of interest at a higher resolution than the resolution of the camera when in the binning mode;
- compositing the region of interest with the full frame binned image;
- and
- displaying the composited image, wherein the left lens is refreshed with the composited image at a first time, wherein the right lens is refreshed with a next composited image at a second time, and wherein the second time is half a refresh period from the first time.
A head mounted display, comprising:
- a camera capable of capturing a region of interest and of binning;
- a display comprising:
- a right lens;
- and
- a left lens;
- a processor coupled to the camera and the display, the processor operable to:
- place the camera in a binning mode;
- capture a full frame binned image;
- designate a region of interest within the camera frame;
- capture the region of interest using the camera;
- composite the region of interest with the full frame binned image;
- refresh the left lens with the region of interest with the full frame binned image at a first time;
- and
- refresh the right lens with a next region of interest with a next full frame binned image at a second time, and wherein the second time is half a refresh period from the first time.
A computer storage medium associated with a head-mounted display comprising a right lens, a left lens, and a camera, the computer storage medium containing computer executable instructions which, when executed by a computer, perform a method comprising the acts of:
- receiving a lower resolution binned full frame image from the camera;
- receiving a higher resolution region of interest image from within a frame of the camera;
- compositing the received lower resolution image with the higher resolution image;
- and
- displaying the composited image, wherein the left lens is refreshed with the composited image at a first time, wherein the right lens is refreshed with a next composited image at a second time, and wherein the second time is half a refresh period from the first time.
Dependencies are inferred from the claim text.