Sensor system based on stacked sensor layers
AssigneeFacebook Technologies, LLC
InventorXinqiao Liu
Life of this patent
Estimating the term…
Abstract
A sensor assembly for determining one or more features of a local area is presented herein. The sensor assembly includes a plurality of stacked sensor layers. A first sensor layer of the plurality of stacked sensor layers located on top of the sensor assembly includes an array of pixels. The top sensor layer can be configured to capture one or more images of light reflected from one or more objects in the local area. The sensor assembly further includes one or more sensor layers located beneath the top sensor layer. The one or more sensor layers can be configured to process data related to the captured one or more images. A plurality of sensor assemblies can be integrated into an artificial reality system, e.g., a head-mounted display.
Claims25
A sensor assembly comprising:
- a sensor layer, of a plurality of stacked layers, including an array of pixels configured to capture one or more first images;
- and
- one or more processing layers of the plurality of stacked layers located in the sensor assembly beneath the sensor layer, the one or more processing layers configured to:
- extract features of one or more objects and their pixel locations from the one or more first images;
- and
- enable a subset of the array of pixels based on the pixel locations to capture one or more second images of the one or more objects.
The sensor assembly of 14, wherein the map of pixel locations is a first map of pixel locations;
- and
- wherein the one or more processing layers are configured to:
- generate, based on one or more second images, a second map of pixel locations of the features of the one or more objects;
- and
- transmit the second map to the host device.
A head-mounted display (HMD) comprising:
- a sensor assembly including:
- a sensor layer, of a plurality of stacked layers, including an array of pixels configured to capture one or more first images, and
- one or more processing layers of the plurality of stacked layers located beneath the sensor layer, the one or more processing layers configured to:
- extract features of one or more objects and their pixel locations from the one or more first images;
- and
- enable a subset of the array of pixels based on the pixel locations to capture one or more second images of the one or more objects;
- and
- an optical assembly configured to direct image light to an eye box corresponding to a location of a user's eye,
- wherein depth information is determined based on the extracted features of the one or more objects.
A mobile device comprising:
- a sensor assembly including:
- a sensor layer, of a plurality of stacked layers, including an array of pixels configured to capture one or more first images, and
- one or more processing layers of the plurality of stacked layers located beneath the sensor layer, the one or more processing layers configured to:
- extract features of one or more objects and their pixel locations from the one or more first images;
- and
- enable a subset of the array of pixels based on the pixel locations to capture one or more second images of the one or more objects;
- and
- an optical assembly configured to direct image light to an eye box corresponding to a location of a user's eye,
- wherein depth information is determined based on the extracted features of the one or more objects.
Dependencies are inferred from the claim text.