Foveated image capture for power efficient video see-through
AssigneeApple Inc.
InventorsAnup K. Sharma, Andrew K. McMahon
Life of this patent
Estimating the term…
Abstract
Generating an image stream may include obtaining image data from a camera, identifying a first subset of the image data including a region of interest, identifying a second subset of the image data different than the first subset of the image data, processing the first subset of image data by a first processing pipeline to obtain a first processed set of image data, processing the second subset of image data by a second processing pipeline to obtain a second processed set of image data, wherein the second processing pipeline processes at a lower quality than the first processing pipeline, and combining the first processed set of image data and the second processed set of image data to obtain a processed image frame.
Claims20
A method comprising:
- obtaining image data from a camera corresponding to an image frame;
- determining a region of interest in the image data;
- identifying a first subset of the image data corresponding to the region of interest and a second subset of the image data different than the first subset of the image data;
- processing, by a first processing pipeline of a plurality of processing pipelines, the first subset of the image data to obtain a first processed set of the image data, wherein the first processing pipeline is configured to apply a first processing technique;
- processing the second subset of the image data by a second processing pipeline of the plurality of processing pipelines to obtain a second processed set of the image data, wherein the second processing pipeline is configured to perform a different processing method than the first processing pipeline, wherein the second processing pipeline is configured to apply a second processing technique;
- and
- combining the first processed set of the image data and the second processed set of the image data to obtain a processed image frame.
A non-transitory computer readable medium comprising computer readable code executable by one or more processors to:
- obtain image data from a camera corresponding to an image frame;
- determine a region of interest in the image data;
- identify a first subset of the image data corresponding to the region of interest and a second subset of the image data different than the first subset of the image data;
- process, by a first processing pipeline of a plurality of processing pipelines, the first subset of the image data to obtain a first processed set of the image data, wherein the first processing pipeline is configured to apply a first processing technique;
- process the second subset of the image data by a second processing pipeline of the plurality of processing pipelines to obtain a second processed set of the image data, wherein the second processing pipeline is configured to perform a different processing method than the first processing pipeline, wherein the second processing pipeline is configured to apply a second processing technique;
- and
- combine the first processed set of the image data and the second processed set of the image data to obtain a processed image frame.
A system comprising:
- one or more processors;
- and
- one or more non-transitory computer readable media comprising computer readable code executable by the one or more processors to:
- obtain image data from a camera corresponding to an image frame;
- determine a region of interest in the image data;
- identify a first subset of the image data corresponding to the region of interest and a second subset of the image data different than the first subset of the image data;
- process, by a first processing pipeline of a plurality of processing pipelines, the first subset of the image data to obtain a first processed set of the image data, wherein the first processing pipeline is configured to apply a first processing technique;
- process the second subset of the image data by a second processing pipeline of the plurality of processing pipelines to obtain a second processed set of the image data, wherein the second processing pipeline is configured to perform a different processing method than the first processing pipeline, wherein the second processing pipeline is configured to apply a second processing technique;
- and
- combine the first processed set of the image data and the second processed set of the image data to obtain a processed image frame.
Dependencies are inferred from the claim text.