Sparse rgb filter hardware accelerator
AssigneeMeta Platforms Technologies, LLC
InventorJohn Enders ROBERTSON
Life of this patent
Estimating the term…
Abstract
A hardware accelerator includes a local buffer configured to receive and store stream data of a sparse color image that includes pixel data of panchromatic pixels and pixel data of color pixels, a first circuit configured to generate pixel data of a monochromatic image using the stream data received and stored in the local buffer while the local buffer continues to receive and store the stream data of the sparse color image, and a second circuit configured to generate pixel data of a Bayer color image using the stream data of the sparse color image received and stored in the local buffer and the pixel data of the monochromatic image while the local buffer continues to receive and store the stream data of the sparse color image.
Claims20
A device comprising:
- a local buffer configured to receive and store stream data of a sparse color image, wherein the stream data of the sparse color image includes pixel data of panchromatic pixels and pixel data of color pixels, the panchromatic pixels and the color pixels arranged in the sparse color image according to a pattern;
- a first circuit configured to generate, while the local buffer continues to receive and store the stream data of the sparse color image, pixel data of a monochromatic image using the stream data received and stored in the local buffer;
- and
- a second circuit configured to generate, while the local buffer continues to receive and store the stream data of the sparse color image, pixel data of a Bayer color image using the stream data of the sparse color image received and stored in the local buffer and the pixel data of the monochromatic image.
A display system comprising:
- an image sensor including a sparse color filter array and configured to capture a sparse color image of an environment of the display system, the sparse color image including panchromatic pixels and color pixels arranged according to a pattern of the sparse color filter array;
- an application processor configured to generate display data based on information in the sparse color image;
- and
- an accelerator on the image sensor, the application processor, or another device, the accelerator comprising:
- a local buffer configured to receive and store stream data of the sparse color image from the image sensor;
- a first circuit configured to generate, while the local buffer continues to receive and store the stream data of the sparse color image, pixel data of a monochromatic image using the stream data received and stored in the local buffer;
- and
- a second circuit configured to generate, while the local buffer continues to receive and store the stream data of the sparse color image, pixel data of a Bayer color image using the stream data received and stored in the local buffer and the pixel data of the monochromatic image.
A method comprising:
- storing, by a local buffer, stream data of a portion of a sparse color image, wherein the stream data of the portion of the sparse color image includes pixel data of panchromatic pixels and pixel data of color pixels, the panchromatic pixels and the color pixels arranged in the sparse color image according to a pattern;
- generating, by a first image filter, pixel data of a portion of a monochromatic image using the stream data of the portion of the sparse color image stored in the local buffer;
- saving, to the local buffer, pixel data of at least some pixels of the monochromatic image generated by the first image filter;
- and
- generating, by a second image filter, a portion of a Bayer color image using the stream data of the portion of the sparse color image stored in the local buffer and the pixel data of at least some pixels of the monochromatic image stored in the local buffer.
Dependencies are inferred from the claim text.