Real-time video frame pre-processing hardware
AssigneeFotoNation Limited
InventorsCorneliu ZAHARIA, Petronel BIGIOI, Peter CORCORAN
Life of this patent
Estimating the term…
Abstract
A dynamically reconfigurable heterogeneous systolic array is configured to process a first image frame, and to generate image processing primitives from the image frame, and to store the primitives and the corresponding image frame in a memory store. A characteristic of the image frame is determined. Based on the characteristic, the array is reconfigured to process a following image frame.
Claims20
An image processing hardware unit comprising:
- a frame receiving component configured to:
- receive frame data of a first image frame;
- a frame processing component configured to:
- generate, based on the frame data of the first image frame, an image processing primitive;
- wherein the image processing primitive is generated by identifying a sub-region of the first image frame and generating the image processing primitive from data of the sub-region;
- wherein the image processing primitive comprises an image map;
- an integral image accumulator configured to:
- generate, based on the image map, an integral image (II) primitive by computing for a first pixel of the II primitive a sum of luminance values of all pixels located above and to the left from the first pixel in the image map;
- and
- store the II primitive and the first image frame in a memory store.
An image processing method comprising:
- receiving frame data of a first image frame;
- generating, based on the frame data of the first image frame, an image processing primitive;
- wherein the image processing primitive is generated by identifying a sub-region of the first image frame and generating the image processing primitive from data of the sub-region;
- wherein the image processing primitive comprises an image map;
- generating, based on the image map, an integral image (II) primitive by computing for a first pixel of the II primitive a sum of luminance values of all pixels located above and to the left from the first pixel in the image map;
- and
- storing the II primitive and the first image frame in a memory store;
- wherein the method is performed using one or more computing devices.
A non-transitory computer-readable storage medium storing one or more computer instructions which, when executed, cause one or more processors to perform:
- receiving frame data of a first image frame;
- generating, based on the frame data of the first image frame, an image processing primitive;
- wherein the image processing primitive is generated by identifying a sub-region of the first image frame and generating the image processing primitive from data of the sub-region;
- wherein the image processing primitive comprises an image map;
- generating, based on the image map, an integral image (II) primitive by computing for a first pixel of the II primitive a sum of luminance values of all pixels located above and to the left from the first pixel in the image map;
- and
- storing the II primitive and the first image frame in a memory store.
Dependencies are inferred from the claim text.