RGB-IR pixel pattern conversion via adaptive filtering

A pattern conversion component in an image processing pipeline, comprising:

• an interface configured to communicate with upstream components and downstream components of the image processing pipeline relative to the pattern conversion component;
• and
• circuitry coupled to the interface and configured to:
• obtain, via the interface, red green blue (RGB)-infrared (IR) pixel data produced by an upstream component of the image processing pipeline;
• convert the RGB-IR pixel data into RGB pixel data and IR pixel data using an adaptive filter;
• and
• supply, via the interface, the RGB pixel data and the IR pixel data to a downstream component of the image processing pipeline;
• wherein to convert the RGB-IR pixel data into the RGB pixel data and the IR pixel data, the circuitry is configured to, for each pixel of the RGB-IR pixel data:
• select a weight from weights generated for the pixel based on a type of conversion operation including a remosaicing operation, an upsampling operation, and a decontamination operation;
• and
• apply the weight to the pixel, resulting in an interpolated value for the pixel for use in the conversion operation.

A method comprising:

• obtaining, by a pattern conversion component of an image processing pipeline, red green blue (RGB)-infrared (IR) pixel data produced by a component of the image processing pipeline upstream relative to the pattern conversion component;
• converting, by the pattern conversion component, the RGB-IR pixel data into RGB pixel data and IR pixel data by:
• identifying, by the pattern conversion component, features of pixels of the RGB-IR pixel data based on a context of the pixels;
• calculating, by the pattern conversion component, weights for the pixels based on the features;
• and
• applying, by the pattern conversion component, a weight to each of the pixels, wherein the applied weight is selected based on a color channel of a given pixel and a type of conversion operation applied to the given pixel, and wherein the type of operation includes one or more of a remosaicing operation, an upsampling operation, and a decontamination operation;
• and
• supplying, by the pattern conversion component, the RGB pixel data and IR pixel data to a downstream component of the image processing pipeline relative to the pattern conversion component.