US 12,182,963 B2 · Image processing apparatus and method implementing a neural network to pre-process a CFM image for further process by ISP pipeline

Abstract

An image processing apparatus processes a color filter mosaic, CFM, image of a scene into a final image of the scene. The image processing apparatus includes processing circuitry configured to implement a neural network. The neural network is configured to process the CFM image into an enhanced CFM image. The processing circuitry is further configured to transform the enhanced CFM image into the final image.

Claims11

Dependent claims

An image processing apparatus for processing an original color filter mosaic (CFM) image of a scene into a final image of the scene, the image processing apparatus comprising processing circuitry configured to:

implement a neural network and process the original CFM image into an enhanced CFM image using the neural network, the original CFM image and the enhanced CFM image corresponding to a same CFM, wherein the neural network is implemented as a pre-processing stage prior to and independent of an image signal processing (ISP) pipeline, so that no retraining of the neural network is required in case of modifications of the ISP pipeline, and
transform, by applying the ISP pipeline, the enhanced CFM image into the final image.

Dependencies are inferred from the claim text.

Facts

Application

17/458,699Filed 27 Aug 2021 · continuation

Priority

27 Feb 2019

Published

US 2021/0390658 A116 Dec 2021

Granted

31 Dec 2024

Term ends

Not estimatedThe source records don’t support an estimate.

Classification22 codes

H04N 9/646
Circuits for processing colour signals: for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction,…
G06N 3/045
Architecture, e.g. interconnection topology: combinations of networks
G06N 3/0464
Architecture, e.g. interconnection topology: convolutional networks [CNN, ConvNet]
G06N 3/08
Neural networks: learning methods

Image processing apparatus and method implementing a neural network to pre-process a CFM image for further process by ISP pipeline

Life of this patent

Image processing apparatus and method implementing a neural network to pre-process a CFM image for further process by ISP pipeline

Life of this patent

Abstract

Claims11