US 12,382,164 B2 · Three-dimensional noise reduction

Abstract

Systems and methods are disclosed for image signal processing. For example, methods may include receiving a current image of a sequence of images from an image sensor; combining the current image with a recirculated image to obtain a noise reduced image, where the recirculated image is based on one or more previous images of the sequence of images from the image sensor; determining a noise map for the noise reduced image, where the noise map is determined based on estimates of noise levels for pixels in the current image, a noise map for the recirculated image, and a set of mixing weights; recirculating the noise map with the noise reduced image to combine the noise reduced image with a next image of the sequence of images from the image sensor; and storing, displaying, or transmitting an output image that is based on the noise reduced image.

Claims20

Dependent claims

A system, comprising:

an image sensor configured to capture image data using a plurality of selectable exposure times;
and
a processing apparatus configured to:
receive a first image from the image sensor, wherein the first image is captured with a first exposure time;
receive a second image from the image sensor, wherein the second image is captured with a second exposure time that is less than the first exposure time;
determine a high dynamic range image based on the first image and the second image, wherein determining the high dynamic range image includes using a blending ratio map to specify how an image portion of the second image is combined with a corresponding image portion of the first image to determine a corresponding image portion of the high dynamic range image;
and
store, display, or transmit an output image that is based on the high dynamic range image.

5 more elements

A method comprising:

receiving a first image from an image sensor, wherein the first image is captured with a first exposure time;
receiving a second image from the image sensor, wherein the second image is captured with a second exposure time that is less than the first exposure time;
determining a high dynamic range image based on the first image and the second image, wherein determining the high dynamic range image includes, responsive to a value of a pixel of an image component of the first image being in a range near a saturation level, determining a blending ratio based on a difference between the saturation level and the value of the pixel, and determining a corresponding image component of the high dynamic range image based on a weighted sum, using the blending ratio as a weight, of the image component of the first image and a corresponding image component of the second image;
and
storing, displaying, or transmitting an output image that is based on the high dynamic range image.

2 more elements

A non-transitory computer-readable storage medium storing executable instructions that, when executed by a processor, facilitate performance of operations, comprising:

receiving a first image from an image sensor, wherein the first image is captured with a first exposure time;
receiving a second image from the image sensor, wherein the second image is captured with a second exposure time that is less than the first exposure time;
determining a high dynamic range image based on the first image and the second image, wherein determining the high dynamic range image includes, responsive to a value of a pixel of an image component of the first image being in a range near a saturation level, determining a blending ratio based on a difference between the saturation level and the value of the pixel, and determining a corresponding image component of the high dynamic range image based on a weighted sum, using the blending ratio as a weight, of the image component of the first image and a corresponding image component of the second image;
and
storing, displaying, or transmitting an output image that is based on the high dynamic range image.

2 more elements

Dependencies are inferred from the claim text.

Facts

Application

18/134,123Filed 13 Apr 2023 · continuation

Priority

25 May 2016

Published

US 2023/0247281 A13 Aug 2023

Granted

5 Aug 2025

Term ends

Not estimatedThe source records don’t support an estimate.

Classification44 codes

H04N 19/597
Using predictive coding: specially adapted for multi-view video sequence encoding
H04N 23/64
Control of cameras or camera modules: computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality,…
G06T 3/18
Geometric image transformations in the plane of the image: image warping, e.g. rearranging pixels individually
G06T 3/4038
Scaling of whole images or parts thereof, e.g. expanding or contracting: image mosaicing, e.g. composing plane images from plane sub-images

Family

Application62/341,580Us provisional application · filed 25 May 2016

Application62/341,415Us provisional application · filed 25 May 2016

Application15/268,038Parent of this continuation-in-part · filed 16 Sep 2016

Application15/358,495Parent of this continuation-in-part · filed 22 Nov 2016

Application15/399,269Parent of this continuation-in-part · filed 5 Jan 2017

US 9,639,935 B1Parent of this continuation-in-part · filed 2 May 2017

PCT/US2017/034231Parent of this division · filed 24 May 2017

US 10,404,926 B2Parent of this continuation-in-part · filed 3 Sep 2019

US 10,499,085 B1Parent of this continuation-in-part · filed 3 Dec 2019

Application17/543,629Parent of this continuation · filed 6 Dec 2021

US 11,196,918 B2Parent of this division · filed 7 Dec 2021

US 2023/0247281 A1Pre-grant publication · published 3 Aug 2023

US 11,653,088 B2Parent of this continuation

Application16/303,892Parent of this division

Application17/543,629Parent of this division

Application16/303,892Parent of this continuation-in-part

US 2017/0347044 A1Published application

US 2020/0267339 A1Published application

US 2022/0256076 A1Published application

US 12,382,164 B2This patent

From the US filing history. Foreign family members aren’t listed.

Three-dimensional noise reduction

Life of this patent

Three-dimensional noise reduction

Life of this patent

Abstract

Claims20