US 11,908,111 B2Granted

Image processing including noise reduction

AssigneeGoPro, Inc.

InventorsGuillaume Matthieu Guerin, Bruno Faure, Vincent Vacquerie, Bruno César Douady

Life of this patent

Estimating the term…

Loading patent…

Abstract

Image analysis and processing may include a first sensor readout unit receiving first Bayer format image data corresponding to a first input image, a second sensor readout unit receiving second Bayer format image data corresponding to a second input image, a first Bayer-to-RGB unit obtaining first RGB format image data based on the first Bayer format image data, a second Bayer-to-RGB unit obtaining second RGB format image data based on the second Bayer format image data, a high dynamic range unit configured obtaining high dynamic range image data based on a combination of the first RGB format image data and the second RGB format image data, an RGB-to-YUV unit obtaining YUV format image data based on the high dynamic range image data, and a three-dimensional noise reduction unit obtaining processed image data based on the YUV format image data.

Claims16

Dependent claims

An image processor for image analysis and processing comprising:

a sensor readout component configured to receive Bayer format image data corresponding to an input image;
a Bayer-to-Bayer component;
a Bayer-to-RGB component configured to obtain RGB format image data based on the Bayer format image data;
an RGB-to-YUV component configured to obtain YUV format image data based on the RGB format image data, wherein to obtain the YUV format image data, the RGB-to-YUV component is configured to:
divide the image into a plurality of non-overlapping tiles having a defined width and a defined height;
obtain a histogram for a respective tile from the plurality of non-overlapping tiles, wherein the RGB-to-YUV component is configured to obtain the histogram using a weight map that weights respective regions of interest in the image prior to statistics aggregation;
obtain a gain table for the respective tile;
and
obtain a gain value for a portion of the respective tile by bilinear interpolation relative to the center of the respective tile;
and
a noise reduction component configured to obtain noise reduced image data based on the YUV format image data;
wherein the image processor is configured to output processed image data based on the noise reduced image data.

9 more elements

An image processor for image analysis and processing comprising:

a sensor readout component configured to receive Bayer format image data corresponding to an input image;
a Bayer-to-Bayer component that includes a statistics unit configured to obtain weighted statistics for spherical image processing;
a Bayer-to-RGB component configured to obtain RGB format image data based on the Bayer format image data;
an RGB-to-YUV component configured to obtain YUV format image data based on the RGB format image data, wherein to obtain the YUV format image data, the RGB-to-YUV component is configured to:
divide the image into a plurality of non-overlapping tiles having a defined width and a defined height;
obtain a histogram for a respective tile from the plurality of non-overlapping tiles, wherein the RGB-to-YUV component is configured to obtain the histogram using a weight map that weights respective regions of interest in the image prior to statistics aggregation;
obtain a gain table for the respective tile;
and
obtain a gain value for a portion of the respective tile by bilinear interpolation relative to the center of the respective tile;
and
a noise reduction component configured to obtain noise reduced image data based on the YUV format image data;
wherein the image processor is configured to output processed spherical image data based on the noise reduced image data.

9 more elements

Dependencies are inferred from the claim text.

Facts

Application: 17/751,981Filed 24 May 2022 · continuation
Priority: 12 Feb 2018
Published: US 2022/0284554 A18 Sep 2022
Granted: 20 Feb 2024
Term ends: Not estimatedThe source records don’t support an estimate.

Classification13 codes

G06T 5/92
Dynamic range modification of images or parts thereof: based on global image properties
G06T 3/40
Geometric image transformations in the plane of the image: scaling of whole images or parts thereof, e.g. expanding or contracting
G06T 5/50
Image enhancement or restoration: using two or more images, e.g. averaging or subtraction
G06T 5/70
Image enhancement or restoration: denoising; Smoothing

Family

Application62/629,486Us provisional application · filed 12 Feb 2018
Application62/632,815Us provisional application · filed 20 Feb 2018
PCT/US2019/017450Parent of this continuation · filed 11 Feb 2019
US 2022/0284554 A1Pre-grant publication · published 8 Sep 2022
Application16/968,707Parent of this continuation
US 11,341,623 B2Parent of this continuation
US 2021/0073956 A1Published application
US 11,908,111 B2This patent

From the US filing history. Foreign family members aren’t listed.

Timeline

Citations

Open elsewhere

Building an agent or pulling many patents? Use the API or MCP server instead of scraping pages. Get an API key