# US 2021/0344968 A1 · Method for image processing and apparatus for implementing the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0344968 A1
- Document ID: US20210344968A1
- Status: Published application
- Kind: A1
- Application number: 17/307,339
- Filed: 2021-05-04
- Published: 2021-11-04
- Earliest claimed: 2020-05-04
- Assignees: Ateme
- Applicants: Ateme
- Inventors: Thomas GUIONNET; Sébastien HERBRETEAU
- Web page: https://patentgrep.com/patent/US20210344968A1

## CPC

- H04N 19/85: using pre-processing or post-processing specially adapted for video compression
- H04N 19/86: involving reduction of coding artifacts, e.g. of blockiness
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 5/70: Denoising; Smoothing
- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- H04N 19/136: Incoming video signal characteristics or properties
- H04N 19/177: the unit being a group of pictures [GOP]
- H04N 19/179: the unit being a scene or a shot
- H04N 19/182: the unit being a pixel
- H04N 19/80: Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation (H04N19/635, H04N19/86 take precedence)
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20204: Removing film grain; Adding simulated film grain
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method of method of processing an image includes: determining estimates of parameters of an auto-regressive, AR, parametric model of noise contained in the image, according to which a current noise pixel is computed as a combination of a linear combination of P previous noise pixels in a causal neighborhood of the current noise pixel weighted by respective AR model linear combination parameters (φ1, . . . , φP) with a generated noise sample corresponding to an additive Gaussian noise of AR model variance parameter (σ), generating a noise template of noise pixels based on the estimated AR model parameters, wherein the noise template is of a predetermined pixel size smaller than the pixel size of the image, determining an estimate (σP) of a variance of the noise template, and based on a comparison of the estimated variance (σP) with a predetermined threshold (Tσ), correcting the AR model variance parameter (σ).

## Claims

### Claim 1

A method of processing an image, the method comprising:
determining estimates of parameters of an auto-regressive, AR, parametric model of noise contained in the image, according to which a current noise pixel is computed as a combination of a linear combination of P previous noise pixels in a causal neighborhood of the current noise pixel weighted by respective AR model linear combination parameters (φ1, . . . , φP) with a generated noise sample corresponding to an additive Gaussian noise of AR model variance parameter (σ);
generating a noise template of noise pixels based on the estimated AR model parameters, wherein the noise template is of a predetermined pixel size smaller than the pixel size of the image;
determining an estimate (σP) of a variance of the noise template;
based on a comparison of the estimated variance (σP) with a predetermined threshold (Tσ), correcting the AR model variance parameter (σ).

### Claim 2 (depends on 1)

The method according to claim 1, wherein the AR model is configured to model grain contained in the image.

### Claim 3 (depends on 1)

The method according to claim 1, performed at an encoder configured for encoding the image, wherein the predetermined pixel size of the noise template is chosen corresponding to the pixel size of a noise synthesis template used at a decoder to synthesize film grain based on the AR model using the AR model linear combination parameters and the corrected AR model variance parameter (σ).

### Claim 4 (depends on 1)

The method according to claim 1, wherein the predetermined pixel size of the noise template is chosen to be 64×64.

### Claim 5 (depends on 1)

The method according to claim 1, wherein the predetermined threshold (Tσ) is chosen as a function of an image content bit-depth and/or a dynamic range of the image.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the correcting performed on the AR model variance parameter (σ) corresponds to a decrease of an amount proportional to a gap between the estimated variance (σP) and the predetermined threshold (Tσ).

### Claim 7 (depends on 6)

The method according to claim 6, wherein the AR model variance parameter σ corresponds to a standard deviation, the estimated variance σP corresponds to a standard deviation, and wherein upon determining that σP>Tσ, the AR model standard deviation parameter σ is corrected as σ′=σ×Tσ/σP.

### Claim 8 (depends on 1)

The method according to claim 1, wherein at least one of the AR model linear combination parameters (φ1, . . . , φP) is preset to zero.

### Claim 9 (depends on 6)

The method according to claim 6, wherein a number of AR model linear combination parameters (φ1, . . . , φP) that are preset to zero is chosen based on a pixel resolution of the image.

### Claim 10

An apparatus, the apparatus comprising a processor and a memory operatively coupled to the processor, wherein the apparatus is configured to perform a method of processing an image, the method comprising:
determining estimates of parameters of an auto-regressive, AR, parametric model of noise contained in the image, according to which a current noise pixel is computed as a combination of a linear combination of P previous noise pixels in a causal neighborhood of the current noise pixel weighted by respective AR model linear combination parameters (φ1, . . . , φP) with a generated noise sample corresponding to an additive Gaussian noise of AR model variance parameter (σ);
generating a noise template of noise pixels based on the estimated AR model parameters, wherein the noise template is of a predetermined pixel size smaller than the pixel size of the image;
determining an estimate (σP) of a variance of the noise template;
based on a comparison of the estimated variance (σP) with a predetermined threshold (Tσ), correcting the AR model variance parameter (σ).

### Claim 11 (depends on 10)

A video encoder, configured to encode video content comprising a plurality of images, the video encoder comprising an apparatus according to claim 10 configured to process images of an input video.

### Claim 12

A non-transitory computer-readable medium encoded with executable instructions which, when executed, causes an apparatus comprising a processor operatively coupled with a memory, to perform a method of processing an image, the method comprising:
determining estimates of parameters of an auto-regressive, AR, parametric model of noise contained in the image, according to which a current noise pixel is computed as a combination of a linear combination of P previous noise pixels in a causal neighborhood of the current noise pixel weighted by respective AR model linear combination parameters (φ1, . . . , φP) with a generated noise sample corresponding to an additive Gaussian noise of AR model variance parameter (σ);
generating a noise template of noise pixels based on the estimated AR model parameters, wherein the noise template is of a predetermined pixel size smaller than the pixel size of the image;
determining an estimate (σP) of a variance of the noise template;
based on a comparison of the estimated variance (σP) with a predetermined threshold (Tσ), correcting the AR model variance parameter (σ).

### Claim 13

(canceled)

### Claim 14

(canceled)

### Claim 15 (depends on 10)

The apparatus according to claim 10, wherein the AR model is configured to model grain contained in the image.

### Claim 16 (depends on 10)

The apparatus according to claim 10, wherein the predetermined threshold (Tσ) is chosen as a function of an image content bit-depth and/or a dynamic range of the image.

### Claim 17 (depends on 10)

The apparatus according to claim 10, wherein the correcting performed on the AR model variance parameter (σ) corresponds to a decrease of an amount proportional to a gap between the estimated variance (σP) and the predetermined threshold (Tσ).

### Claim 18 (depends on 17)

The apparatus according to claim 17, wherein the AR model variance parameter σ corresponds to a standard deviation, the estimated variance σP corresponds to a standard deviation, and wherein upon determining that σP>Tσ, the AR model standard deviation parameter σ is corrected as σ′=σ×Tσ/σP.

### Claim 19 (depends on 12)

The non-transitory computer-readable medium according to claim 12, wherein the AR model is configured to model grain contained in the image.

### Claim 20 (depends on 12)

The non-transitory computer-readable medium according to claim 12, wherein the predetermined threshold (Tσ) is chosen as a function of an image content bit-depth and/or a dynamic range of the image.

### Claim 21 (depends on 12)

The non-transitory computer-readable medium according to claim 12, wherein the correcting performed on the AR model variance parameter (σ) corresponds to a decrease of an amount proportional to a gap between the estimated variance (σP) and the predetermined threshold (Tσ).

### Claim 22 (depends on 21)

The non-transitory computer-readable medium according to claim 21, wherein the AR model variance parameter σ corresponds to a standard deviation, the estimated variance σP corresponds to a standard deviation, and wherein upon determining that σP>Tσ, the AR model standard deviation parameter σ is corrected as σ′=σ×Tσ/σP.
