# US 2021/0343045 A1 · Method for image processing and apparatus for implementing the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0343045 A1
- Document ID: US20210343045A1
- Status: Published application
- Kind: A1
- Application number: 17/307,419
- Filed: 2021-05-04
- Published: 2021-11-04
- Earliest claimed: 2020-05-04
- Assignees: Ateme
- Applicants: Ateme
- Inventors: Thomas GUIONNET; Sébastien HERBRETEAU
- Web page: https://patentgrep.com/patent/US20210343045A1

## CPC

- G06T 9/00: Image coding (bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00)
- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- G06T 5/70: Denoising; Smoothing
- G06T 5/92: based on global image properties
- H04N 19/119: Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
- H04N 19/136: Incoming video signal characteristics or properties
- H04N 19/142: Detection of scene cut or scene change
- H04N 19/172: the region being a picture, frame or field
- H04N 19/177: the unit being a group of pictures [GOP]
- H04N 19/179: the unit being a scene or a shot
- H04N 19/182: the unit being a pixel
- H04N 19/80: Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation (H04N19/635, H04N19/86 take precedence)
- H04N 19/85: using pre-processing or post-processing specially adapted for video compression
- H04N 19/98: Adaptive-dynamic-range coding [ADRC]
- G06T 2207/20204: Removing film grain; Adding simulated film grain
- G06T 2207/20208: High dynamic range [HDR] image processing
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method of method of processing an image of a video sequence including a plurality of images, wherein the video sequence is divided into a sequence of consecutive subsets each including one or more consecutive images of the video sequence is provides, which includes: determining, among the consecutive subsets, a current subset that includes the image, upon determining that the image is a first image of the current subset to be processed, determining an analysis window corresponding to the current subset, wherein the analysis window includes a plurality of consecutive images of the video sequence, and includes at least one image of the current subset, and generating processing results for the image by performing a processing on the images of the analysis window.

## Claims

### Claim 1

A method of processing an image of a video sequence comprising a plurality of images, wherein the video sequence is divided into a sequence of consecutive subsets each comprising one or more consecutive images of the video sequence, the method comprising:
determining, among the consecutive subsets, a current subset that comprises the image;
upon determining that the image is a first image of the current subset to be processed, determining an analysis window corresponding to the current subset, wherein the analysis window comprises a plurality of consecutive images of the video sequence, and comprises at least one image of the current subset;
generating processing results for the image by performing a processing on the images of the analysis window.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the processing comprises determining estimates of parameters of an auto-regressive, AR, parametric model of noise contained in the images of the analysis window, according to which a current noise pixel is computed as a combination of a linear combination of P previous noise pixels in a causal neighborhood of the current noise pixel weighted by respective AR model linear combination parameters (φ1, . . . , φP) with a generated noise sample corresponding to an additive Gaussian noise of AR model variance parameter (σ).

### Claim 3 (depends on 2)

The method according to claim 2, wherein the AR model is configured to model grain contained in the image.

### Claim 4 (depends on 1)

The method according to claim 1, wherein the processing comprises performing tone-mapping to convert the image from a first dynamic range to a second dynamic range.

### Claim 5 (depends on 5)

The method according to claim 5, wherein the first dynamic range is the High Dynamic Range, HDR, and the second dynamic range is the Standard Dynamic Range, SDR.

### Claim 6 (depends on 1)

The method according to claim 1, further comprising: upon determining that the image is not the first image of the current subset to be processed, obtaining processing results for the image based on processing results for the first image generated by performing the processing on the images of the analysis window.

### Claim 7 (depends on 1)

The method according to claim 1, further comprising: detecting a video event occurring between two consecutive images of the video sequence, and adjusting an analysis window which contains the two consecutive images so that the analysis window no longer contains the two consecutive images.

### Claim 8 (depends on 1)

The method according to claim 1, further comprising: detecting a video event occurring between two consecutive images of the video sequence, and adjusting a subset which contains the two consecutive images so that the subset no longer contains the two consecutive images.

### Claim 9 (depends on 7)

The method according to claim 7, wherein the video event is a scene cut, a cross-fade, a flash or a graphics insertion.

### Claim 10

An apparatus, the apparatus comprising a processor and a memory operatively coupled to the processor, wherein the apparatus is configured to perform a method of processing an image of a video sequence comprising a plurality of images, wherein the video sequence is divided into a sequence of consecutive subsets each comprising one or more consecutive images of the video sequence, the method comprising:
determining, among the consecutive subsets, a current subset that comprises the image;
upon determining that the image is a first image of the current subset to be processed, determining an analysis window corresponding to the current subset, wherein the analysis window comprises a plurality of consecutive images of the video sequence, and comprises at least one image of the current subset;
generating processing results for the image by performing a processing on the images of the analysis window.

### Claim 11 (depends on 10)

A video encoder, configured to encode video content comprising a plurality of images, the video encoder comprising an apparatus according to claim 10 configured to process images of an input video.

### Claim 12

A non-transitory computer-readable medium encoded with executable instructions which, when executed, causes an apparatus comprising a processor operatively coupled with a memory, to perform a method of processing an image of a video sequence comprising a plurality of images, wherein the video sequence is divided into a sequence of consecutive subsets each comprising one or more consecutive images of the video sequence, the method comprising:
determining, among the consecutive subsets, a current subset that comprises the image;
upon determining that the image is a first image of the current subset to be processed, determining an analysis window corresponding to the current subset, wherein the analysis window comprises a plurality of consecutive images of the video sequence, and comprises at least one image of the current subset;
generating processing results for the image by performing a processing on the images of the analysis window.

### Claim 13

(canceled)

### Claim 14

(canceled)

### Claim 15 (depends on 10)

An apparatus according to claim 10, wherein the processing comprises determining estimates of parameters of an auto-regressive, AR, parametric model of noise contained in the images of the analysis window, according to which a current noise pixel is computed as a combination of a linear combination of P previous noise pixels in a causal neighborhood of the current noise pixel weighted by respective AR model linear combination parameters (φ1, . . . , φP) with a generated noise sample corresponding to an additive Gaussian noise of AR model variance parameter (σ).

### Claim 16 (depends on 15)

An apparatus according to claim 15, wherein the AR model is configured to model grain contained in the image.

### Claim 17 (depends on 10)

An apparatus according to claim 10, wherein the processing comprises performing tone-mapping to convert the image from a first dynamic range to a second dynamic range.

### Claim 18 (depends on 10)

An apparatus according to claim 10, wherein the method further comprises: upon determining that the image is not the first image of the current subset to be processed, obtaining processing results for the image based on processing results for the first image generated by performing the processing on the images of the analysis window.

### Claim 19 (depends on 12)

A non-transitory computer-readable medium according to claim 12, wherein the processing comprises determining estimates of parameters of an auto-regressive, AR, parametric model of noise contained in the images of the analysis window, according to which a current noise pixel is computed as a combination of a linear combination of P previous noise pixels in a causal neighborhood of the current noise pixel weighted by respective AR model linear combination parameters (φ1, . . . , φP) with a generated noise sample corresponding to an additive Gaussian noise of AR model variance parameter (σ).

### Claim 20 (depends on 19)

A non-transitory computer-readable medium according to claim 19, wherein the AR model is configured to model grain contained in the image.

### Claim 21 (depends on 12)

A non-transitory computer-readable medium according to claim 12, wherein the processing comprises performing tone-mapping to convert the image from a first dynamic range to a second dynamic range.

### Claim 22 (depends on 12)

A non-transitory computer-readable medium according to claim 12, wherein the method further comprises: upon determining that the image is not the first image of the current subset to be processed, obtaining processing results for the image based on processing results for the first image generated by performing the processing on the images of the analysis window.
