# US 2026/0075255 A1 · Scene-adaptive online learning for video post processing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0075255 A1
- Document ID: US20260075255A1
- Status: Published application
- Kind: A1
- Application number: 18/882,183
- Filed: 2024-09-11
- Published: 2026-03-12
- Earliest claimed: 2024-09-11
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Junmin Wu; Khalid Tahboub; Scott Benjamin Leask; Jamie Menjay Lin; Kai Wang
- Web page: https://patentgrep.com/patent/US20260075255A1

## CPC

- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- H04N 19/86: involving reduction of coding artifacts, e.g. of blockiness
- G06N 3/045: Combinations of networks
- G06N 3/084: Backpropagation, e.g. using gradient descent
- H04N 19/142: Detection of scene cut or scene change
- H04N 19/154: Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion (use of rate-distortion criteria H04N19/147)
- H04N 19/172: the region being a picture, frame or field
- H04N 19/179: the unit being a scene or a shot
- H04N 19/42: characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation (H04N19/635 takes precedence)
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/463: by compressing encoding parameters before transmission
- H04N 19/80: Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation (H04N19/635, H04N19/86 take precedence)
- H04N 19/91: Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A video capture device may be encode a set of original pictures to create encoded video data, decode the encoded video data to create a set of reconstructed pictures, determine a subset of parameters to update from among a plurality of parameters of a post-processing filter network, including using the set of original pictures as ground truth and the set of reconstructed pictures as input to the post-processing filter network, update the subset of parameters to generate updated parameters, and send the encoded video data and the updated parameters to a playback device.

## Claims

### Claim 1

A method of processing video data at a capture device, the method comprising:
encoding a set of original pictures to create encoded video data;
decoding the encoded video data to create a set of reconstructed pictures;
determining a subset of parameters to update from among a plurality of parameters of a post-processing filter network, including using the set of original pictures as ground truth and the set of reconstructed pictures as input to the post-processing filter network;
updating the subset of parameters to generate updated parameters; and
sending the encoded video data and the updated parameters to a playback device.

### Claim 2 (depends on 1)

The method of claim 1, wherein determining the subset of parameters to update comprises:
accumulating a respective gradient change for every parameter of the plurality of parameters over N forward and backward passes;
sorting the respective gradient changes in a list; and
selecting parameters associated with a top ‘n’ percent of the respective gradient changes in the list as the subset of parameters.

### Claim 3 (depends on 1)

The method of claim 1, wherein determining the subset of parameters to update comprises:
accumulating a respective gradient change for every parameter of the plurality of parameters over N forward and backward passes;
determining a respective accumulated gradient change ratio for every parameter of the plurality of parameters, wherein the respective accumulated gradient change ratio is a function of the respective gradient change divided by a magnitude of a respective parameter;
sorting the respective accumulated gradient change ratios in a list; and
selecting parameters associated with a top ‘n’ percent of the respective accumulated gradient change ratios in the list as the subset of parameters.

### Claim 4 (depends on 1)

The method of claim 1, wherein determining the subset of parameters to update comprises one of:
randomly selecting ‘n’ percent of the plurality of parameters as the subset of parameters; or
selecting ‘n’ percent of contiguous parameters starting from a last layer of the post-processing filter network.

### Claim 5 (depends on 1)

The method of claim 1, wherein updating the subset of parameters to generate updated parameters comprises:
performing one or more of a forward gradient method, back propagation, or a mixture of forward and backward training to update the subset of parameters.

### Claim 6 (depends on 5)

The method of claim 5, further comprising:
not updating values of the plurality of parameters that are not in the subset of parameters.

### Claim 7 (depends on 1)

The method of claim 1, wherein the set of original pictures is one of a first number pictures in a sequence, or a uniformly selected first number of pictures in a sequence.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
selecting one or more pictures for the set of original pictures based on a change in signal-to-noise ratio between pictures.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
selecting one or more pictures for the set of original pictures based on a scene change.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
compressing the updated parameters.

### Claim 11 (depends on 10)

The method of claim 10, wherein compressing the updated parameters comprises:
determining an arithmetic parameter ‘n’ based on a percentage of updated parameters to a total number of the plurality of parameters of the post-processing filter network, wherein arithmetic parameter ‘n’ is a probability used in arithmetic coding of the updated parameters;
arithmetically encoding a mask using arithmetic parameter ‘n’, wherein each value of the mask indicates whether or not a parameter in the post-processing filter network is the updated parameter;
determining a respective parameter difference between a respective updated parameter and a corresponding parameter of the subset of parameters; and
encoding the respective parameters differences for the updated parameters.

### Claim 12 (depends on 1)

The method of claim 1, wherein the post-processing filter network is a convolutional neural network.

### Claim 13

An apparatus configured to process video data at a capture device, the apparatus comprising:
a memory; and
processing circuitry in communication with the memory, the processing circuitry configured to:
encode a set of original pictures to create encoded video data;
decode the encoded video data to create a set of reconstructed pictures;
determine a subset of parameters to update from among a plurality of parameters of a post-processing filter network, including using the set of original pictures as ground truth and the set of reconstructed pictures as input to the post-processing filter network;
update the subset of parameters to generate updated parameters; and
send the encoded video data and the updated parameters to a playback device.

### Claim 14 (depends on 13)

The apparatus of claim 13, wherein to determine the subset of parameters to update, the processing circuitry is further configured to:
accumulate a respective gradient change for every parameter of the plurality of parameters over N forward and backward passes;
sort the respective gradient changes in a list; and
select parameters associated with a top ‘n’ percent of the respective gradient changes in the list as the subset of parameters.

### Claim 15 (depends on 13)

The apparatus of claim 13, wherein to determine the subset of parameters to update, the processing circuitry is further configured to:
accumulate a respective gradient change for every parameter of the plurality of parameters over N forward and backward passes;
determine a respective accumulated gradient change ratio for every parameter of the plurality of parameters, wherein the respective accumulated gradient change ratio is a function of the respective gradient change divided by a magnitude of a respective parameter;
sort the respective accumulated gradient change ratios in a list; and
select parameters associated with a top ‘n’ percent of the respective accumulated gradient change ratios in the list as the subset of parameters.

### Claim 16 (depends on 13)

The apparatus of claim 13, wherein to determine the subset of parameters to update, the processing circuitry is further configured to:
randomly select ‘n’ percent of the plurality of parameters as the subset of parameters; or
select ‘n’ percent of contiguous parameters starting from a last layer of the post-processing filter network.

### Claim 17 (depends on 13)

The apparatus of claim 13, wherein to update the subset of parameters to generate updated parameters, the processing circuitry is configured to:
perform one or more of a forward gradient method, back propagation, or a mixture of forward and backward training to update the subset of parameters.

### Claim 18 (depends on 17)

The apparatus of claim 17, wherein the processing circuitry is further configured to:
not update values of the plurality of parameters that are not in the subset of parameters.

### Claim 19 (depends on 13)

The apparatus of claim 13, wherein the set of original pictures is one of a first number pictures in a sequence, or a uniformly selected first number of pictures in a sequence.

### Claim 20 (depends on 13)

The apparatus of claim 13, wherein the processing circuitry is further configured to:
select one or more pictures for the set of original pictures based on a change in signal-to-noise ratio between pictures.

### Claim 21 (depends on 13)

The apparatus of claim 13, wherein the processing circuitry is further configured to:
select one or more pictures for the set of original pictures based on a scene change.

### Claim 22 (depends on 13)

The apparatus of claim 13, wherein the processing circuitry is further configured to:
compress the updated parameters.

### Claim 23 (depends on 22)

The apparatus of claim 22, wherein to compress the updated parameters, the processing circuitry is configured to:
determine an arithmetic parameter ‘n’ based on a percentage of updated parameters to a total number of the plurality of parameters of the post-processing filter network, wherein arithmetic parameter ‘n’ is a probability used in arithmetic coding of the updated parameters;
arithmetically encode a mask using arithmetic parameter ‘n’, wherein each value of the mask indicates whether or not a parameter in the post-processing filter network is the updated parameter;
determine a respective parameter difference between a respective updated parameter and a corresponding parameter of the subset of parameters; and
encode the respective parameters differences for the updated parameters.

### Claim 24 (depends on 13)

The apparatus of claim 13, wherein the post-processing filter network is a convolutional neural network.

### Claim 25 (depends on 13)

The apparatus of claim 13, further comprising:
a camera configured to capture the set of original pictures.

### Claim 26

A method of processing video data at a playback device, the method comprising:
receiving encoded video data and encoded parameters for a post-processing filter network;
decoding the encoded video data to generate a decoded picture;
decoding the encoded parameters to recover updated parameters; and
processing the decoded picture using the post-processing filter network and the updated parameters.

### Claim 27 (depends on 26)

The method of claim 26, wherein the encoded parameters include an arithmetic parameter ‘n’, an arithmetically encoded mask, and a respective parameter difference for each of the updated parameters, and wherein decoding the encoded parameters comprises:
decoding the arithmetic parameter ‘n’;
arithmetically decoding the arithmetically encoded mask using arithmetic parameter ‘n’ to recover a mask, wherein each value of the mask indicates whether or not a parameter in the post-processing filter network is the updated parameter; and
adding the respective parameter difference to a corresponding parameter value of the post-processing filter network based on the mask to recover the updated parameters.

### Claim 28

An apparatus configured to process video data at a playback device, the apparatus comprising:
a memory; and
processing circuitry in communication with the memory, the processing circuitry configured to:
receive encoded video data and encoded parameters for a post-processing filter network;
decode the encoded video data to generate a decoded picture;
decode the encoded parameters to recover updated parameters; and
process the decoded picture using the post-processing filter network and the updated parameters to generate a filtered picture.

### Claim 29 (depends on 28)

The apparatus of claim 28, wherein the encoded parameters include an arithmetic parameter ‘n’, an arithmetically encoded mask, and a respective parameter difference for each of the updated parameters, and wherein to decode the encoded parameters, the processing circuitry is further configured to:
decode the arithmetic parameter ‘n’;
arithmetically decode the arithmetically encoded mask using arithmetic parameter ‘n’ to recover a mask, wherein each value of the mask indicates whether or not a parameter in the post-processing filter network is the updated parameter; and
add the respective parameter difference to a corresponding parameter value of the post-processing filter network based on the mask to recover the updated parameters.

### Claim 30 (depends on 28)

The apparatus of claim 28, further comprising:
a display configured to display the filtered picture.
