# US 2015/0146782 A1 · In-loop fidelity enhancement for video compression

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0146782 A1
- Document ID: US20150146782A1
- Status: Published application
- Kind: A1
- Application number: 14/614,422
- Filed: 2015-02-05
- Published: 2015-05-28
- Earliest claimed: 2007-12-13
- Assignees: Mediatek Inc.
- Applicants: Mediatek Inc.
- Inventors: Shaw-Min Lei; Yu-Wen Huang; Xun Guo
- Web page: https://patentgrep.com/patent/US20150146782A1

## CPC

- H04N 19/82: involving filtering within a prediction loop
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/61: in combination with predictive coding
- H04N 19/86: involving reduction of coding artifacts, e.g. of blockiness
- H04N 19/865: {with detection of the former encoding block subdivision in decompressed video}
- H04N 19/91: Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
- H04N 19/96: Tree coding, e.g. quad-tree coding
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An encoder for receiving a video frame and performing encoding processes to generate an encoded bitstream includes: a fidelity enhancement block, for performing a fidelity enhancement technique on processed data utilizing a partition method, and generating fidelity enhancement information comprising at least one parameter associated with a partition structure, wherein the fidelity enhancement technique comprises applying discrepancy modeling based on DC offset; and an entropy coding block, coupled to the fidelity enhancement block, for encoding the fidelity enhancement information, and embedding the encoded fidelity enhancement information into the encoded bitstream.

## Claims

### Claim 1

An encoder for receiving a video frame and performing encoding processes to generate an encoded bitstream, the encoder comprising:
a fidelity enhancement block, for performing a fidelity enhancement technique on processed data utilizing a partition method, and generating fidelity enhancement information comprising at least one parameter associated with a partition structure, wherein the fidelity enhancement technique comprises applying discrepancy modeling based on DC offset; and
an entropy coding block, coupled to the fidelity enhancement block, for encoding the fidelity enhancement information, and embedding the encoded fidelity enhancement information into the encoded bitstream.

### Claim 2 (depends on 1)

The encoder of claim 1, wherein the fidelity enhancement technique further comprises Wiener filtering, Kalman filtering, noise reduction, deblurring, regression, and regularization.

### Claim 3 (depends on 1)

The encoder of claim 1, wherein the fidelity enhancement block performs Wiener filtering, generates auto correlation and cross correlation matrices for a smaller area of the video frame, and reuses the auto correlation and cross correlation matrices for a larger area of the video frame when the larger area includes the smaller area.

### Claim 4 (depends on 1)

The encoder of claim 1, wherein the fidelity enhancement technique further comprises applying discrepancy modeling based on weighted prediction or spatial prediction.

### Claim 5 (depends on 1)

The encoder of claim 1, further comprising:
a prediction block, for performing prediction on the video frame to generate prediction residues and prediction information;
a transform and quantization block, coupled to the prediction block, for performing transform and quantization processes on the prediction residues; and
a reconstruction loop, coupled between the transform and quantization block and the prediction block, for reconstructing the video frame according to the prediction residues and information from the transform and quantization block;
wherein the entropy coding block is coupled to the transform and quantization block, and the fidelity enhancement block is in the reconstruction loop and used for providing compensated processed data to the prediction block for prediction.

### Claim 6 (depends on 5)

The encoder of claim 5, wherein the reconstruction loop further comprises:
a deblocking unit, for performing deblocking to generate the processed data;
wherein the fidelity enhancement block receives the processed data from the deblocking unit.

### Claim 7 (depends on 5)

The encoder of claim 5, wherein the reconstruction loop further comprises:
a reference frame buffer, for buffering the processed data of a reference frame;
wherein the fidelity enhancement block receives the processed data from the reference frame buffer.

### Claim 8 (depends on 5)

The encoder of claim 5, wherein the reconstruction loop further comprises:
an inverse quantization and transform unit, coupled to the transform and quantization unit, for performing inverse quantization and transform processes to generate the processed data;
wherein the fidelity enhancement block receives the processed data from the inverse quantization and transform unit.

### Claim 9 (depends on 5)

The encoder of claim 5, wherein the reconstruction loop further comprises:
an inverse quantization unit, coupled to the transform and quantization unit, for performing inverse quantization process to generate the processed data;
wherein the fidelity enhancement block receives the processed data from the inverse quantization unit.

### Claim 10 (depends on 1)

The encoder of claim 1, wherein the encoded fidelity enhancement information is embedded in the encoded bitstream, and a header of the encoded bitstream comprises a pointer for indicating a location of the fidelity enhancement information in the encoded bitstream.

### Claim 11

A decoder for receiving a bitstream to generate a video frame, comprising:
an entropy decoding unit, for decoding the bitstream to generate residues and fidelity enhancement information, wherein the fidelity enhancement information comprises at least one parameter associated with a partition structure;
a motion compensation block, for performing motion compensation to generate predictors; and
a reconstruction loop, coupled between the entropy decoding unit and the motion compensation block, for reconstructing the video frame from the residues and the predictors, wherein the reconstruction loop at least comprises:
a fidelity enhancement block, for receiving the fidelity enhancement information from the entropy decoding unit, and performing fidelity enhancement technique on the reconstructed video frame according to the partition structure derived from the fidelity enhancement information, wherein the fidelity enhancement technique comprises applying discrepancy modeling based on DC offset.

### Claim 12 (depends on 11)

The decoder of claim 11, wherein the fidelity enhancement technique further comprises applying discrepancy modeling technique based on weighted prediction or spatial prediction.

### Claim 13 (depends on 11)

The decoder of claim 11, wherein the reconstruction loop further comprises:
a reference frame buffer, for buffering processed data of a reference frame;
wherein the fidelity enhancement block receives the processed data from the reference frame buffer and performs the fidelity enhancement technique on the processed data according to the partition structure.

### Claim 14 (depends on 11)

The decoder of claim 11, wherein the reconstruction loop further comprises:
a deblocking unit, for performing deblocking to generate the reconstructed video frame;
wherein the fidelity enhancement block receives the reconstructed video frame from the deblocking unit and performs the fidelity enhancement technique on the reconstructed video frame.

### Claim 15 (depends on 11)

The decoder of claim 11, wherein a header of the bitstream comprises a pointer for indicating a location of the fidelity enhancement information in the bitstream, and the entropy decoding unit extracts the fidelity enhancement information from the bitstream according to the pointer.

### Claim 16

An encoder for receiving a video frame and performing encoding processes to generate an encoded bitstream, the encoder comprising:
a prediction block, for performing prediction on the video frame to generate prediction residues and prediction information;
a transform and quantization block, coupled to the prediction block, for performing transform and quantization processes on the prediction residues;
a reconstruction loop, coupled between the transform and quantization block and the prediction block, for reconstructing the video frame according to information from the transform and quantization block; wherein the reconstruction loop comprises:
a reference frame buffer; and
a discrepancy modeling block, for performing a discrepancy modeling technique on processed data, and generating discrepancy modeling information; and
an entropy coding block, for encoding the prediction residues with the discrepancy modeling information into the encoded bitstream;
wherein the discrepancy modeling technique is performed to reduce quantization errors between the processed data and original data of the video frame.

### Claim 17 (depends on 16)

The encoder of claim 16, wherein the discrepancy modeling technique comprises DC offset compensation, weighted prediction, or spatial prediction.

### Claim 18 (depends on 16)

The encoder of claim 16, wherein the discrepancy modeling block receives the processed data of a reference frame and performs the discrepancy modeling technique to reduce errors between the reference frame and the video frame.

### Claim 19 (depends on 16)

The encoder of claim 16, wherein the discrepancy modeling block receives the processed data of the video frame, performs the discrepancy modeling technique to reduce errors between processed and unprocessed data of the video frame, and stores compensated processed data in the reference frame buffer.

### Claim 20

A decoder for receiving a bitstream to generate a video frame, comprising:
an entropy decoding unit, for decoding the bitstream to generate residues and discrepancy modeling information; and
a reconstruction loop, coupled to the entropy decoding unit, for reconstructing the video frame from the residues, wherein the reconstruction loop comprises:
a discrepancy modeling block, for receiving the discrepancy modeling information from the entropy decoding unit, and applying a discrepancy modeling technique on processed data according to the discrepancy modeling information;
wherein the discrepancy modeling technique is performed to reduce quantization errors between the processed data and original data of the video frame.

### Claim 21 (depends on 20)

The decoder of claim 20, wherein the discrepancy modeling technique comprises DC offset compensation, weighted prediction, or spatial prediction.

### Claim 22 (depends on 20)

The decoder of claim 20, wherein the reconstruction loop further comprises a reference frame buffer, and the discrepancy modeling block receives the processed data of the video frame, performs the discrepancy modeling technique according to the discrepancy modeling information to generate compensated processed data, and stores the compensated processed data in the reference frame buffer.
