# US 10,123,011 B2 · Histogram segmentation based local adaptive filter for video encoding and decoding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,123,011 B2
- Document ID: US10123011B2
- Status: Granted
- Kind: B2
- Application number: 15/589,165
- Filed: 2017-05-08
- Published: 2017-08-24
- Granted: 2018-11-06
- Earliest claimed: 2013-06-04
- Assignees: Intel Corporation
- Applicants: Intel Corporation
- Inventors: Lidong Xu; Yi-Jen Chiu; Wenhao Zhang; Hong Jiang
- Web page: https://patentgrep.com/patent/US10123011B2

## CPC

- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- H04N 19/136: Incoming video signal characteristics or properties
- H04N 19/147: according to rate distortion criteria (rate-distortion as a criterion for motion estimation H04N19/567)
- H04N 19/182: the unit being a pixel
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Reconstructed picture quality for a video codec system may be improved by categorizing reconstructed pixels into different histogram bins with histogram segmentation and then applying different filters on different bins. Histogram segmentation may be performed by averagely dividing the histogram into M bins or adaptively dividing the histogram into N bins based on the histogram characteristics. Here M and N may be a predefined, fixed, non-negative integer value or an adaptively generated value at encoder side and may be sent to decoder through the coded bitstream.

## Claims

### Claim 1

An apparatus comprising:
a video encoder including an adaptive filter with offset, using multiple histogram bin segmentation, said filter to separately adaptively filter pixel values in a first bin, the filter offset adapted to said first bin, and said filter to set the offset based on a sum of differences between filtered values output from the adaptive filter and original input pixel values input to the adaptive filter divided by the number of pixels in the first histogram bin, said filter to separately adaptively filter pixel values in a second bin, the filter offset adapted to said second bin, and said filter to set the offset based on a sum of differences between filtered values output from the adaptive filter and original input pixel values input to the adaptive filter divided by the number of pixels in the second histogram bin; and
a video decoder.

### Claim 2 (depends on 1)

The apparatus of claim 1, said encoder to evenly divide the histogram into bins.

### Claim 3 (depends on 1)

The apparatus of claim 1, said encoder to signal the offsets to a remote decoder.

### Claim 4 (depends on 1)

The apparatus of claim 1, said encoder to identify a segmentation method based on a rate-distortion cost.

### Claim 5

A method comprising:
using multiple histogram bin segmentation including first and second bins in an adaptive filter with offset;
separately adaptively filtering pixel values in a first bin, the filter offset for the first bin adapted to the first bin;
setting an offset for said first bin based on a sum of differences between filtered values output from the adaptive filter and original input pixel values input to the adaptive filter divided by the number of pixels in the first bin;
separately adaptively filtering pixel values in a second bin, the filter offset for the second bin adapted to said second bin; and
setting an offset for the second bin based on a sum of differences between filtered values output from the adaptive filter and original input pixel values input to the adaptive filter divided by the number of pixels in the second bin.

### Claim 6 (depends on 5)

The method of claim 5, including evenly dividing a histogram into bins.

### Claim 7 (depends on 5)

The method of claim 5, including signaling the offsets to a remote decoder.

### Claim 8 (depends on 5)

The method of claim 5, including identifying a segmentation method based on a rate-distortion cost.

### Claim 9

One or more non-transitory computer readable media storing instructions to perform a sequence comprising:
using multiple histogram bin segmentation including first and second bins in an adaptive filter with offset;
separately adaptively filtering pixel values in a first bin, the filter offset for the first bin adapted to the first bin;
setting an offset for said first bin based on a sum of differences between filtered values output from the adaptive filter and original input pixel values input to the adaptive filter divided by the number of pixels in the first bin;
separately adaptively filtering pixel values in a second bin, the filter offset for the second bin adapted to said second bin; and
setting an offset for the second bin based on a sum of differences between filtered values output from the adaptive filter and original input pixel values input to the adaptive filter divided by the number of pixels in the second bin.

### Claim 10 (depends on 9)

The media of claim 9, further storing instructions to perform a sequence including evenly dividing a histogram into bins.

### Claim 11 (depends on 9)

The media of claim 9, further storing instructions to perform a sequence including signaling the offsets to a remote decoder.

### Claim 12 (depends on 9)

The media of claim 9, further storing instructions to perform a sequence including identifying a segmentation method based on a rate-distortion cost.

### Claim 13

An apparatus comprising:
means for using multiple histogram bin segmentation including first and second bins in an adaptive filter with offset;
means for separately adaptively filtering pixel values in a first bin, the filter offset for the first bin adapted to the first bin;
means for setting an offset for said first bin based on a sum of differences between filtered values output from the adaptive filter and original input pixel values input to the adaptive filter divided by the number of pixels in the first bin;
means for separately adaptively filtering pixel values in a second bin, the filter offset for the second bin adapted to said second bin; and
means for setting an offset for the second bin based on a sum of differences between filtered values output from the adaptive filter and original input pixel values input to the adaptive filter divided by the number of pixels in the second bin.

### Claim 14 (depends on 13)

The apparatus of claim 13, including means for evenly dividing a histogram into bins.

### Claim 15 (depends on 13)

The apparatus of claim 13, including means for signaling the offsets to a remote decoder.

### Claim 16 (depends on 13)

The apparatus of claim 13, including means for identifying a segmentation method based on a rate-distortion cost.

### Claim 17

A system comprising:
a video encoder including an adaptive filter with offset, using multiple histogram bin segmentation, said filter to separately adaptively filter pixel values in a first bin, the filter offset adapted to said first bin, and said filter to set the offset based on a sum of differences between filtered values output from the adaptive filter and original input pixel values input to the adaptive filter divided by the number of pixels in the first histogram bin, said filter to separately adaptively filter pixel values in a second bin, the filter offset adapted to said second bin, and said filter to set the offset based on a sum of differences between filtered values output from the adaptive filter and original input pixel values input to the adaptive filter divided by the number of pixels in the second histogram bin; and
a display coupled to said encoder.

### Claim 18 (depends on 17)

The system of claim 17, said encoder to evenly divide the histogram into bins.

### Claim 19 (depends on 17)

The system of claim 17, said encoder to signal the offsets to a remote decoder.

### Claim 20 (depends on 17)

The system of claim 17, said encoder to identify a segmentation method based on a rate-distortion cost.

### Claim 21 (depends on 17)

The system of claim 17, including a battery coupled to said encoder.

### Claim 22 (depends on 17)

The system of claim 17, including a radio coupled to said encoder.
