# US 2010/0246689 A1 · Dynamic dithering for video compression

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0246689 A1
- Document ID: US20100246689A1
- Status: Published application
- Kind: A1
- Application number: 12/463,859
- Filed: 2009-05-11
- Published: 2010-09-30
- Earliest claimed: 2009-03-26
- Assignees: Apple Inc.
- Inventors: Gianluca FILIPPINI; Hsi-Jung WU; James Oliver NORMILE; Xiaojin SHI; Xiaosong ZHOU; Ionut HRISTODORESCU
- Web page: https://patentgrep.com/patent/US20100246689A1

## CPC

- H04N 19/90: using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
- H04N 19/124: Quantisation
- H04N 19/136: Incoming video signal characteristics or properties
- H04N 19/154: Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion (use of rate-distortion criteria H04N19/147)
- H04N 19/86: involving reduction of coding artifacts, e.g. of blockiness
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method and device for dithering video from a decoder. The method and device provide: selecting a segment of video frames from the video; computing a noise map for the segment of the video, the noise map computed from differences among pixels selected from spatially-distributed sampling patterns in the segment; determining contours of quantization artifacts within the video frame based on the noise map and a histogram of pixel values in the video frame; computing a gradient measurement of pixel values along the contours; identifying regions along the contours of quantization artifacts to apply dithering based on the noise map and the gradient measurement; determining a dithering strength based on the noise map and the gradient measurement; and applying dithering noise to the identified regions at the determined dithering strength.

## Claims

### Claim 1

A method for dithering video, comprising:
selecting a segment of video frames from the video;
computing a noise map for the segment of the video, the noise map computed from differences among pixels selected from spatially-distributed sampling patterns in the segment;
determining contours of quantization artifacts within the video frame based on the noise map and a histogram of pixel values in the video frame;
computing a gradient measurement of pixel values along the contours;
identifying regions along the contours of quantization artifacts to apply dithering based on the noise map and the gradient measurement;
determining a dithering strength based on the noise map and the gradient measurement; and
applying dithering noise to the identified regions at the determined dithering strength along the identified regions.

### Claim 2 (depends on 1)

The method of claim 1, wherein the segment of video frames includes only one video frame.

### Claim 3 (depends on 1)

The method of claim 1, wherein the segment of video includes more than one video frame.

### Claim 4 (depends on 1)

The method of claim 1, wherein the noise map includes an array of elements each representing a pixel location.

### Claim 5 (depends on 1)

The method of claim 1, wherein the noise map includes an array of elements each representing a location of a block of pixels.

### Claim 6 (depends on 1)

The method of claim 1, wherein the computing of the noise map is based on band-pass filtering the video frames.

### Claim 7 (depends on 6)

The method of claim 6, wherein the band-pass filtering is a difference of gaussians filtering.

### Claim 8 (depends on 1)

The method of claim 1, wherein the computing of the noise map is based on a plurality of WSAD values each representing a weighted sum of absolute differences among pixels of a block of pixels, each WSAD value determined from a different sampling pattern taken across the block of pixels.

### Claim 9 (depends on 8)

The method of claim 8, wherein the noise map is further determined based on a confidence interval as a function of the plurality of WSAD values.

### Claim 10 (depends on 8)

The method of claim 8, wherein the different sampling pattern includes pairs of pixels.

### Claim 11 (depends on 8)

The method of claim 8, wherein the different sampling pattern is generated randomly.

### Claim 12 (depends on 1)

The method of claim 1, wherein the contours are represented by pixel locations.

### Claim 13 (depends on 1)

The method of claim 1, wherein the contours are represented by locations of pixel blocks.

### Claim 14 (depends on 1)

The method of claim 1, wherein the quantization artifacts include banding artifacts.

### Claim 15 (depends on 14)

The method of claim 14, wherein the banding artifacts are caused by video quantization.

### Claim 16 (depends on 15)

The method of claim 15, wherein the determining of the contours of banding artifacts is based on a detection of peaks in a statistical measurement of the noise map.

### Claim 17 (depends on 1)

The method of claim 1, wherein the computing of the gradient measurement is based on shift differences among adjacent blocks of pixels in up, down, left, or right direction.

### Claim 18 (depends on 17)

The method of claim 17, wherein the shift differences are directional to at least one of the up, down, left, and right directions.

### Claim 19 (depends on 17)

The method of claim 17, wherein the shift differences are isotropic to directions.

### Claim 20 (depends on 17)

The method of claim 17, wherein the gradient measurement is a sum of shift differences in the up, down, left, and right directions.

### Claim 21

A method for dithering video and dithering information transmitted from a custom encoder over a communication channel, comprising:
(a) selecting a segment of video frames from the video;
(b) computing a noise map for the segment of the video, the noise map computed from differences among pixels selected from spatially-distributed sampling patterns in the segment;
(c) determining contours of quantization artifacts within the video frame based on the noise map and a histogram of pixel values in the video frame;
(d) computing a gradient measurement of pixel values along the contours;
(e) identifying regions along the contours of quantization artifacts to apply dithering based on the noise map and the gradient measurement;
(f) determining a dithering strength based on the noise map and the gradient measurement;
(g) transmitting the bitstream and dithering information over the communication channel to a decoder, the dithering information including the contours of quantization artifacts, the identified regions along the contours, and the determined dithering strength.

### Claim 22 (depends on 21)

The method of claim 21, further comprising:
decoding the bitstream into the video at the decoder; and
dithering the video based on the dithering information.

### Claim 23 (depends on 21)

The method of claim 21, wherein the performance of steps (a)-(g) only when the decoder has limited resources.

### Claim 24 (depends on 21)

The method of claim 21, wherein the encoder decodes the bitstream using an in-loop decoder built in the encoder.

### Claim 25 (depends on 21)

The method of claim 21, wherein the communication channel is wired.

### Claim 26 (depends on 21)

The method of claim 21, wherein the communication channel is wireless.

### Claim 27 (depends on 21)

The method of claim 21, wherein the quantization artifacts include banding artifacts.

### Claim 28

A method for dithering video to be encoded in an encoder, comprising:
selecting a segment of video frames from the video;
computing a noise map for the segment of the video, the noise map computed from differences among pixels selected from spatially-distributed sampling patterns in the segment;
determining contours of quantization artifacts within the video frame based on the noise map and a histogram of pixel values in the video frame;
computing a gradient measurement of pixel values along the contours;
identifying regions along the contours of quantization artifacts to apply dithering based on the noise map and the gradient measurement;
determining a dithering strength based on the noise map and the gradient measurement;
applying dithering noise to the identified regions at the determined dithering strength along the identified regions, and
encoding the dithered video at the encoder.

### Claim 29

A device for dithering a video, comprising:
a processor configured to perform:
selecting a segment of video frames from the video;
computing a noise map for the segment of the video, the noise map computed from differences among pixels selected from spatially-distributed sampling patterns in the segment;
determining contours of quantization artifacts within the video frame based on the noise map and a histogram of pixel values in the video frame;
computing a gradient measurement of pixel values along the contours;
identifying regions along the contours of quantization artifacts to apply dithering based on the noise map and the gradient measurement;
determining a dithering strength based on the noise map and the gradient measurement; and
applying dithering noise to the identified regions at the determined dithering strength along the identified regions.

### Claim 30

A machine-readable medium stored thereon codes configured to perform a method for dithering video from a decoder, comprising:
selecting a segment of video frames from the video;
computing a noise map for the segment of the video, the noise map computed from differences among pixels selected from spatially-distributed sampling patterns in the segment;
determining contours of quantization artifacts within the video frame based on the noise map and a histogram of pixel values in the video frame;
computing a gradient measurement of pixel values along the contours;
identifying regions along the contours of quantization artifacts to apply dithering based on the noise map and the gradient measurement;
determining a dithering strength based on the noise map and the gradient measurement; and
applying dithering noise to the identified regions at the determined dithering strength along the identified regions.

### Claim 31

A method for dithering video from a decoder, comprising:
computing directional shift differences for a video frame;
determining contours of quantization artifacts in the video frame based on the directional shift differences and a histogram of pixel values in the video frame;
computing a gradient measurement of pixel values along the contours;
identifying regions along the contours of quantization artifacts to apply dithering based on the gradient measurement;
determining a dithering strength based on the gradient measurement; and
applying dithering noise to the identified regions at the determined dithering strength along the identified regions.

### Claim 32 (depends on 31)

The method of claim 31, wherein the directional shift differences are computed in at least one of the up, down, left, and right directions.
