# US 2017/0257644 A1 · Spatial Improvement of Transform Blocks

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0257644 A1
- Document ID: US20170257644A1
- Status: Published application
- Kind: A1
- Application number: 14/779,262
- Filed: 2015-09-01
- Published: 2017-09-07
- Earliest claimed: 2015-09-01
- Assignees: Telefonaktiebolaget LM Ericsson (publ)
- Applicants: Telefonaktiebolaget Lm Ericsson (Publ)
- Inventors: Kenneth Andersson; Per Wennersten
- Web page: https://patentgrep.com/patent/US20170257644A1

## CPC

- H04N 19/61: in combination with predictive coding
- H04N 19/122: Selection of transform size, e.g. 8x8 or 2x4x8 DCT; Selection of sub-band transforms of varying structure or type
- H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/18: the unit being a set of transform coefficients
- H04N 19/182: the unit being a pixel
- H04N 19/86: involving reduction of coding artifacts, e.g. of blockiness
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Reconstructed prediction errors in a sub-portion (12) of a residual block (11) obtained by inverse transforming a transform block (10) are modified in order to spatially improve localized portions of the residual block (11), e.g. to compensate for visual artifacts from transform coding. The modification affects reconstructed prediction errors in the sub-portion (12) of the residual block (11) but not reconstructed prediction errors in a remaining portion of the residual block (11).

## Claims

### Claim at position 1

1-46. (canceled)

### Claim 47

A method of transform block decoding, said method comprising:
inverse transforming a first transform block of samples having a respective transform coefficient to obtain a first residual block of samples having a respective reconstructed prediction error value;
inverse transforming a second transform block of samples having a respective transform coefficient to obtain a second residual block of samples having a respective reconstructed prediction error value; and
modifying respective reconstructed prediction error values of samples in a sub-portion of said first residual block by respective reconstructed prediction error values of said second residual block, wherein modifying said respective reconstructed prediction error values affects reconstructed prediction error values of samples in said sub-portion of said residual block but not reconstructed prediction error values of samples in a remaining portion of said residual block.

### Claim 48 (depends on 47)

The method according to claim 47, wherein said second residual block has a smaller size in terms of number of samples as compared to said first residual block and said second residual block corresponds to said sub-portion of said first residual block, and wherein modifying said respective reconstructed prediction error values comprises modifying, sample by sample, said respective reconstructed prediction error values of said sub-portion of said first residual block by said respective reconstructed prediction error values of said second residual block.

### Claim 49 (depends on 48)

The method according to claim 48, wherein modifying said respective reconstructed prediction error values comprises adding, sample by sample, said reconstructed respective prediction error values of said second residual block to said respective reconstructed prediction error values of said sub-portion of said first residual block.

### Claim 50 (depends on 48)

The method according to claim 48, wherein modifying said respective reconstructed prediction error values comprises replacing, sample by sample, said respective reconstructed prediction error values of said sub-portion of said first residual block by said respective reconstructed prediction error values of said second residual block.

### Claim 51 (depends on 47)

The method according to claim 47, wherein modifying said respective reconstructed prediction error values comprises:
modifying respective reconstructed prediction error values in a sub-portion of said second residual block; and
adding, sample by sample, said respective reconstructed prediction error values of said second residual block to said respective reconstructed prediction error values of said first residual block.

### Claim 52 (depends on 51)

The method according to claim 51, wherein modifying said respective reconstructed prediction error values comprises zeroing said respective reconstructed prediction error values in said sub-portion of said second residual block.

### Claim 53 (depends on 51)

The method according to claim 51, wherein modifying said respective reconstructed prediction error values comprises multiplying each respective reconstructed prediction error value in said sub-portion of said second residual block with a respective weight.

### Claim 54 (depends on 51)

The method according to claim 51, wherein:
inverse transforming said first transform block comprises inverse transforming said first transform block of samples having a respective zero-frequency or low frequency transform coefficient to obtain said first residual block; and
inverse transforming said second transform block comprises inverse transforming said second transform block of samples having a respective high frequency transform coefficient to obtain said second residual block.

### Claim 55 (depends on 54)

The method according to claim 54, further comprising splitting a transform block of samples having a respective transform coefficient into said first transform block and said second transform block by:
copying said respective zero-frequency and low frequency transform coefficients from said transform block into zero-frequency and low frequency sample positions in said first transform block;
setting remaining sample positions in said first transform block to zero;
copying said respective high frequency transform coefficients from said transform block into high frequency sample positions in said second transform block; and
setting remaining sample positions in said second transform block to zero.

### Claim 56

A method of transform block decoding, said method comprising:
inverse transforming a transform block of samples having a respective transform coefficient to obtain a residual block of samples having a respective reconstructed prediction error value;
providing a transform skip block of samples having a respective prediction error value, said transform skip block has a smaller size in terms of number of samples as compared to said residual block; and
modifying, sample by sample, respective reconstructed prediction error values samples in a sub-portion of said residual block by said respective prediction error values of said transform skip block, wherein modifying said respective reconstructed prediction error values affects reconstructed prediction error values of samples in said sub-portion of said residual block but not reconstructed prediction error values of samples in a remaining portion of said residual block.

### Claim 57

A method of transform block encoding comprising:
transforming a first residual block of samples having a respective prediction error value into a first transform block of samples having a respective transform coefficient;
transforming a second residual block of samples having a respective prediction error value into a second transform block of samples having a respective transform coefficient; and
providing information instructing a decoder to modify respective reconstructed prediction error values of samples in a sub-portion of a reconstructed version of said first residual block obtained based on said first transform block by respective reconstructed prediction error values of a reconstructed version of said second residual block obtained based on said second transform block, wherein modifying said respective reconstructed prediction error values affects reconstructed prediction error values of samples in said sub-portion of said reconstructed version of said first residual block but not reconstructed prediction error values of samples in a remaining portion of said reconstructed version of said first residual block.

### Claim 58 (depends on 57)

The method according to claim 57, wherein said second residual block has a smaller size in terms of number of samples as compared to said first residual block and said second residual block corresponds to a sub-portion of said first residual block, and wherein modifying said respective reconstructed prediction error values comprises modifying, sample by sample, said respective reconstructed prediction error values of said sub-portion of said reconstructed version of said first residual block obtained based on said first transform block by said respective reconstructed prediction error values of said reconstructed version of said second residual block obtained based on said second transform block.

### Claim 59 (depends on 57)

The method according to claim 57, wherein modifying said respective prediction error values comprises:
modifying respective reconstructed prediction error values in a sub-portion of a reconstructed version of said second residual block obtained based on said second transform block; and
adding, sample by sample, said respective reconstructed prediction error values of said reconstructed version of said second residual block to said respective reconstructed prediction error values of said reconstructed version of said first residual block obtained based on said first transform block.

### Claim 60 (depends on 59)

The method according to claim 59, wherein:
transforming said first residual block comprises transforming said first residual block into said first transform block of samples having a respective zero-frequency or low frequency transform coefficient; and
transforming said second residual block comprises transforming said second residual block into said second transform block of samples having a respective high frequency transform coefficient.

### Claim 61 (depends on 57)

The method according to claim 57, wherein providing said information comprises providing information instructing said decoder to split a transform block of samples having a respective transform coefficient into said first transform block of samples having a respective zero-frequency or low frequency transform coefficient and said second transform block of samples having a respective high frequency transform coefficient by:
copying respective zero-frequency and low frequency transform coefficients from said transform block into zero-frequency and low frequency sample positions in said first transform block;
setting remaining sample positions in said first transform block to zero;
copying respective high frequency transform coefficients from said transform block into high frequency sample positions in said second transform block; and
setting remaining sample positions in said second transform block to zero, wherein modifying said respective prediction error values comprises:
modifying respective reconstructed prediction error values in a sub-portion of a reconstructed version of a second residual block of samples obtained based on said second transform block; and
adding, sample by sample, said respective reconstructed prediction error values of said reconstructed version of said second residual block to respective reconstructed prediction error values of said reconstructed version of said first residual block obtained based on said first transform block.

### Claim 62

A method of transform block encoding comprising:
transforming a residual block of samples having a respective prediction error value into a transform block of samples having a respective transform coefficient; and
providing a transform skip block of samples having a respective prediction error value, said transform skip block has a smaller size in terms of number of samples as compared to said residual block; and
providing information instructing a decoder to modify, sample by sample, respective reconstructed prediction error values of samples in a sub-portion of a reconstructed version of said residual block obtained based on said transform block by respective prediction error values of said transform skip block, wherein modifying said respective reconstructed prediction error values affects reconstructed prediction error values of samples in said sub-portion of said reconstructed version of said residual block but not reconstructed prediction error values of samples in a remaining portion of said reconstructed version of said residual block.

### Claim 63

A device for transform block decoding, wherein:
said device is configured to inverse transform a first transform block of samples having a respective transform coefficient to obtain a first residual block of samples having a respective reconstructed prediction error value;
said device is configured to inverse transform a second transform block of samples having a respective transform coefficient to obtain a second residual block of samples having a respective reconstructed prediction error value; and
said device is configured to modify respective reconstructed prediction error values of samples in a sub-portion of said first residual block by respective reconstructed prediction error values of said second residual block, wherein the modification performed by said device affects reconstructed prediction error values of samples in said sub-portion of said first residual block but not reconstructed prediction error values of samples in a remaining portion of said first residual block.

### Claim 64 (depends on 63)

The device according to claim 63, wherein said second residual block has a smaller size in terms of number of samples as compared to said first residual block and said second residual block corresponds to a sub-portion of said first residual block, and said device is configured to modify, sample by sample, said respective reconstructed prediction error values of said sub-portion of said first residual block by said respective reconstructed prediction error values of said second residual block.

### Claim 65 (depends on 64)

The device according to claim 64, wherein said device is configured to add, sample by sample, said respective reconstructed prediction error values of said second residual block to said respective reconstructed prediction error values of said sub-portion of said first residual block.

### Claim 66 (depends on 64)

The device according to claim 64, wherein said device is configured to replace, sample by sample, said respective reconstructed prediction error values of said sub-portion of said first residual block by said respective reconstructed prediction error values of said second residual block.

### Claim 67 (depends on 63)

The device according to claim 63, wherein:
said device is configured to modify respective reconstructed prediction error values in a sub-portion of said second residual block; and
said device is configured to add, sample by sample, said respective reconstructed prediction error values of said second residual block to said respective reconstructed prediction error values of said first residual block.

### Claim 68 (depends on 67)

The device according to claim 67, wherein:
said device is configured to inverse transform said first transform block of samples having a respective zero-frequency or low frequency transform coefficient to obtain said first residual block; and
said device is configured to inverse transform said second transform block of samples having a respective high frequency transform coefficient to obtain said second residual block.

### Claim 69 (depends on 68)

The device according to claim 68, wherein said device is configured to split a transform block of samples having a respective transform coefficient into said first transform block and said second transform block by:
copying said respective zero-frequency and low frequency transform coefficients from said transform block into zero-frequency and low frequency sample positions in said first transform block;
setting remaining sample positions in said first transform block to zero;
copying said respective high frequency transform coefficients from said transform block into high frequency sample positions in said second transform block; and
setting remaining sample positions in said second transform block to zero.

### Claim 70 (depends on 63)

The device according to claim 63, comprising:
a processor; and
a memory comprising instructions executable by said processor, wherein said processor is operative to inverse transform said first transform block and said second transform block; and
said processor is operative to modify said respective reconstructed prediction error values of samples in said sub-portion of said first residual block by said respective reconstructed prediction error values of said second residual block.

### Claim 71

A device for transform block decoding comprising:
an inverse transforming unit for inverse transforming a first transform block of samples having a respective transform coefficient to obtain a first residual block of samples having a respective reconstructed prediction error value and inverse transforming a second transform block of samples having a respective transform coefficient to obtain a second residual block of samples having a respective reconstructed prediction error value; and
a modifying unit for modifying respective reconstructed prediction error values of samples in a sub-portion of said first residual block by respective reconstructed prediction error values of said second residual block, wherein the modification performed by said modifying unit affects reconstructed prediction error values of samples in said sub-portion of said first residual block but not reconstructed prediction error values of samples in a remaining portion of said first residual block.

### Claim 72

A device for transform block decoding, wherein:
said device is configured to inverse transform a transform block of samples having a respective transform coefficient to obtain a residual block of samples having a respective reconstructed prediction error value;
said device is configured to provide a transform skip block of samples having a respective prediction error value, said transform skip block has a smaller size in terms of number of samples as compared to said residual block; and
said device is configured to modify, sample by sample, respective reconstructed prediction error values in a sub-portion of said residual block by said respective prediction error values of said transform skip block, wherein the modification performed by said device affects reconstructed prediction error values of samples in said sub-portion of said residual block but not reconstructed prediction error values of samples in a remaining portion of said residual block.

### Claim 73 (depends on 72)

The device according to claim 72, comprising:
a processor; and
a memory comprising instructions executable by said processor, wherein:
said processor is operative to inverse transform said transform block;
said processor is operative to provide said transform skip block; and
said processor is operative to modify said respective reconstructed prediction error values of samples in said sub-portion of said residual block by said respective prediction error values of said transform skip block.

### Claim 74

A device for transform block decoding comprising:
an inverse transforming unit for inverse transforming a transform block of samples having a respective transform coefficient to obtain a residual block of samples having a respective reconstructed prediction error value; and
a modifying unit for modifying, sample by sample, respective reconstructed prediction error values in a sub-portion of said residual block by respective prediction error values of a transform skip block of samples having a respective prediction error value, said transform skip block has a smaller size in terms of number of samples as compared to said residual block, wherein the modification performed by said modifying unit affects reconstructed prediction error values of samples in said sub-portion of said residual block but not reconstructed prediction error values of samples in a remaining portion of said residual block.

### Claim 75

A decoder comprising a device for transform block decoding, wherein:
said device is configured to inverse transform a first transform block of samples having a respective transform coefficient to obtain a first residual block of samples having a respective reconstructed prediction error value;
said device is configured to inverse transform a second transform block of samples having a respective transform coefficient to obtain a second residual block of samples having a respective reconstructed prediction error value; and
said device is configured to modify respective reconstructed prediction error values of samples in a sub-portion of said first residual block by respective reconstructed prediction error values of said second residual block, wherein the modification performed by said device affects reconstructed prediction error values of samples in said sub-portion of said first residual block but not reconstructed prediction error values of samples in a remaining portion of said first residual block.

### Claim 76

A user equipment comprising a decoder for transform block decoding, wherein:
said decoder is configured to inverse transform a first transform block of samples having a respective transform coefficient to obtain a first residual block of samples having a respective reconstructed prediction error value;
said decoder is configured to inverse transform a second transform block of samples having a respective transform coefficient to obtain a second residual block of samples having a respective reconstructed prediction error value; and
said decoder is configured to modify respective reconstructed prediction error values of samples in a sub-portion of said first residual block by respective reconstructed prediction error values of said second residual block, wherein the modification performed by said decoder affects reconstructed prediction error values of samples in said sub-portion of said first residual block but not reconstructed prediction error values of samples in a remaining portion of said first residual block.

### Claim 77

A device for transform block encoding,
said device is configured to transform a first residual block of samples having a respective prediction error value into a first transform block of samples having a respective transform coefficient;
said device is configured to transform a second residual block of samples having a respective prediction error value into a second transform block of samples having a respective transform coefficient; and
said device is configured to provide information instructing a decoder to modify respective reconstructed prediction error values of samples in a sub-portion of a reconstructed version of said first residual block obtained based on said first transform block by respective reconstructed prediction error values of a reconstructed version of said second residual block obtained based on said second transform block, wherein modifying said respective reconstructed prediction error values affects reconstructed prediction error values of samples in said sub-portion of said reconstructed version of said first residual block but not reconstructed prediction error values of samples in a remaining portion of said reconstructed version of said first residual block.

### Claim 78 (depends on 77)

The device according to claim 77, wherein said second residual block has a smaller size in terms of number of samples as compared to said first residual block and said second residual block corresponds to a sub-portion of said first residual block, wherein modifying said respective reconstructed prediction error values comprises modifying, sample by sample, said respective reconstructed prediction error values of said sub-portion of said reconstructed version of said first residual block by respective reconstructed prediction error values of a reconstructed version of said second residual block.

### Claim 79 (depends on 77)

The device according to claim 77, wherein modifying said respective prediction error values comprises:
modifying respective reconstructed prediction error values in a sub-portion of a reconstructed version of said second residual block obtained based on said second transform block; and
adding, sample by sample, said respective reconstructed prediction error values of said reconstructed version of said second residual block to said reconstructed respective prediction error values of said reconstructed version of said first residual block obtained based on said first transform block.

### Claim 80 (depends on 79)

The device according to claim 79, wherein:
said device is configured to transform said first residual block into said first transform block of samples having a respective zero-frequency or low frequency transform coefficient; and
said device is configured to transform said second residual block into said second transform block of samples having a respective high frequency transform coefficient to obtain said second residual block.

### Claim 81 (depends on 77)

The device according to claim 77, wherein said device is configured to provide information instructing said decoder to split a transform block of samples having a respective transform coefficient into said first transform block of samples having a respective zero-frequency or low frequency transform coefficient and said second transform block of samples having a respective high frequency transform coefficient by:
copying respective zero-frequency and low frequency transform coefficients from said transform block into zero-frequency and low frequency sample positions in said first transform block;
setting remaining sample positions in said first transform block to zero;
copying respective high frequency transform coefficients from said transform block into high frequency sample positions in said second transform block; and
setting remaining sample positions in said second transform block to zero, wherein modifying said respective prediction error values comprises:
modifying respective prediction error value in a sub-portion of a reconstructed version of a second residual block of samples obtained based on said second transform block; and
adding, sample by sample, said respective prediction error values of said reconstructed version of said second residual block to respective prediction error values of said reconstructed version of said first residual block obtained based on said first transform block.

### Claim 82 (depends on 77)

The device according to claim 77, comprising:
a processor; and
a memory comprising instructions executable by said processor, wherein
said processor is operative to transform said first residual block and said second residual block into said first transform block and said second transform block; and
said processor is operative to provide said information instructing said decoder to modify said respective reconstructed prediction error values of samples in said sub-portion of said reconstructed version of said first residual block by said respective reconstructed prediction error values of said reconstructed version of said second residual block.

### Claim 83

A device for transform block encoding comprising:
a transforming unit for transforming a first residual block of samples having a respective prediction error value into a first transform block of samples having a respective transform coefficient and transforming a second residual block of samples having a respective prediction error value into a second transform block of samples having a respective transform coefficient; and
a providing unit for providing information instructing a decoder to modify respective reconstructed prediction error values of samples in a sub-portion of a reconstructed version of said first residual block obtained based on said first transform block by respective reconstructed prediction error values of a reconstructed version of said second residual block obtained based on said second transform block, wherein modifying said respective reconstructed prediction error values affects reconstructed prediction error values of samples in said sub-portion of said reconstructed version of said first residual block but not reconstructed prediction error values of samples in a remaining portion of said reconstructed version of said first residual block.

### Claim 84

A device for transform block encoding:
said device is configured to transform a residual block of samples having a respective prediction error value into a transform block of samples having a respective transform coefficient;
said device is configured to provide a transform skip block of samples having a respective prediction error value, said transform skip block has a smaller size in terms of number of samples as compared to said residual block; and
said device is configured to provide information instructing a decoder to modify, sample by sample, respective reconstructed prediction error values of samples in a sub-portion of a reconstructed version of said residual block obtained based on said transform block by said respective prediction error values of said transform skip block, wherein modifying said respective reconstructed prediction error values affects reconstructed prediction error values of samples in said sub-portion of said reconstructed version of said residual block but not reconstructed prediction error values of samples in a remaining portion of said reconstructed version of said residual block.

### Claim 85 (depends on 84)

The device according to claim 84, comprising:
a processor; and
a memory comprising instructions executable by said processor, wherein
said processor is operative to transform said residual block into said transform block;
said processor is operative to provide said transform skip block; and
said processor is operative to provide said information instructing said decoder to modify, sample by sample, said respective reconstructed prediction error values of samples in said sub-portion of said reconstructed version of said residual block obtained based on said transform block by said respective prediction error values of said transform skip block.

### Claim 86

A device for transform block encoding comprising:
a transforming unit for transforming a residual block of samples having a respective prediction error value into a transform block of samples having a respective transform coefficient; and
a providing unit for providing a transform skip block of samples having a respective prediction error value, said transform skip block has a smaller size in terms of number of samples as compared to said residual block and providing information instructing a decoder to modify, sample by sample, respective reconstructed prediction error values of samples in a sub-portion of a reconstructed version of said residual block obtained based on said transform block by said respective prediction error values of said transform skip block, wherein modifying said respective reconstructed prediction error values affects reconstructed prediction error values of samples in said sub-portion of said reconstructed version of said residual block but not reconstructed prediction error values of samples in a remaining portion of said reconstructed version of said residual block.

### Claim 87

An encoder comprising a device for transform block encoding wherein:
said device is configured to transform a first residual block of samples having a respective prediction error value into a first transform block of samples having a respective transform coefficient;
said device is configured to transform a second residual block of samples having a respective prediction error value into a second transform block of samples having a respective transform coefficient; and
said device is configured to provide information instructing a decoder to modify respective reconstructed prediction error values of samples in a sub-portion of a reconstructed version of said first residual block obtained based on said first transform block by respective reconstructed prediction error values of a reconstructed version of said second residual block obtained based on said second transform block, wherein modifying said respective reconstructed prediction error values affects reconstructed prediction error values of samples in said sub-portion of said reconstructed version of said first residual block but not reconstructed prediction error values of samples in a remaining portion of said reconstructed version of said first residual block.

### Claim 88

A non-transitory computer-readable medium storing a computer program comprising instructions that, when executed by a processor, cause said processor to:
inverse transform a first transform block of samples having a respective transform coefficient to obtain a first residual block of samples having a respective reconstructed prediction error value;
inverse transform a second transform block of samples having a respective transform coefficient to obtain a second residual block of samples having a respective reconstructed prediction error value; and
modify respective reconstructed prediction error values of samples in a sub-portion of said first residual block by respective reconstructed prediction error values of said second residual block, wherein the modification performed by said processor affects reconstructed prediction error values of samples in said sub-portion of said first residual block but not reconstructed prediction error values of samples in a remaining portion of said first residual block.

### Claim 89

A non-transitory computer-readable medium storing a computer program comprising instructions that, when executed by a processor, cause said processor to:
transform a transform block of samples having a respective transform coefficient to obtain a residual block of samples having a respective reconstructed prediction error value;
provide a transform skip block of samples having a respective prediction error value, said transform skip block has a smaller size in terms of number of samples as compared to said residual block; and
modify, sample by sample, said respective reconstructed prediction error values of said sub-portion of said residual block by said respective prediction error values of said transform skip block, wherein the modification performed by said processor affects reconstructed prediction error values of samples in said sub-portion of said residual block but not reconstructed prediction error values of samples in a remaining portion of said residual block.

### Claim 90

A non-transitory computer-readable medium storing a computer program comprising instructions that, when executed by a processor, cause said processor to:
transform a first residual block of samples having a respective prediction error value into a first transform block of samples having a respective transform coefficient;
transform a second residual block of samples having a respective prediction error value into a second transform block of samples having a respective transform coefficient; and
provide information instructing a decoder to modify respective reconstructed prediction error values of samples in a sub-portion of a reconstructed version of said first residual block obtained based on said first transform block by respective reconstructed prediction error values of a reconstructed version of said second residual block obtained based on said second transform block, wherein modifying said respective reconstructed prediction error values affects reconstructed prediction error values of samples in said sub-portion of said reconstructed version of said first residual block but not reconstructed prediction error values of samples in a remaining portion of said reconstructed version of said first residual block.

### Claim 91

A non-transitory computer-readable medium storing a computer program comprising instructions that, when executed by a processor, cause said processor to:
transform a residual block of samples having a respective prediction error value into a transform block of samples having a respective transform coefficient;
provide a transform skip block of samples having a respective prediction error value, said transform skip block has a smaller size in terms of number of samples as compared to said residual block; and
provide information instructing a decoder to modify, sample by sample, respective reconstructed prediction error values of samples in a sub-portion of a reconstructed version of said residual block obtained based on said transform block by said respective prediction error values of said transform skip block, wherein modifying said respective reconstructed prediction error values affects reconstructed prediction error values of samples in said sub-portion of said reconstructed version of said residual block but not reconstructed prediction error values of samples in a remaining portion of said reconstructed version of said residual block.
