# US 2019/0356917 A1 · Image processing device and image processing method for image encoding based on non-square quantization matrix

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0356917 A1
- Document ID: US20190356917A1
- Status: Published application
- Kind: A1
- Application number: 16/524,750
- Filed: 2019-07-29
- Published: 2019-11-21
- Earliest claimed: 2011-05-20
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: HIRONARI SAKURAI; JUNICHI TANAKA
- Web page: https://patentgrep.com/patent/US20190356917A1

## CPC

- H04N 19/122: Selection of transform size, e.g. 8x8 or 2x4x8 DCT; Selection of sub-band transforms of varying structure or type
- H04N 19/126: Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
- H04N 19/129: Scanning of coding units, e.g. zig-zag scan of transform coefficients or flexible macroblock ordering [FMO]
- H04N 19/134: characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/30: using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence)
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N 19/61: in combination with predictive coding
- H04N 19/625: using discrete cosine transform [DCT]
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

There is provided an image processing device including a decoding section that decodes an encoded stream and generates quantized transform coefficient data, and an inverse quantization section that, taking transform coefficient data as transform units to be used during inverse orthogonal transform, inversely quantizes the quantized transform coefficient data decoded by the decoding section, such that in a case where a non-square transform unit is selected, the inverse quantization section uses a non-square quantization matrix, corresponding to a non-square transform unit, that is generated from a square quantization matrix corresponding to a square transform unit.

## Claims

### Claim 1

An image processing device, comprising:
a processor configured to:
orthogonally transform image data based on a non-square transform unit;
generate transform coefficient data based on the orthogonally transformed image data;
set a non-square quantization matrix based on a copy of one of row elements at an interval or column elements at the interval of a square quantization matrix;
quantize the transform coefficient data based on the non-square quantization matrix; and
encode the quantized transform coefficient data to generate a bit stream including the square quantization matrix.

### Claim 2 (depends on 1)

The image processing device according to claim 1, wherein a size of a long edge of the non-square quantization matrix is equal to a size of an edge of the square quantization matrix.

### Claim 3 (depends on 1)

The image processing device according to claim 1, wherein one of the row elements or the column elements of the square quantization matrix are based on a position associated with the square quantization matrix.

### Claim 4 (depends on 1)

The image processing device according to claim 1, wherein
the interval of one of the row elements and the column elements to be copied from the square quantization matrix is determined according to a ratio of a size of a short edge of the non-square quantization matrix versus a size of an edge of the square quantization matrix,
the ratio is 1:4, and
the interval is one of four rows or four columns.

### Claim 5 (depends on 1)

The image processing device according to claim 1, wherein
a size of the square quantization matrix is 4×4, and
a size of the non-square quantization matrix is one of 1×4 or 4×1.

### Claim 6 (depends on 1)

The image processing device according to claim 1,
wherein a size of the square quantization matrix is 8×8, and
wherein a size of the non-square quantization matrix is one of 2×8 or 8×2.

### Claim 7 (depends on 1)

The image processing device according to claim 1,
wherein a size of the square quantization matrix is 16×16, and
wherein a size of the non-square quantization matrix is one of 4×16 or 16×4.

### Claim 8 (depends on 1)

The image processing device according to claim 1,
wherein a size of the square quantization matrix is 32×32, and
wherein a size of the non-square quantization matrix is one of 8×32 or 32×8.

### Claim 9

A method, comprising:
orthogonally transforming, by a processor, image data based on a non-square transform unit;
generating, by the processor, transform coefficient data based on the orthogonally transformed image data;
setting, by the processor, a non-square quantization matrix based on a copy of one of row elements at an interval or column elements at the interval of a square quantization matrix;
quantizing, by the processor, the transform coefficient data based on the non-square quantization matrix; and
encoding, by the processor, the quantized transform coefficient data to generate a bit stream including the square quantization matrix.

### Claim 10 (depends on 9)

The method according to claim 9, wherein a size of a long edge of the non-square quantization matrix is equal to a size of an edge of the square quantization matrix.

### Claim 11 (depends on 9)

The method according to claim 9, wherein one of the row elements or the column elements of the square quantization matrix are based on a position associated with the square quantization matrix.

### Claim 12 (depends on 9)

The method according to claim 9, wherein
the interval of one of the row elements and the column elements to be copied from the square quantization matrix is determined according to a ratio of a size of a short edge of the non-square quantization matrix versus a size of an edge of the square quantization matrix,
the ratio is 1:4, and
the interval is one of four rows or four columns.

### Claim 13 (depends on 9)

The method according to claim 9,
wherein a size of the square quantization matrix is 4×4, and
wherein a size of the non-square quantization matrix is one of 1×4 or 4×1.

### Claim 14 (depends on 9)

The method according to claim 9,
wherein a size of the square quantization matrix is 8×8, and
wherein a size of the non-square quantization matrix is one of 2×8 or 8×2.

### Claim 15 (depends on 9)

The method according to claim 9,
wherein a size of the square quantization matrix is 16×16, and
wherein a size of the non-square quantization matrix is one of 4×16 or 16×4.

### Claim 16 (depends on 9)

The method according to claim 9, wherein
a size of the square quantization matrix is 32×32, and
a size of the non-square quantization matrix is one of 8×32 or 32×8.
