# US 2017/0257645 A1 · Apparatus and method to improve image or video quality or encoding performance by enhancing discrete cosine transform coefficients

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0257645 A1
- Document ID: US20170257645A1
- Status: Published application
- Kind: A1
- Application number: 15/447,755
- Filed: 2017-03-02
- Published: 2017-09-07
- Earliest claimed: 2016-03-02
- Assignees: Matrixview Limited
- Applicants: MatrixView, Inc.
- Inventors: Arvind Thiagarajan; Ravilla Jaisimha
- Web page: https://patentgrep.com/patent/US20170257645A1

## CPC

- H04N 19/625: using discrete cosine transform [DCT]
- G10L 19/00: Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis (in musical instruments G10H)
- H04N 19/124: Quantisation
- H04N 19/126: Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
- H04N 19/176: the region being a block, e.g. a macroblock
- H04N 19/18: the unit being a set of transform coefficients
- G10L 19/0212: {using orthogonal transformation}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Provided is a process for compressing data that includes: obtaining data to be compressed; compressing the data with a first DCT compression algorithm to obtain a first DCT amplitude matrix; compressing the data with a second DCT compression algorithm to obtain a second DCT amplitude matrix, the second DCT compression algorithm compressing the data more than the first algorithm; modifying the second DCT amplitude matrix based on a value in the first DCT amplitude matrix.

## Claims

### Claim 1

A method for compressing data, the method comprising:
obtaining, with one or more processors, video or other image data to be compressed;
compressing, with one or more processors, the data with a first discrete cosine transform (DCT) compression algorithm to obtain a first DCT amplitude matrix, wherein:
the first DCT compression algorithm has a first compression rate;
the first DCT amplitude matrix comprises a plurality of rows corresponding to different respective frequencies of variation in the data in a first direction; and
the first DCT amplitude matrix comprises a plurality of columns corresponding to different respective frequencies of variation in the data in a second direction;
compressing, with one or more processors, the data with a second DCT compression algorithm to obtain a second DCT amplitude matrix, wherein:
the second DCT compression algorithm has a second compression rate that is a higher compression rate than the first compression rate;
the second DCT amplitude matrix comprises a plurality of rows corresponding to different respective frequencies of variation in the data in the first direction;
the second DCT amplitude matrix comprises a plurality of columns corresponding to different respective frequencies of variation in the data in the second direction; and
the first DCT amplitude matrix and the second DCT amplitude matrix represent the same data compressed by differing amounts;
forming, with one or more processors, a hybrid DCT amplitude matrix based on both at least part of the first DCT amplitude matrix and at least part of the second DCT amplitude matrix, the hybrid DCT amplitude matrix comprises at least some values from the first DCT amplitude matrix and at least some values from the second DCT amplitude matrix; and
saving the hybrid DCT amplitude matrix or compressed data based on the hybrid DCT amplitude matrix to memory or sending the hybrid DCT amplitude matrix or compressed data based on the hybrid DCT amplitude matrix over a network.

### Claim 2 (depends on 1)

The method of claim 1, comprising:
modifying the second DCT amplitude matrix based on a first set of values in the first DCT amplitude matrix, wherein modifying includes replacing a second set of values in the second DCT amplitude matrix with the first set of values, the second set of values corresponding to the first set of values in the second amplitude matrix.

### Claim 3 (depends on 1)

The method of claim 1, wherein the at least some values from the first DCT amplitude matrix include a direct current (DC) component with corresponding value from the first amplitude matrix.

### Claim 4 (depends on 1)

The method of claim 1, wherein the at least some values from the second DCT amplitude matrix include highest-frequency alternative current (AC) component corresponding values from the second DCT amplitude matrix.

### Claim 5 (depends on 1)

The method of claim 1, comprising:
dynamically forming the hybrid DCT amplitude matrix based on a threshold value that changes during compression of a video.

### Claim 6 (depends on 5)

The method of claim 5, comprising:
obtaining bit rate information indicative of data transmission rate of the compressed data over a network;
obtaining a bit rate target; and
adjusting the threshold based on difference between the bit rate target and a bit rate of the video.

### Claim 7 (depends on 1)

The method of claim 1, comprising:
obtaining data loss information indicative of amount of data lost in compression;
obtaining a data loss threshold; and
determining that the obtained data loss information exceeds the threshold and in response adjusting a number of values in the first DCT amplitude matrix combined with the second DCT amplitude matrix in the hybrid DCT amplitude matrix.

### Claim 8 (depends on 1)

The method of claim 1, comprising:
segmenting an image into blocks of adjacent pixels and determining hybrid DCT amplitude matrices for each respective block of adjacent pixels.

### Claim 9 (depends on 8)

The method of claim 8, wherein:
a threshold frequency used to determine which values of the respective hybrid DCT amplitude matrices for each respective block come from which of the first and second DCT compression algorithms is different for different blocks of adjacent pixels in the image.

### Claim 10 (depends on 1)

The method of claim 1, wherein:
the first DCT compression algorithm has a first quantization matrix; and
the second DCT compression algorithm has a second quantization matrix that is different from the first quantization matrix.

### Claim 11 (depends on 1)

The method of claim 1, comprising:
serializing the hybrid DCT amplitude matrix.

### Claim 12 (depends on 11)

The method of claim 11, comprising:
encoding the serialized DCT amplitude matrix with run-length coding to form a compressed bitstream representation of video.

### Claim 13 (depends on 12)

The method of claim 12, wherein:
the compressed bitstream representation of video is configured to be decoded by a decoder operative to decode data compressed by a single one of the first DCT compression algorithm and the second DCT compression algorithm.

### Claim 14 (depends on 1)

The method of claim 1, comprising:
steps for forming a discrete cosine transform.

### Claim 15 (depends on 1)

The method of claim 1, comprising:
steps for forming a hybrid DCT amplitude matrix.

### Claim 16 (depends on 1)

The method of claim 1, comprising:
steps for adjusting a threshold frequency for combining two versions of a DCT amplitude matrix.

### Claim 17

A tangible, non-transitory, machine-readable medium storing instructions that when executed by one or more computers effectuate operations of compressing data, the operations comprising:
obtaining, with one or more processors, video or other image data to be compressed;
compressing, with one or more processors, the data with a first discrete cosine transform (DCT) compression algorithm to obtain a first DCT amplitude matrix, wherein:
the first DCT compression algorithm has a first compression rate;
the first DCT amplitude matrix comprises a plurality of rows corresponding to different respective frequencies of variation in the data in a first direction; and
the first DCT amplitude matrix comprises a plurality of columns corresponding to different respective frequencies of variation in the data in a second direction;
compressing, with one or more processors, the data with a second DCT compression algorithm to obtain a second DCT amplitude matrix, wherein:
the second DCT compression algorithm has a second compression rate that is a higher compression rate than the first compression rate;
the second DCT amplitude matrix comprises a plurality of rows corresponding to different respective frequencies of variation in the data in the first direction;
the second DCT amplitude matrix comprises a plurality of columns corresponding to different respective frequencies of variation in the data in the second direction; and
the first DCT amplitude matrix and the second DCT amplitude matrix represent the same data compressed by differing amounts;
forming, with one or more processors, a hybrid DCT amplitude matrix based on both at least part of the first DCT amplitude matrix and at least part of the second DCT amplitude matrix, the hybrid DCT amplitude matrix comprises at least some values from the first DCT amplitude matrix and at least some values from the second DCT amplitude matrix; and
saving the hybrid DCT amplitude matrix or compressed data based on the hybrid DCT amplitude matrix to memory or sending the hybrid DCT amplitude matrix or compressed data based on the hybrid DCT amplitude matrix over a network.

### Claim 18 (depends on 17)

The medium of claim 17, the operations comprising
modifying the second DCT amplitude matrix based on a first set of values in the first DCT amplitude matrix, wherein modifying includes replacing a second set of values in the second DCT amplitude matrix with the first set of values, the second set of values corresponding to the first set of values in the second amplitude matrix.

### Claim 19 (depends on 17)

The medium of claim 17, wherein the at least some values from the first DCT amplitude matrix include a direct current (DC) component with corresponding value from the first amplitude matrix.

### Claim 20 (depends on 17)

The medium of claim 17, wherein the at least some values from the second DCT amplitude matrix include highest-frequency alternative current (AC) component corresponding values from the second DCT amplitude matrix.
