# US 12,010,332 B2 · Video compression based on spatial-temporal features > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,010,332 B2 - Document ID: US12010332B2 - Status: Granted - Kind: B2 - Application number: 17/861,008 - Filed: 2022-07-08 - Published: 2024-01-11 - Granted: 2024-06-11 - Earliest claimed: 2022-07-08 - Assignees: Synaptics Incorporated - Applicants: Synaptics Incorporated - Inventors: Maciej Sebastian Pedzisz - Web page: https://patentgrep.com/patent/US12010332B2 ## CPC - H04N 19/196: being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters (processing of motion vectors H04N19/513) - H04N 19/127: Prioritisation of hardware or computational resources - H04N 19/14: Coding unit complexity, e.g. amount of activity or edge presence estimation (H04N19/146 takes precedence) - H04N 19/182: the unit being a pixel - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract This disclosure provides methods, devices, and systems for video compression. The present implementations more specifically relate to video compression techniques that account for spatial-temporal changes in pixel values. In some aspects, an encoder may determine a change importance factor (CIF) for each image tile of a current image to be encoded. The encoder may calculate the CIF for an image tile of the current image (the “current image tile”) based on a degree of variation among the pixel values in the current image tile, a degree of change between the current image tile and a respective image tile of a previously-encoded image (the “previous image tile”), and a degree of variation among the pixel values in the previous image tile. In some implementations, the encoder may determine whether to transmit each of the current image tiles to a receiving device based on the CIF associated with the respective image tile. ## Claims ### Claim 1 A method of digital image transmission, comprising: receiving a plurality of first pixel values associated with a first image in a sequence of images; calculating a difference between each of the plurality of first pixel values and a respective one of a plurality of second pixel values associated with a second image that precedes the first image in the sequence of images; calculating a degree of change between the plurality of first pixel values and the plurality of second pixel values as a function (D [C, P]) of the differences between the plurality of first pixel values and the plurality of second pixel values; calculating a difference between each of the plurality of first pixel values and an average first pixel value associated with the plurality of first pixel values; calculating a degree of variation among the plurality of first pixel values as a function (V[C]) of the differences between the plurality of first pixel values and the average first pixel value: calculating a difference between each of the plurality of second pixel values and an average second pixel value associated with the plurality of second pixel values; calculating a degree of variation among the plurality of second pixel values as a function (V[P]) of the differences between the plurality of second pixel values and the average second pixel value; determining a first change importance factor (CIF) based on the degree of variation among the plurality of first pixel values, the degree of change between the plurality of first pixel values and the plurality of second pixel values, and the degree of variation among the plurality of second pixel values; and selectively transmitting the plurality of first pixel values to a receiving device based at least in part on the first CIF. ### Claim 2 (depends on 1) The method of claim 1, wherein the plurality of first pixel values represents one of a plurality of image tiles associated with the first image. ### Claim 3 (depends on 1) The method of claim 1, wherein D [C, P] is equal to the maximum of the differences between the plurality of first pixel values and the plurality of second pixel values, V[C] is equal to the arithmetic mean of the differences between the plurality of first pixel values and the average first pixel value, and V [P] is equal to the arithmetic mean of the differences between the plurality of second pixel values and the average second pixel value. ### Claim 4 (depends on 1) The method of claim 1, wherein the first CIF is determined as a ratio of D [C, P] relative to the lesser of V[C] or V[P]. ### Claim 5 (depends on 1) The method of claim 1, wherein the selective transmitting of the plurality of first pixel values comprises: refraining from transmitting the plurality of first pixel values to the receiving device based on the first CIF being less than a threshold value. ### Claim 6 (depends on 1) The method of claim 1, wherein the selective transmitting of the plurality of first pixel values comprises: refraining from transmitting the plurality of first pixel values to the receiving device based on the first CIF being outside a threshold percentile of CIFs associated with the first image. ### Claim 7 (depends on 1) The method of claim 1, further comprising: receiving a plurality of third pixel values associated with the first image; determining a second CIF based on a degree of variation among the plurality of third pixel values, a degree of change between the plurality of third pixel values and a plurality of fourth pixel values associated with the second image, and a degree of variation among the plurality of fourth pixel values; and transmitting the plurality of third pixel values to the receiving device. ### Claim 8 (depends on 7) The method of claim 7, wherein the selective transmitting of the plurality of first pixel values comprises: transmitting the plurality of first pixel values, to the receiving device, prior to the transmission of the plurality of third pixel values based on the first CIF being greater than the second CIF. ### Claim 9 (depends on 7) The method of claim 7, further comprising: encoding the plurality of first pixel values in accordance with one or more first encoding parameters associated with the first CIF; and encoding the plurality of second pixel values in accordance with one or more second encoding parameters associated with the second CIF. ### Claim 10 (depends on 9) The method of claim 9, wherein the one or more first encoding parameters are different than the one or more second encoding parameters based on the first CIF being different than the second CIF. ### Claim 11 (depends on 10) The method of claim 10, wherein the one or more first encoding parameters include a first quantization matrix and the one or more second encoding parameters include a second quantization matrix associated with a different quality level than the first quantization matrix. ### Claim 12 (depends on 1) The method of claim 1, wherein the selective transmitting of the plurality of first pixel values comprises: updating a count value based at least in part on whether the plurality of second pixel values is transmitted to the receiving device; and adjusting the first CIF based on the count value, the plurality of first pixel values being selectively transmitted to the receiving device based on the adjusted first CIF. ### Claim 13 (depends on 12) The method of claim 12 wherein the updating of the count value comprises: resetting the count value based on the plurality of second pixel values being transmitted to the receiving device. ### Claim 14 (depends on 12) The method of claim 12, wherein the updating of the count value comprises: incrementing the count value based at least in part on the plurality of second pixel values not being transmitted to the receiving device. ### Claim 15 An encoder comprising: a processing system; and a memory storing instructions that, when executed by the processing system, causes the encoder to: receive a plurality of first pixel values associated with a first image in a sequence of images; calculate a difference between each of the plurality of first pixel values and a respective one of a plurality of second pixel values associated with a second image that precedes the first image in the sequence of images; calculate a degree of change between the plurality of first pixel values and the plurality of second pixel values as a function (D [C, P]) of the differences between the plurality of first pixel values and the plurality of second pixel values; calculate a difference between each of the plurality of first pixel values and an average first pixel value associated with the plurality of first pixel values; calculate a degree of variation among the plurality of first pixel values as a function (V [C]) of the differences between the plurality of first pixel values and the average first pixel value; calculate a difference between each of the plurality of second pixel values and an average second pixel value associated with the plurality of second pixel values; and calculate a degree of variation among the plurality of second pixel values as a function (V [P]) of the differences between the plurality of second pixel values and the average second pixel value; determine a change importance factor (CIF) based on the degree of variation among the plurality of first pixel values, the degree of change between the plurality of first pixel values and the plurality of second pixel values, and the degree of variation among the plurality of second pixel values; and selectively transmit the plurality of first pixel values to a receiving device based at least in part on the CIF. ### Claim 16 (depends on 15) The encoder of claim 15, wherein D [C, P] is equal to the maximum of the differences between the plurality of first pixel values and the plurality of second pixel values, V [C] is equal to the arithmetic mean of the differences between the plurality of first pixel values and the average first pixel value, and V [P] is equal to the arithmetic mean of the differences between the plurality of second pixel values and the average second pixel value. ### Claim 17 (depends on 15) The encoder of claim 15, wherein the CIF is determined as a ratio of D [C, P] relative to the lesser of V [C] or V[P]. ### Claim 18 A method of encoding, comprising: receiving a plurality of first pixel values associated with a first image in a sequence of images; calculating a difference between each of the plurality of first pixel values and a respective one of a plurality of second pixel values associated with a second image that precedes the first image in the sequence of images; calculating a degree of change between the plurality of first pixel values and the plurality of second pixel values as a function of the differences between the plurality of first pixel values and the plurality of second pixel values; calculating a difference between each of the plurality of first pixel values and an average first pixel value associated with the plurality of first pixel values; calculating a degree of variation among the plurality of first pixel values as a function of the differences between the plurality of first pixel values and the average first pixel value; calculating a difference between each of the plurality of second pixel values and an average second pixel value associated with the plurality of second pixel values; calculating a degree of variation among the plurality of second pixel values as a function of the differences between the plurality of second pixel values and the average second pixel value: determining a change importance factor (CIF) based on the degree of variation among the plurality of first pixel values, the degree of change between the plurality of first pixel values and the plurality of second pixel values, and qathe degree of variation among the plurality of second pixel values; and encoding the plurality of first pixel values in accordance with one or more encoding parameters associated with the CIF.