# US 2006/0153304 A1 · Segment-based encoding system using residue coding by basis function coefficients

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2006/0153304 A1
- Document ID: US20060153304A1
- Status: Published application
- Kind: A1
- Application number: 11/369,336
- Filed: 2006-03-07
- Published: 2006-07-13
- Earliest claimed: 1999-04-17
- Assignees: PTS Corporation
- Inventors: Adityo Prakash; Eniko Fodor
- Web page: https://patentgrep.com/patent/US20060153304A1

## CPC

- G06T 9/001: {Model-based coding, e.g. wire frame}
- H04N 19/107: between spatial and temporal predictive coding, e.g. picture refresh
- H04N 19/12: Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
- H04N 19/156: Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
- H04N 19/17: the unit being an image region, e.g. an object
- H04N 19/172: the region being a picture, frame or field
- H04N 19/196: being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters (processing of motion vectors H04N19/513)
- H04N 19/20: using video object coding
- H04N 19/23: with coding of regions that are present throughout a whole video segment, e.g. sprites, background or mosaic
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/507: using conditional replenishment
- H04N 19/51: Motion estimation or motion compensation
- H04N 19/517: by encoding
- H04N 19/52: by predictive encoding
- H04N 19/527: Global motion vector estimation
- H04N 19/59: involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
- H04N 19/61: in combination with predictive coding
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 19/80: Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation (H04N19/635, H04N19/86 take precedence)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An encoding system includes an encoder that encodes uncompressed video data to form compressed video data and a decoder that decodes the compressed video data to form at least an approximation of the uncompressed video data. The video data comprises a sequence of a plurality of image frames comprising key frames and nonkey frames. In encoding a nonkey frame, reference is made to segments of a reference frame. Kinetic information, such as motion vectors, relates portions of the nonkey frame to the segments of it reference frame. The information content of the nonkey frame that is not conveyed by the segmentation, the reference frame content and the kinetic information can be encoded as residue data. Each segment's residue data, or the nonkey frame's residue data, can be encoded as coefficients of basis functions known to both the encoder and the decoder.

## Claims

### Claim 1

An encoding system for encoding uncompressed video data to form compressed video data, wherein the video data comprises a sequence of a plurality of image frames comprising key frames and nonkey frames, the encoding system comprising:
an encoder comprising:
a kinetic information generator that generates kinetic information that relates regions of a nonkey frame to regions of a reference frame that is used in encoding a nonkey frame;
a residue coder that codes for differences between a frame representing differences between content of the nonkey frame and a frame resulting from an application of the kinetic information of the reference frame; and
a compressed video data outputter that outputs compressed video data including at least compressed key frames, the kinetic information and residue data; and
a decoder that regenerates the nonkey frame from the compressed video data using kinetic information about the nonkey frame from the compressed video data and residue data about the nonkey frame.

### Claim 2 (depends on 1)

The system of claim 1, wherein the residue is coded as coefficients of basis functions.

### Claim 3 (depends on 2)

The system of claim 2, wherein the residue coder alternately codes the residue using run-length encoding when the run-length encoded residue is smaller than the coefficients of basis functions encoded residue.

### Claim 4 (depends on 2)

The system of claim 2, wherein the set of basis functions is known in advance by the decoder and the encoder.

### Claim 5 (depends on 1)

The system of claim 1, wherein said regions comprise a plurality of different shapes.

### Claim 6 (depends on 1)

The system of claim 1, wherein said regions comprise a same shape.

### Claim 7 (depends on 1)

The system of claim 1, wherein said regions comprise rectangular-shaped regions.

### Claim 8

An encoder for encoding a sequence of image frames to form compressed video data, the encoder comprising:
a kinetic information generator that generates kinetic information that relates regions of a nonkey frame to regions of a reference frame that is used in encoding a nonkey frame;
a residue coder that codes for differences between a frame representing differences between content of the nonkey frame and a frame resulting from an application of the kinetic information of the reference frame; and
a compressed video data outputter that outputs compressed video data including at least compressed key frames, the kinetic information and residue data.

### Claim 9 (depends on 8)

The encoder of claim 8, wherein the residue is coded as coefficients of basis functions.

### Claim 10 (depends on 9)

The encoder of claim 9, wherein the residue coder alternately codes the residue using run-length encoding when the run-length encoded residue is smaller than the coefficients of basis functions encoded residue.

### Claim 11 (depends on 9)

The encoder of claim 9, wherein the set of basis functions is known in advance by the encoder and a decoder receiving the compressed video data from the encoder.

### Claim 12 (depends on 8)

The encoder of claim 8, wherein said regions comprise a plurality of different shapes.

### Claim 13 (depends on 8)

The encoder of claim 8, wherein said regions comprise a same shape.

### Claim 14 (depends on 8)

The encoder of claim 8, wherein said regions comprise rectangular-shaped regions.

### Claim 15

A method for encoding a sequence of image frames to form compressed video data, the methodcomprising:
generating kinetic information that relates regions of a nonkey frame to regions of a reference frame that is used in encoding a nonkey frame;
coding for differences between a frame representing differences between content of the nonkey frame and a frame resulting from an application of the kinetic information of the reference frame; and
outputting compressed video data including at least compressed key frames, the kinetic information and residue data.

### Claim 16 (depends on 15)

The method of claim 15, wherein the residue is coded as coefficients of basis functions.

### Claim 17 (depends on 16)

The method of claim 16, wherein the residue is coded using run-length encoding when the run-length encoded residue is smaller than the coefficients of basis functions encoded residue.

### Claim 18 (depends on 16)

The method of claim 16, wherein the set of basis functions is known in advance by a decoder receiving the compressed video data.
