# US 2002/0118742 A1 · Prediction structures for enhancement layer in fine granular scalability video coding

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2002/0118742 A1
- Document ID: US20020118742A1
- Status: Published application
- Kind: A1
- Application number: 09/793,035
- Filed: 2001-02-26
- Published: 2002-08-29
- Earliest claimed: 2001-02-26
- Assignees: Philips Electronics North America Corporation
- Inventors: Atul Puri; Yingwei Chen; Hayder Radha
- Web page: https://patentgrep.com/patent/US20020118742A1

## CPC

- H04N 19/34: Scalability techniques involving progressive bit-plane based encoding of the enhancement layer, e.g. fine granular scalability [FGS]
- H04N 19/61: in combination with predictive coding
- H04N 19/63: using sub-band based transform, e.g. wavelets
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The present invention is directed to a technique for flexibly and efficiently coding of video data. The technique involves coding of a portion of the video data called base layer frames and coding of residual images generated from the video data and the prediction signal. The prediction for each video frame is generated using multiple decoded base layer frames and may use motion compensation. The residual images are called enhancement layer frames and are then coded. Based on this technique, since a wider locality of base layer frames are utilized, better prediction can be obtained. Since the resulting residual data in enhancement layer frames is small, they can be efficiently coded. For coding of enhancement layer frames, fine granular scalability techniques (such as DCT transform coding or wavelet coding) are employed. The decoding process is reverse of encoding process. Therefore, flexible, yet efficient coding and decoding of video is accomplished.

## Claims

### Claim 1

A method for coding video data, comprising the steps of:
coding a portion of the video data to produce base layer frames;
generating residual images from the video data and the base layer frames utilizing multiple base layer frames for each of the residual images; and
coding the residual images with a fine granular scalability technique to produce enhancement layer frames.

### Claim 2 (depends on 1)

The method of claim 1, wherein the multiple base layer frames include a temporally located base layer frame and at least one adjacent base layer frame.

### Claim 3 (depends on 1)

The method of claim 1, wherein each of the residual images is generated by subtracting a prediction signal from the video data, where the prediction signal is formed by the multiple base layer frames.

### Claim 4 (depends on 3)

The method of claim 3, wherein the prediction signal is produced by the following steps:
performing motion estimation on each of the base layer frames;
weighting each of the base layer frames; and
summing the multiple base layer frames.

### Claim 5

A method of decoding a video signal including a base layer and an enhancement layer, comprising the steps of:
decoding the base layer to produce base layer video frames;
decoding the enhancement layer with a fine granular scalability technique to produce enhancement layer video frames; and
combining each of the enhancement layer video frames with multiple base layer video frames to produce output video.

### Claim 6 (depends on 5)

The method of claim 5, wherein the multiple base layer video frames include a temporally located base layer video frame and at least one adjacent base layer video frame.

### Claim 7 (depends on 5)

The method of claim 5, wherein the combining step is performed by adding each of the enhancement layer video frames to a prediction signal, where the prediction signal is formed by the multiple base layer video frames.

### Claim 8 (depends on 7)

The method of claim 7, wherein the prediction signal is produced by the following steps:
performing motion compensation on each of the base layer video frames;
weighting each of the base layer video frames; and
summing the multiple base layer video frames.

### Claim 9

An apparatus for coding video data, comprising:
a first encoder for coding a portion of the video data to produce base layer frames;
an enhancement prediction and residual calculation block for generating residual images from the video data and the base layer frames utilizing multiple base layer frames for each of the residual images; and
a second encoder for coding the residual images with a fine granular scalability technique to produce enhancement layer frames.

### Claim 10

An apparatus for decoding a video signal including a base layer and an enhancement layer, comprising the steps of:
a first decoder for decoding the base layer to produce base layer video frames;
a second decoder for decoding the enhancement layer with a fine granular scalability technique to produce enhancement layer video frames; and
an enhancement prediction and residual combination block for combining each of the enhancement layer video frames with multiple base layer video frames to produce output video.

### Claim 11

A memory medium including code for encoding video data, the code comprising:
a code to encode a portion of the video data to produce base layer frames;
a code to generate residual images from the video data and the base layer frames utilizing multiple base layer frames for each of the residual images; and
a code to encode the residual images with a fine granular scalability technique to produce enhancement layer frames.

### Claim 12

A memory medium including code for decoding a video signal including a base layer and an enhancement layer, the code comprising:
a code to decode the base layer to produce base layer video frames;
a code to decode the enhancement layer with a fine granular scalability technique to produce enhancement layer video frames; and
a code to combine each of the enhancement layer video frames with multiple base layer video frames to produce output video.
