# US 2010/0166074 A1 · Method and apparatus for encoding or decoding frames of different views in multiview video using global disparity

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0166074 A1
- Document ID: US20100166074A1
- Status: Published application
- Kind: A1
- Application number: 12/377,985
- Filed: 2007-08-17
- Published: 2010-07-01
- Earliest claimed: 2006-08-18
- Assignees: Gwangju Institute of Science and Technology; Kt Corporation
- Inventors: Yo Sung Ho; Kwan Jung Oh
- Web page: https://patentgrep.com/patent/US20100166074A1

## CPC

- H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
- H04N 13/194: Transmission of image signals
- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The present invention relates to a method and apparatus for encoding a multi-view video and a method and apparatus for decoding a multi-view video, and more particularly, to a method and apparatus for encoding a multi-view video and a method and apparatus for decoding a multi-view video that can perform encoding and decoding in consideration of global disparity between pictures captured at two different viewpoints to remove spatial redundancy. An embodiment of the invention provides an encoder for compressing data for pictures captured at different viewpoints using global disparity in a multi-view video. The encoder includes: an input unit that receives pictures captured at two or more viewpoints; a reference picture generating unit that generates a new reference picture on the basis of the global disparity between a target picture and a reference picture; and a motion predicting unit that calculates motion vectors of the target picture on the basis of the reference picture.

## Claims

### Claim 1

An encoder for compressing data for pictures captured at different viewpoints using global disparity in a multi-view video, comprising:
an input unit that receives pictures captured at two or more viewpoints;
a reference picture generating unit that generates a new reference picture on the basis of the global disparity between a target picture and a reference picture; and
a motion predicting unit that calculates motion vectors of the target picture on the basis of the reference picture.

### Claim 2 (depends on 1)

The encoder of claim 1, wherein the reference picture generating unit includes:
a global disparity calculating unit that calculates the global disparity between the target picture and the reference picture;
a reference picture moving unit that increases the number of pixels of the reference picture in the horizontal and vertical directions by global disparity values or more in the horizontal and vertical directions that are obtained by the global disparity calculating unit, and moves the reference picture by the global disparity values; and
a padding processing unit that pads vacant pixels that are generated due to the movement of the reference picture and an increase in the number of pixels by the reference picture moving unit with the values of adjacent pixels.

### Claim 3 (depends on 2)

The encoder of claim 2, wherein the global disparity calculating unit of the reference picture generating unit receives a second reference picture and calculates global disparity between the second reference picture and the target picture, the reference picture moving unit of the reference picture generating unit increases the number of pixels of the second reference picture in the horizontal and vertical directions by global disparity values or more in the horizontal and vertical directions that are obtained by the global disparity calculating unit, and moves the second reference picture by the global disparity values, and the reference picture generating unit further includes an edge copy processing unit that copies the second reference picture or the reference picture, and pads vacant pixels of the reference picture or the second reference picture that are generated due to the movement of the second reference picture and an increase in the number of pixels by the reference picture moving unit with the copied picture.

### Claim 4 (depends on 3)

The encoder of claim 3, wherein the reference picture generating unit further includes:
an up-sampling unit that performs up-sampling on two pictures in order to accurately calculate global disparity between the two pictures; and
a filter that smoothes the reference picture or the second reference picture that is processed by the reference picture moving unit, the edge copy processing unit, and the edge padding processing unit.

### Claim 5 (depends on 2)

The encoder of claim 2, further comprising:
an image capture buffering unit that captures an input picture and stores the captured picture;
a frame rearranging unit that receives the multi-view pictures from the image capture buffering unit and rearranges the received pictures;
a subtracter that calculates the difference between the multi-view picture output from the frame rearranging unit and the reference picture;
a DCT unit that performs discrete cosine transform on a matrix of the difference between the pictures that is obtained by the subtracter to obtain a DCT coefficient;
a quantizing unit that quantizes the DCT coefficient; and
an entropy encoding unit that encodes the quantized DCT coefficient.

### Claim 6

An encoder for compressing data for pictures captured at different viewpoints using global disparity in a multi-view video, comprising:
a global disparity calculating unit that calculates global disparity between a target picture and a reference picture; and
a motion predicting unit that, in order to calculate a motion vector for a block of the target picture with respect to the reference picture, starts searching the block on the reference picture from a position that is moved from the position of the block of the target picture by the global disparity.

### Claim 7 (depends on 6)

The encoder of claim 6, further comprising:
an image capture buffering unit that captures an input multi-view picture and stores the captured picture;
a frame rearranging unit that receives the multi-view pictures from the image capture buffering unit and rearranges the received pictures;
a subtracter that calculates the difference between the multi-view picture output from the frame rearranging unit and the reference picture;
a DCT unit that performs discrete cosine transform on a matrix of the difference between the pictures that is obtained by the subtracter to obtain a DCT coefficient;
a quantizing unit that quantizes the DCT coefficient; and
an entropy encoding unit that encodes the quantized DCT coefficient.

### Claim 8

A method of encoding pictures captured at different viewpoints using global disparity in a multi-view video, the method comprising the steps of:
capturing the pictures of the multi-view video and storing the captured pictures;
rearranging the pictures of the multi-view video in a predetermined order;
moving an encoded reference picture to generate a new reference picture; and
calculating a motion vector of a target picture on the basis of the new reference picture.

### Claim 9 (depends on 8)

The encoding method of claim 8, wherein the step of generating the new reference picture includes the steps of:
calculating global disparity between the target picture and the reference picture;
increasing the number of pixels of the reference picture in the horizontal and vertical directions by global disparity values or more in the horizontal and vertical directions, and moving the reference picture by the global disparity values to generate a new reference picture; and
padding vacant pixels of the new reference picture with the values of adjacent pixels.

### Claim 10 (depends on 9)

The encoding method of claim 9, further comprising the steps of:
capturing pictures of a multi-view video and storing the captured pictures;
rearranging the stored pictures in a predetermined order;
calculating the difference between the rearranged picture and the reference picture;
performing discrete cosine transform on a matrix of the difference between the pictures to obtain a DCT coefficient;
quantizing the DCT coefficient; and
performing entropy encoding on the quantized DCT coefficient.

### Claim 11 (depends on 10)

The encoding method of claim 10, wherein, in the step of performing the entropy encoding, the motion vector and information on the global disparity between the reference picture and the target picture are encoded.

### Claim 12 (depends on 11)

The encoding method of claim 11, wherein, in the step of rearranging the pictures, all of the multi-view pictures captured at a starting time are arranged in a line, the pictures captured at each viewpoint are arranged in a line at predetermined time intervals after the starting time, and these processes are repeatedly performed to arrange the pictures that are captured at all of the viewpoints during all of the times.

### Claim 13

(canceled)

### Claim 14

(canceled)

### Claim 15

(canceled)

### Claim 16

(canceled)

### Claim 17

(canceled)

### Claim 18

(canceled)

### Claim 19

(canceled)

### Claim 20

(canceled)

### Claim 21

(canceled)

### Claim 22

(canceled)

### Claim 23

(canceled)
