# US 2014/0153645 A1 · 3d video coding including depth based disparity vector calibration

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0153645 A1
- Document ID: US20140153645A1
- Status: Published application
- Kind: A1
- Application number: 13/977,331
- Filed: 2012-04-19
- Published: 2014-06-05
- Earliest claimed: 2012-04-19
- Assignees: Intel Corporation
- Inventors: Wenhao Zhang; Yi-Jen Chin; Lidong Xo; Yu Han; Zhipin Deng
- Web page: https://patentgrep.com/patent/US20140153645A1

## CPC

- H04N 13/161: Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597)
- H04N 19/513: Processing of motion vectors
- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Systems, apparatus, articles, and methods are described including operations for 3D video coding including depth based disparity vector calibration.

## Claims

### Claim at position 1

1-28. (canceled)

### Claim 29

A computer-implemented method for video coding, comprising:
calibrating two or more disparity vectors associated with a prediction unit based at least in part on a depth map, wherein the prediction unit corresponds to a portion of a video picture that is associated with the depth map;
performing disparity compensated inter-picture prediction on the prediction unit based at least in part on the calibrated disparity vectors; and
coding the prediction unit based at least in part on the disparity compensated inter-picture prediction.

### Claim 30 (depends on 29)

The method of claim 29, wherein the coding of the prediction unit comprises 3D decoding.

### Claim 31 (depends on 29)

The method of claim 29, further comprising decoding a dependent view video picture based at least in part on the coded prediction unit.

### Claim 32 (depends on 29)

The method of claim 29, further comprising partitioning the prediction unit into two or more sub-blocks prior to the calibration of the two or more disparity vectors.

### Claim 33 (depends on 29)

The method of claim 29, further comprising partitioning the prediction unit into two or more sub-blocks prior to the calibration of the two or more disparity vectors, wherein the partitioning of the prediction unit into two or more sub-blocks is parameterized so that the finest partition available is equal to a per pixel level partition.

### Claim 34 (depends on 29)

The method of claim 29, further comprising:
differentiating between a first type of prediction unit and a second type of prediction unit different from the first type, wherein the first and second type of prediction units differ base on one or more of the following criteria: a slice-level criterion, a picture level criterion, and a view level criterion; and
selectively partitioning the prediction unit with a first parameter value for the first type of prediction unit and partitioning the prediction unit with a second parameter value different from the first parameter value for the second type of prediction unit.

### Claim 35 (depends on 29)

The method of claim 29, further comprising:
differentiating between a first type of prediction unit and a second type of prediction unit different from the first type based at least in part on a size of the prediction unit; and
selectively partitioning the prediction unit with a first parameter value for the first type of prediction unit and partitioning the prediction unit with a second parameter value different from the first parameter value for the second type of prediction unit.

### Claim 36 (depends on 29)

The method of claim 29, further comprising partitioning the prediction unit into two or more sub-blocks prior to the calibration of the two or more disparity vectors, wherein the calibration of the two or more disparity vectors comprises calibrating individual vectors of the two or more disparity vectors for individual sub-blocks of the two or more sub-blocks based at least in part on a characteristic depth value selected from the following characteristic depth values: an average depth value associated with the individual sub-block, a depth value corresponding to a center pixel associated with the individual sub-block, and a median depth value corresponding to the individual sub-block.

### Claim 37 (depends on 29)

The method of claim 29, further comprising partitioning the prediction unit into two or more sub-blocks prior to the calibration of the two or more disparity vectors, wherein the calibration of the two or more disparity vectors comprises:
calibrating, via a decoder, individual vectors of the two or more disparity vectors for individual sub-blocks of the two or more sub-blocks based at least in part on a fixed depth model, a scaling factor, and an offset factor.

### Claim 38 (depends on 29)

The method of claim 29, further comprising partitioning the prediction unit into two or more sub-blocks prior to the calibration of the two or more disparity vectors, wherein the calibration of the two or more disparity vectors comprises:
determining, via a decoder, a scaling factor for individual sub-blocks of the two or more sub-blocks based at least in part on a characteristic depth value associated with the individual sub-block;
determining, via the decoder, an offset factor for individual sub-blocks of the two or more sub-blocks based at least in part on a characteristic depth value associated with the individual sub-block; and
calibrating, via the decoder, individual vectors of the two or more disparity vectors for individual sub-blocks of the two or more sub-blocks based at least in part on the scaling factor and the offset factor.

### Claim 39 (depends on 29)

The method of claim 29, further comprising partitioning the prediction unit into two or more sub-blocks prior to the calibration of the two or more disparity vectors, wherein the calibration of the two or more disparity vectors comprises:
receiving, via a decoder, a scaling factor for individual sub-blocks of the two or more sub-blocks from an encoder, the scaling factor having been previously determined by the encoder based at least in part on a characteristic depth value associated with the individual sub-block;
receiving, via the decoder, an offset factor for individual sub-blocks of the two or more sub-blocks from the encoder, the scaling factor having been previously determined by the encoder based at least in part on a characteristic depth value associated with the individual sub-block; and
calibrating, via the decoder, individual vectors of the two or more disparity vectors for individual sub-blocks of the two or more sub-blocks based at least in part on the scaling factor and the offset factor.

### Claim 40 (depends on 29)

The method of claim 29, further comprising partitioning the prediction unit into two or more sub-blocks prior to the calibration of the two or more disparity vectors, wherein the calibration of the two or more disparity vectors comprises:
calibrating, via the decoder, individual vectors of the two or more disparity vectors for individual sub-blocks of the two or more sub-blocks based at least in part on a scaling factor and an offset factor,
wherein the scaling factor and the offset factor are determined based at least in part on imaging device parameters.

### Claim 41 (depends on 29)

The method of claim 29, wherein the calibration of the two or more disparity vectors comprises selectively calibrating the two or more disparity vectors associated with a primary type of prediction unit and calibrating only a single disparity vector associated with a secondary type of prediction unit different from the primary type, wherein the primary and secondary types of prediction units differ base on one or more of the following criteria: a slice-level criterion, a picture level criterion, and a view level criterion.

### Claim 42 (depends on 29)

The method of claim 29, further comprising:
differentiating between a primary type of prediction unit and a secondary type of prediction unit different from the primary type based at least in part on a flag associated with the prediction unit,
wherein the calibration of the two or more disparity vectors comprises selectively calibrating the two or more disparity vectors associated with the primary type of prediction unit and calibrating only a single disparity vector associated with the secondary type of prediction unit different from the first type.

### Claim 43

A system for video coding on a computer, comprising:
a display device configured to present video data;
one or more processors communicatively coupled to the display device;
one or more memory stores communicatively coupled to the one or more processors;
a calibration logic module communicatively coupled to the one or more processors and configured to calibrate two or more disparity vectors associated with a prediction unit based at least in part on a depth map, wherein the prediction unit corresponds to a portion of a video picture that is associated with the depth map;
a disparity compensation logic module communicatively coupled to the calibration logic module and configured to perform disparity compensated inter-picture prediction on the prediction unit based at least in part on the calibrated disparity vectors; and
a coder communicatively coupled to the disparity compensation logic module and configured to code the prediction unit based at least in part on the disparity compensated inter-picture prediction for presentation on display device.

### Claim 44 (depends on 43)

The system of claim 43, the coder is further configured to decode a dependent view video picture based at least in part on the coded prediction unit.

### Claim 45 (depends on 43)

The system of claim 43, wherein the calibration logic module is further configured to partition the prediction unit into two or more sub-blocks prior to the calibration of the two or more disparity vectors, wherein the partitioning of the prediction unit into two or more sub-blocks is parameterized so that the finest partition available is equal to a per pixel level partition, wherein the calibration of the two or more disparity vectors comprises calibrating individual vectors of the two or more disparity vectors for individual sub-blocks of the two or more sub-blocks based at least in part on a characteristic depth value selected from the following characteristic depth values: an average depth value associated with the individual sub-block, a depth value corresponding to a center pixel associated with the individual sub-block, and a median depth value corresponding to the individual sub-block.

### Claim 46 (depends on 43)

The system of claim 43, wherein the calibration logic module is further configured to:
differentiate between a first type of prediction unit and a second type of prediction unit different from the first type, wherein the first and second type of prediction units differ base on one or more of the following criteria: a slice-level criterion, a picture level criterion, and a view level criterion; and
selectively partition the prediction unit with a first parameter value for the first type of prediction unit and partitioning the prediction unit with a second parameter value different from the first parameter value for the second type of prediction unit.

### Claim 47 (depends on 43)

The system of claim 43, wherein the calibration logic module is further configured to:
differentiate between a first type of prediction unit and a second type of prediction unit different from the first type based at least in part on a size of the prediction unit; and
selectively partition the prediction unit with a first parameter value for the first type of prediction unit and partitioning the prediction unit with a second parameter value different from the first parameter value for the second type of prediction unit.

### Claim 48 (depends on 43)

The system of claim 43, wherein the calibration logic module is further configured to partition the prediction unit into two or more sub-blocks prior to the calibration of the two or more disparity vectors, wherein the calibration of the two or more disparity vectors comprises:
calibrating, via the coder, individual vectors of the two or more disparity vectors for individual sub-blocks of the two or more sub-blocks based at least in part on a fixed depth model, a scaling factor, and an offset factor.

### Claim 49 (depends on 43)

The system of claim 43, wherein the calibration logic module is further configured to partition the prediction unit into two or more sub-blocks prior to the calibration of the two or more disparity vectors, wherein the calibration of the two or more disparity vectors comprises:
determining, via the coder, a scaling factor for individual sub-blocks of the two or more sub-blocks based at least in part on a characteristic depth value associated with the individual sub-block;
determining, via the coder, an offset factor for individual sub-blocks of the two or more sub-blocks based at least in part on a characteristic depth value associated with the individual sub-block; and
calibrating, via the coder, individual vectors of the two or more disparity vectors for individual sub-blocks of the two or more sub-blocks based at least in part on the scaling factor and the offset factor.

### Claim 50 (depends on 43)

The system of claim 43, wherein the calibration logic module is further configured to partition the prediction unit into two or more sub-blocks prior to the calibration of the two or more disparity vectors, wherein the calibration of the two or more disparity vectors comprises:
receiving, via the coder, a scaling factor for individual sub-blocks of the two or more sub-blocks from an encoder, the scaling factor having been previously determined by the encoder based at least in part on a characteristic depth value associated with the individual sub-block;
receiving, via the coder, an offset factor for individual sub-blocks of the two or more sub-blocks from the encoder, the scaling factor having been previously determined by the encoder based at least in part on a characteristic depth value associated with the individual sub-block; and
calibrating, via the coder, individual vectors of the two or more disparity vectors for individual sub-blocks of the two or more sub-blocks based at least in part on the scaling factor and the offset factor.

### Claim 51 (depends on 43)

The system of claim 43, wherein the calibration logic module is further configured to partition the prediction unit into two or more sub-blocks prior to the calibration of the two or more disparity vectors, wherein the calibration of the two or more disparity vectors comprises:
calibrating, via the coder, individual vectors of the two or more disparity vectors for individual sub-blocks of the two or more sub-blocks based at least in part on a scaling factor and an offset factor,
wherein the scaling factor and the offset factor are determined based at least in part on imaging device parameters.

### Claim 52 (depends on 43)

The system of claim 43, wherein the calibration of the two or more disparity vectors comprises selectively calibrating the two or more disparity vectors associated with a primary type of prediction unit and calibrating only a single disparity vector associated with a secondary type of prediction unit different from the primary type, wherein the primary and secondary types of prediction units differ base on one or more of the following criteria: a slice-level criterion, a picture level criterion, and a view level criterion.

### Claim 53 (depends on 43)

The system of claim 43, wherein the calibration logic module is further configured to:
differentiate between a primary type of prediction unit and a secondary type of prediction unit different from the primary type based at least in part on a flag associated with the prediction unit,
wherein the calibration of the two or more disparity vectors comprises selectively calibrating the two or more disparity vectors associated with the primary type of prediction unit and calibrating only a single disparity vector associated with the secondary type of prediction unit different from the first type.
