# US 9,521,418 B2 · Slice header three-dimensional video extension for slice header prediction

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 9,521,418 B2
- Document ID: US9521418B2
- Status: Granted
- Kind: B2
- Application number: 13/553,628
- Filed: 2012-07-19
- Published: 2013-03-07
- Granted: 2016-12-13
- Earliest claimed: 2011-07-22
- Assignees: QUALCOMM Incorporated
- Applicants: Ying Chen; Ye-Kui Wang; Marta Karczewicz
- Inventors: Ying Chen; Ye-Kui Wang; Marta Karczewicz
- Web page: https://patentgrep.com/patent/US9521418B2

## CPC

- H04N 19/172: the region being a picture, frame or field
- H04N 19/174: the region being a slice, e.g. a line of blocks or a group of blocks
- H04N 19/44: Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N 19/61: in combination with predictive coding
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

In one example, a video coder is configured to code one or more blocks of video data representative of texture information of at least a portion of a frame of video data, process a texture slice for a texture view component of a current view associated, the texture slice comprising the coded one or more blocks and a texture slice header comprising a set of syntax elements representative of characteristics of the texture slice, code depth information representative of depth values for at least the portion of the frame, and process a depth slice for a depth view component corresponding to the texture view component of the view, the depth slice comprising the coded depth information and a depth slice header comprising a set of syntax elements representative of characteristics of the depth slice, wherein process the texture slice or the depth slice comprises predict at least one syntax element.

## Claims

### Claim 1

A method of coding video data, the method comprising:
coding one or more blocks of video data representative of texture information of at least a portion of a frame of the video data;
processing a texture slice for a texture view component of a current view associated with an access unit, the texture slice comprising the coded one or more blocks and a texture slice header comprising syntax elements related to reference picture list construction for the texture slice;
coding depth information representative of depth values for at least the portion of the frame; and
processing a depth slice for a depth view component corresponding to the texture view component of the view, the depth slice comprising the coded depth information and a depth slice header comprising syntax elements related to reference picture list construction for the depth slice;
wherein at least one of:
processing the texture slice comprises:
coding, in a slice header extension of the texture slice header, a syntax element indicating that a reference slice header for the texture slice is a slice header associated with another view of the same access unit as the current view;
coding, in the slice header extension of the texture slice, a reference picture prediction syntax element that indicates whether the syntax elements related to reference picture list construction for the texture slice are predicted from the reference slice header for the texture slice, wherein a first value of the reference picture prediction syntax element for the texture slice indicates that the syntax elements of the texture slice header related to reference picture list construction for the texture slice are copied from the reference slice header for the texture slice, and wherein a second value of the reference picture prediction syntax element for the texture slice indicates that the syntax elements of the texture slice header related to reference picture list construction for the texture slice are not copied from the reference slice header for the texture slice; and
predicting at least one syntax element of the syntax elements of the texture slice header related to reference picture list construction for the texture slice from the reference slice header for the texture slice, or
processing the depth slice comprises:
coding, in a slice header extension of the depth slice header, a syntax element indicating that a reference slice header for the depth slice is a slice header associated with the other view of the same access unit as the current view;
coding, in the slice header extension of the depth slice, a reference picture prediction syntax element that indicates whether the syntax elements related to reference picture list construction for the depth slice are predicted from the reference slice header for the depth slice, wherein a first value of the reference picture prediction syntax element for the depth slice indicates that the syntax elements of the depth slice header related to reference picture list construction for the depth slice are copied from the reference slice header for the depth slice, and wherein a second value of the reference picture prediction syntax element for the depth slice indicates that the syntax elements of the depth slice header related to reference picture list construction for the depth slice are not copied from the reference slice header for the depth slice; and
predicting at least one syntax element of the set of syntax elements of the depth slice header related to reference picture list construction for the depth slice from the reference slice header for the depth slice.

### Claim 2 (depends on 1)

The method of claim 1, wherein the reference slice header for the texture view or the reference slice header for the depth view comprises a slice header from one of a texture view component or a depth view component of the other view.

### Claim 3 (depends on 2)

The method of claim 2, wherein the other view comprises an Advanced Video Coding (AVC) compatible base view of the same access unit.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
arranging the set of syntax elements representative of characteristics of the texture slice and the set of syntax elements representative of characteristics of the depth slice in an order different from an AVC slice header order.

### Claim 5 (depends on 1)

The method of claim 1, wherein coding the one or more blocks of video data and the depth information comprises decoding the one or more blocks of video data and the depth information, wherein processing the texture slice comprises receiving the texture slice, wherein processing the depth slice comprises receiving the depth slice, wherein coding the syntax element indicating the reference slice header for the texture slice comprises receiving the syntax element indicating the reference slice header for the texture slice, wherein coding the reference picture prediction syntax element for the texture slice comprises decoding the reference picture prediction syntax element for the texture slice, wherein coding the reference picture prediction syntax element for the depth slice comprises decoding the reference picture prediction syntax element for the depth slice, and wherein coding the syntax element indicating the reference slice header for the depth slice comprises receiving the syntax element indicating the reference slice header for the depth slice.

### Claim 6 (depends on 1)

The method of claim 1, wherein one or both of:
the syntax element indicating the reference slice header for the texture slice comprises a delta view order, and wherein the delta view order indicates the location of the reference slice header for the texture slice relative to the current view, or
the syntax element indicating the reference slice header for the depth slice comprises a delta view order, and wherein the delta view order indicates the location of the reference slice header for the depth slice relative to the current view.

### Claim 7 (depends on 5)

The method of claim 5, comprising:
receiving, in the slice header extension of the texture slice, a syntax element indicating if the reference slice header for the texture slice corresponds to a slice header of the depth view component of the other view or a slice header of the texture view component of the other view; or
receiving, in the slice header extension of the depth slice, a syntax element indicating if the reference slice header for the depth slice corresponds to the slice header of the depth view component of the other view or the slice header of the texture view component of the other view.

### Claim 8 (depends on 7)

The method of claim 7, further comprising:
receiving a slice ID of the depth slice or the texture slice of the indicated depth or texture view component, respectively.

### Claim 9 (depends on 7)

The method of claim 7, further comprising:
receiving a slice ID for the depth slice and the texture slice, wherein the slice ID is signaled in at least one of the slice header or a network abstraction layer (NAL) unit header of a NAL unit of the view component.

### Claim 10 (depends on 7)

The method of claim 7, further comprising:
receiving a slice ID for the depth slice and the texture slice, wherein the slice ID is signaled in an access unit including a network abstraction layer (NAL) unit of the depth view component and the texture view component, respectively.

### Claim 11 (depends on 1)

The method of claim 1, wherein coding the one or more blocks of video data and the depth information comprises encoding the one or more blocks of video data and the depth information, wherein processing the texture slice comprises encoding the texture slice, wherein processing the depth slice comprises encoding the depth slice, wherein coding the syntax element indicating the reference slice header for the texture slice comprises encoding the syntax element indicating the reference slice header for the texture slice, wherein coding the reference picture prediction syntax element for the texture slice comprises encoding the reference picture prediction syntax element for the texture slice, wherein coding the reference picture prediction syntax element for the depth slice comprises encoding the reference picture prediction syntax element for the depth slice, and wherein coding the syntax element indicating the reference slice header for the depth slice comprises encoding the syntax element indicating the reference slice header for the depth slice.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
encoding, in the slice header extension of the texture slice, a syntax element indicating if the reference slice header for the texture slice corresponds to a slice header of the depth view component of the other view or a slice header of the texture view component of the other view; or
encoding, in the slice header extension of the depth slice, a syntax element indicating if the reference slice header for the depth view corresponds to the slice header of the depth view component of the other view or the slice header of the texture view component of the other view.

### Claim 13

A device for coding video data comprising:
a memory configured to store data associated with video data; and
one or more processors configured to:
code one or more blocks of video data representative of texture information of at least a portion of a frame of the video data;
process a texture slice for a texture view component of a current view associated with an access unit, the texture slice comprising the coded one or more blocks and a texture slice header comprising syntax elements related to reference picture list construction for the texture slice;
code depth information representative of depth values for at least the portion of the frame; and
process a depth slice for a depth view component corresponding to the texture view component of the view, the depth slice comprising the coded depth information and a depth slice header comprising syntax elements related to reference picture list construction for the depth slice,
wherein, to process the texture slice or the depth slice, the one or more processors are configured to:
code, in a slice header extension of the texture slice header, a syntax element indicating that a reference slice header for the texture slice is a slice header associated with another view of the same access unit as the current view;
code, in the slice header extension of the texture slice, a reference picture prediction syntax element that indicates whether the syntax elements related to reference picture list construction for the texture slice are predicted from the reference slice header for the texture slice, wherein a first value of the reference picture prediction syntax element for the texture slice indicates that the syntax elements of the texture slice header related to reference picture list construction for the texture slice are copied from the reference slice header for the texture slice, and wherein a second value of the reference picture prediction syntax element for the texture slice indicates that the syntax elements of the texture slice header related to reference picture list construction for the texture slice are not copied from the reference slice header for the texture slice; and
predict at least one syntax element of the syntax elements of the texture slice header related to reference picture list construction for the texture slice from the reference slice header for the texture slice;
or
code, in a slice header extension of the depth slice header, a syntax element indicating that a reference slice header for the depth slice is a slice header associated with the other view of the same access unit as the current view;
code, in the slice header extension of the depth slice, a reference picture prediction syntax element that indicates whether the syntax elements related to reference picture list construction for the depth slice are predicted from the reference slice header for the depth slice, wherein a first value of the reference picture prediction syntax element for the depth slice indicates that the syntax elements of the depth slice header related to reference picture list construction for the depth slice are copied from the reference slice header for the depth slice, and wherein a second value of the reference picture prediction syntax element for the depth slice indicates that the syntax elements of the depth slice header related to reference picture list construction for the depth slice are not copied from the reference slice header for the depth slice; and
predict at least one syntax element of the set of syntax elements of the depth slice header related to reference picture list construction for the depth slice from the reference slice header for the depth slice.

### Claim 14 (depends on 13)

The device of claim 13, wherein the reference slice header for the texture view or the reference slice header for the depth view comprises a slice header from one of a texture view component of the other view or a depth view component from the other view.

### Claim 15 (depends on 13)

The device of claim 13, wherein the other view comprises an Advanced Video Coding (AVC) compatible base view of the same access unit.

### Claim 16 (depends on 13)

The device of claim 13, wherein the one or more processors are further configured to arrange the set of syntax elements representative of characteristics of the texture slice and the set of syntax elements representative of characteristics of the depth slice in an order different from an AVC slice header order.

### Claim 17 (depends on 13)

The device of claim 13, wherein the device for coding video data is a device for decoding video data, and wherein the one or more processors are configured to:
decode the one or more blocks of video data and the depth information,
receive the texture slice,
receive the depth slice,
receive the syntax element indicating the reference slice header for the texture slice,
receive the reference picture prediction syntax element for the texture slice,
receive the reference picture prediction syntax element for the depth slice, and
receive the syntax element indicating the reference slice header for the depth slice.

### Claim 18 (depends on 13)

The device of claim 13, wherein one or both of:
the syntax element indicating the reference slice header for the texture slice comprises a delta view order, and wherein the delta view order indicates the location of the reference slice header for the texture slice relative to the current view, or
the syntax element indicating the reference slice header for the depth slice comprises a delta view order, and wherein the delta view order indicates the location of the reference slice header for the depth slice relative to the current view.

### Claim 19 (depends on 17)

The device of claim 17, wherein the one or more processors are configured to:
receive, in the slice header extension of the texture slice, a syntax element indicating if the reference slice header for the texture slice corresponds to a slice header of the depth view component of the other view or the texture view component of the other view; or
receive, in the slice header extension of the depth slice, a syntax element indicating if the reference slice header for the depth slice corresponds to the slice header of the depth view component of the other view or the slice header of the texture view component of the other view.

### Claim 20 (depends on 17)

The device of claim 17, wherein the one or more processors are further configured to receive a slice ID of the depth slice or the texture slice of the indicated depth or texture view component, respectively.

### Claim 21 (depends on 17)

The device of claim 17, wherein the one or more processors are further configured to receive a slice ID for the depth slice and the texture slice, wherein the slice ID is received in at least one of the slice header or a network abstraction layer (NAL) unit header of a NAL unit of the view component.

### Claim 22 (depends on 17)

The device of claim 17, wherein the one or more processors are further configured to receive a slice ID for the depth slice and the texture slice, wherein the slice ID is signaled in an access unit including a network abstraction layer (NAL) unit of the depth view component and the texture view component, respectively.

### Claim 23 (depends on 13)

The device of claim 13, wherein the device for coding video data is a device for encoding video data, and wherein the one or more processors are configured to: encode the one or more blocks of video data and the depth information,
encode the texture slice,
encode the depth slice,
encode the syntax element indicating the reference slice header for the texture slice,
receive the reference picture prediction syntax element for the texture slice,
receive the reference picture prediction syntax element for the depth slice, and
encode the syntax element indicating the reference slice header for the depth slice.

### Claim 24 (depends on 23)

The device of claim 23, wherein the one or more processors are further configured to:
encode, in the slice header extension of the texture slice, a syntax element indicating if the reference slice header for the texture slice corresponds to a slice header of the depth view component of the other view or a slice header of the texture view component of the other view; or
encode, in the slice header extension of the depth slice, a syntax element indicating if the reference slice header for the depth view corresponds to the slice header of the depth view component of the other view or the slice header of the texture view component of the other view.

### Claim 25

A non-transitory computer-readable storage medium having stored thereon instructions that, when executed, cause one or more processors of a video coding device to:
code one or more blocks of video data representative of texture information of at least a portion of a frame of the video data;
process a texture slice for a texture view component of a current view associated with an access unit, the texture slice comprising the coded one or more blocks and a texture slice header comprising syntax elements related to reference picture list construction for the texture slice;
code depth information representative of depth values for at least the portion of the frame; and
process a depth slice for a depth view component corresponding to the texture view component of the view, the depth slice comprising the coded depth information and a depth slice header comprising syntax elements related to reference picture list construction for the depth slice;
wherein the instructions that cause the one or more processors to process the texture slice or the depth slice comprises comprise instructions that cause the one or more processors to:
code, in a slice header extension of the texture slice header, a syntax element indicating that a reference slice header for the texture slice is a slice header associated with another view of the same access unit as the current view;
code, in the slice header extension of the texture slice, a reference picture prediction syntax element that indicates whether the syntax elements related to reference picture list construction for the texture slice are predicted from the reference slice header for the texture slice, wherein a first value of the reference picture prediction syntax element for the texture slice indicates that the syntax elements of the texture slice header related to reference picture list construction for the texture slice are copied from the reference slice header for the texture slice, and wherein a second value of the reference picture prediction syntax element for the texture slice indicates that the syntax elements of the texture slice header related to reference picture list construction for the texture slice are not copied from the reference slice header for the texture slice; and
predict at least one syntax element of the set of syntax elements of the texture slice header related to reference picture list construction for the texture slice from the reference slice header for the texture slice;
or
code, in a slice header extension of the depth slice header, a syntax element indicating that a reference slice header for the depth slice is a slice header associated with the other view of the same access unit as the current view;
code, in the slice header extension of the depth slice, a reference picture prediction syntax element that indicates whether the syntax elements related to reference picture list construction for the depth slice are predicted from the reference slice header for the depth slice, wherein a first value of the reference picture prediction syntax element for the texture slice indicates that the syntax elements of the depth slice header related to reference picture list construction for the depth slice are copied from the reference slice header for the depth slice, and wherein a second value of the reference picture prediction syntax element for the texture slice indicates that the syntax elements of the depth slice header related to reference picture list construction for the depth slice are not copied from the reference slice header for the depth slice; and
predict at least one syntax element of the set of syntax elements of the depth slice header related to reference picture list construction for the depth slice from reference slice header for the depth slice, respectively, wherein the reference slice header is from a view component of the same access unit.

### Claim 26 (depends on 25)

The non-transitory computer-readable storage medium of claim 25, wherein the reference slice header for the texture view or the reference slice header for the depth view comprises a slice header from one of a texture view component of the other view or a depth view component from the other view.

### Claim 27 (depends on 25)

The non-transitory computer-readable storage medium of claim 25, wherein the other view comprises an Advanced Video Coding (AVC) compatible base view of the same access unit.

### Claim 28 (depends on 25)

The non-transitory computer-readable storage medium of claim 25, wherein the instructions cause the one or more processors to:
decode the one or more blocks of video data and the depth information,
receive the texture slice,
receive the depth slice,
receive the syntax element indicating the reference slice header for the texture slice,
receive the reference picture prediction syntax element for the texture slice,
receive the reference picture prediction syntax element for the depth slice, and
receive the syntax element indicating the reference slice header for the depth slice.

### Claim 29 (depends on 28)

The non-transitory computer-readable storage medium of claim 28, wherein one or both of:
the syntax element indicating the reference slice header for the texture slice comprises a delta view order, and wherein the delta view order indicates the location of the reference slice header for the texture view relative to the current view, or
the syntax element indicating the reference slice header for the depth slice comprises a delta view order, and wherein the delta view order indicates the location of the reference slice header for the depth slice relative to the current view.

### Claim 30 (depends on 28)

The non-transitory computer-readable storage medium of claim 28, wherein the instructions further cause the one or more processors of the video coding device to:
receive, in the slice header extension of the texture slice, a syntax element indicating if the reference slice header for the texture slice corresponds to a slice header of the depth view component of the other view or a slice header of the texture view component of the other view; or
receive, in the slice header extension of the depth slice, a syntax element indicating if the reference slice header for the depth slice corresponds to the slice header of the depth view component of the other view or the slice header of the texture view component of the other view.

### Claim 31 (depends on 28)

The non-transitory computer-readable storage medium of claim 28, wherein the instructions further cause the one or more processors of the video coding device to:
receive a slice ID of the depth slice or the texture slice of the indicated depth or texture view component, respectively.

### Claim 32 (depends on 28)

The non-transitory computer-readable storage medium of claim 28, wherein the instructions further cause the one or more processors of the video coding device to:
receive a slice ID for the depth slice and the texture slice, wherein the slice ID is received in at least one of the slice header or a network abstraction layer (NAL) unit header of a NAL unit of the view component.

### Claim 33 (depends on 28)

The non-transitory computer-readable storage medium of claim 28, wherein the instructions further cause the one or more processors of the video coding device to:
receive a slice ID for the depth slice and the texture slice, wherein the slice ID is received in an access unit including a network abstraction layer (NAL) unit of the depth view component and the texture view component, respectively.

### Claim 34 (depends on 25)

The non-transitory computer-readable storage medium of claim 25, wherein the instructions cause the one or more processors to:
encode the one or more blocks of video data and the depth information,
encode the texture slice,
encode the depth slice,
encode the syntax element indicating the reference slice header for the texture slice,
encode the reference picture prediction syntax element for the texture slice,
encode the reference picture prediction syntax element for the texture slice, and
encode the syntax element indicating the reference slice header for the depth slice.

### Claim 35

A device for processing video data, comprising:
means for coding one or more blocks of video data representative of texture information of at least a portion of a frame of the video data;
means for processing a texture slice for a texture view component of a current view associated with an access unit, the texture slice comprising the coded one or more blocks and a texture slice header comprising syntax elements related to reference picture list construction for the texture slice;
means for coding depth information representative of depth values for at least the portion of the frame; and
means for processing a depth slice for a depth view component corresponding to the texture view component of the view, the depth slice comprising the coded depth information and a depth slice header comprising syntax elements related to reference picture list construction for the depth slice;
wherein means for processing the texture slice or the depth slice comprise:
means for coding, in a slice header extension of the texture slice header, a syntax element indicating that a reference slice header for the texture slice is a slice header associated with another view of the same access unit as the current view;
means for coding, in the slice header extension of the texture slice, a reference picture prediction syntax element that indicates whether the syntax elements related to reference picture list construction for the texture slice are predicted from the reference slice header for the texture slice, wherein a first value of the reference picture prediction syntax element for the texture slice indicates that the syntax elements of the texture slice header related to reference picture list construction for the texture slice are copied from the reference slice header for the texture slice, and wherein a second value of the reference picture prediction syntax element for the texture slice indicates that the syntax elements of the texture slice header related to reference picture list construction for the texture slice are not copied from the reference slice header for the texture slice; and
means for predicting at least one syntax element of the set of syntax elements of the texture slice header related to reference picture list construction for the texture slice from the reference slice header for the texture slice;
or
means for coding, in a slice header extension of the depth slice header, a syntax element indicating that a reference slice header for the depth slice is a slice header associated with the other view of the same access unit as the current view, wherein a first value of the reference picture prediction syntax element for the depth slice indicates that the syntax elements of the depth slice header related to reference picture list construction for the depth slice are copied from the reference slice header for the depth slice, and wherein a second value of the reference picture prediction syntax element for the depth slice indicates that the syntax elements of the depth slice header related to reference picture list construction for the depth slice are not copied from the reference slice header for the depth slice; and
means for predicting at least one syntax element of the set of syntax elements related to reference picture list construction for the depth slice from a reference slice header, respectively, wherein the reference slice header is from a view component of the same access unit.

### Claim 36 (depends on 35)

The device of claim 35, wherein the reference slice header for the texture view or the reference slice header for the depth view comprises a slice header from one of a texture view component of the other view or a depth view component from the other view.

### Claim 37 (depends on 35)

The device of claim 35, wherein the other view comprises an Advanced Video Coding (AVC) compatible base view of the same access unit.

### Claim 38 (depends on 35)

The device of claim 35, wherein the device is a video decoder.

### Claim 39 (depends on 38)

The device of claim 38, wherein one or both of
the slice element indicating the reference slice header for the texture slice comprises a delta view order, and wherein the delta view order indicates the location of the reference slice header relative to the current view, or
the syntax element indicating the reference slice header for the depth slice comprises a delta view order, and wherein the delta view order indicates the location of the reference slice header for the depth slice relative to the current view.

### Claim 40 (depends on 38)

The device of claim 38, wherein the video decoder further comprises:
means for receiving, in the slice header extension of the texture slice, a syntax element indicating if the reference slice header for the texture slice corresponds to a slice header of the depth view component of the other view or a slice header of the texture view component of the other view; or
receiving, in the slice header extension of the depth slice, a syntax element indicating if the reference slice header for the depth slice corresponds to the slice header of the depth view component of the other view or the slice header of the texture view component of the other view.

### Claim 41 (depends on 38)

The device of claim 38, wherein the video decoder further comprises:
means for receiving a slice ID of the depth slice or the texture slice of the indicated depth or texture view component, respectively.

### Claim 42 (depends on 38)

The device of claim 38, wherein the video decoder further comprises:
means for receiving a slice ID for the depth slice and the texture slice, wherein the slice ID is received in at least one of the slice header or a network abstraction layer (NAL) unit header of a NAL unit of the view component.

### Claim 43 (depends on 38)

The device of claim 38, wherein the video decoder further comprises:
means for receiving a slice ID for the depth slice and the texture slice, wherein the slice ID is received in an access unit including a network abstraction layer (NAL) unit of the depth view component and the texture view component, respectively.

### Claim 44 (depends on 35)

The device of claim 35, wherein the device is a video encoder.