# US 2014/0192152 A1 · Indication of current view dependency on reference view in multiview coding file format

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0192152 A1
- Document ID: US20140192152A1
- Status: Published application
- Kind: A1
- Application number: 14/137,213
- Filed: 2013-12-20
- Published: 2014-07-10
- Earliest claimed: 2013-01-04
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Ye-Kui Wang; Ying Chen
- Web page: https://patentgrep.com/patent/US20140192152A1

## CPC

- H04N 13/161: Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597)
- H04N 5/76: Television signal recording
- H04N 5/919: by dividing samples or signal segments, e.g. television lines, among a plurality of recording channels
- H04N 9/8042: {involving data reduction}
- H04N 9/8205: {involving the multiplexing of an additional signal and the colour video signal}
- H04N 19/44: Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 5/765: Interface circuits between an apparatus for recording and another apparatus
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Techniques for encapsulating video streams containing multiple coded views in a media file are described herein. In one example, a method includes parsing a track of video data, wherein the track includes one or more views. The method further includes parsing information to determine whether a texture view or a depth view of a reference view is required for decoding at least one of the one or more views in the track. Another example method includes composing a track of video data, wherein the track includes one or more views and composing information that indicates whether a texture view or a depth view of a reference view is required for decoding at least one of the one or more views in the track.

## Claims

### Claim 1

A method of processing video data, the method comprising:
parsing a track of video data, wherein the track includes one or more views; and
parsing information to determine whether a texture view or a depth view of a reference view is required for decoding at least one of the one or more views in the track.

### Claim 2 (depends on 1)

The method of claim 1, wherein parsing information further comprises parsing a view identifier box from at least one of a sample entry and a multi-view group entry, wherein the at least one of the sample entry and the multi-view group entry are associated with the track.

### Claim 3 (depends on 2)

The method of claim 2, wherein parsing information further comprises determining from the view identifier box whether the track includes only texture views, only depth views, or texture and depth views.

### Claim 4 (depends on 2)

The method of claim 2, wherein parsing information further comprises determining from the view identifier box, for each view included in the track, whether the view is a texture view or a depth view.

### Claim 5 (depends on 1)

The method of claim 1, wherein the video data comprises a first set of video data that includes a texture view and a depth view, the method further comprising:
parsing a second set of video data based on the first video data, wherein parsing information comprises parsing information to determine whether the first texture view, the first depth view, or both the texture view and depth view of the first set of video data are needed to decode the second set of video data.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
parsing a supplemental enhancement information (SEI) message box to determine a three dimensional scalability information SEI message associated with one or more of the views.

### Claim 7 (depends on 1)

The method of claim 1, wherein the track contains one or more depth views, the method further comprising at least one of parsing a three-dimensional video coding (3VC) Depth Resolution box to determine a spatial resolution of the one or more depth views and parsing a 3VC decoder configuration record to determine a width and a height of a depth view included in the track.

### Claim 8 (depends on 1)

The method of claim 1, wherein the track is a first track, wherein the first track includes one of a depth view of a view and a texture view of the view, further comprising:
parsing a second track of video data, wherein the second track includes the one of the depth view of the view and the texture view of the view that is not included in the first track.

### Claim 9 (depends on 8)

The method of claim 8, further comprising:
parsing a track reference for the first track that references the second track, wherein the track reference includes at least one track reference type that indicates one of that the first track includes the depth view that is associated with the texture view stored in the second track, that the first track depends on the texture view stored in the second track, and that the first track depends on a depth view stored in the second track.

### Claim 10 (depends on 1)

The method of claim 1, wherein the track is a three-dimensional video coding (3VC) track, the method further comprising:
parsing a 3VC decoder configuration record, wherein the 3VC decoder configuration record indicates a configuration record for a matching sample entry of the video data.

### Claim 11 (depends on 1)

The method of claim 1, wherein the track is three-dimensional video coding (3VC) track that includes one or more depth network abstraction layer (NAL) units, wherein parsing the track further comprises parsing at least one of a sample entry type ‘3vc1’ that allows extractors and a sample entry type ‘3vc2’ that disallows extractors.

### Claim 12

A device for processing video data comprising:
a memory configured to store video data; and
one or more processors configured to:
parse a track of video data, wherein the track includes one or more views; and
parse information to determine whether a texture view or a depth view of a reference view is required for decoding at least one of the one or more views in the track.

### Claim 13 (depends on 12)

The device of claim 12, wherein parse information further comprises parse a view identifier box from at least one of a sample entry and a multi-view group entry, wherein the at least one of the sample entry and the multi-view group entry are associated with the track.

### Claim 14 (depends on 13)

The device of claim 13, wherein parse information further comprises determine from the view identifier box whether the track includes only texture views, only depth views, or texture and depth views.

### Claim 15 (depends on 13)

The device of claim 13, wherein parse information further comprises determine from the view identifier box, for each view included in the track, whether the view is a texture view or a depth view.

### Claim 16 (depends on 12)

The device of claim 12, wherein the video data comprises a first video data that includes a texture view and a depth view, the device configured to:
parse second video data based on the first video data, wherein parse information comprises parse information to determine whether the texture view, the depth view, or both the texture and depth view of the first video data are needed to decode the second video data.

### Claim 17 (depends on 12)

The device of claim 12, further configured to:
parse a supplemental enhancement information (SEI) message box to determine a three dimensional scalability information SEI message associated with one or more of the views.

### Claim 18 (depends on 12)

The device of claim 12, wherein the track contains one or more depth views, the device further configured to perform at least one of parse a 3VC Depth Resolution box to determine a spatial resolution of the one or more depth views and parse a three-dimensional video coding (3VC) decoder configuration record to determine a width and a height of a depth view included in the track.

### Claim 19 (depends on 12)

The device of claim 12, wherein the track is a first track, wherein the first track includes one of a depth view of a view and a texture view of the view, the device further configured to:
parse a second track of video data, wherein the second track includes the one of the depth view of the view and the texture view of the view that is not included in the first track.

### Claim 20 (depends on 19)

The device of claim 19, further configured to:
parse a track reference for the first track that references the second track, wherein the track reference includes at least one track reference type that indicates one of that the first track includes the depth view that is associated with the texture view stored in the second track, that the first track depends on the texture view stored in the second track, and that the first track depends on a depth view stored in the second track.

### Claim 21 (depends on 12)

The device of claim 12, wherein the track is a three-dimensional video coding (3VC) track, the device further configured to:
parse a 3VC decoder configuration record, wherein the 3VC decoder configuration record indicates a configuration record for a matching sample entry of the video data.

### Claim 22 (depends on 12)

The device of claim 12, wherein the track is three-dimensional video coding (3VC) track that includes one or more depth network abstraction layer (NAL) units, wherein parse the track further comprises parsing at least one of a sample entry type ‘3vc1’ that allows extractors and a sample entry type ‘3vc2’ that disallows extractors.

### Claim 23

A non-transitory computer-readable storage medium having instructions stored thereon that upon execution cause one or more processors of a video coding device to:
parse a track of video data, wherein the track includes one or more views; and
parse information to determine whether a texture view or a depth view of a reference view is required for decoding at least one of the one or more views in the track.

### Claim 24 (depends on 23)

The non-transitory computer-readable storage medium of claim 23, wherein parse information further comprises parse a view identifier box from at least one of a sample entry and a multi-view group entry, wherein the at least one of the sample entry and the multi-view group entry are associated with the track.

### Claim 25

An apparatus configured to parse a video file including coded video content, the apparatus comprising:
means for parsing a track of video data, wherein the track includes one or more views; and
means for parsing information to determine whether a texture view or a depth view of a reference view is required for decoding at least one of the one or more views in the track.

### Claim 26

A method of processing video data, the method comprising:
composing a track of video data, wherein the track includes one or more views; and
composing information that indicates whether a texture view or a depth view of a reference view is required for decoding at least one of the one or more views in the track.

### Claim 27 (depends on 26)

The method of claim 26, wherein composing information further comprises composing a view identifier box in at least one of a sample entry and a multi-view group entry, wherein the at least one of the sample entry and the multi-view group entry are associated with the track.

### Claim 28 (depends on 27)

The method of claim 27, wherein composing information further comprises indicating in the view identifier box whether the track includes only texture views, only depth views, or texture and depth views.

### Claim 29 (depends on 27)

The method of claim 27, wherein composing information further comprises indicating in the view identifier box, for each view included in the track, whether the view is a texture view or a depth view.

### Claim 30 (depends on 26)

The method of claim 26, wherein the video data comprises a first video data that includes a texture view and a depth view, the method further comprising:
composing second video data based on the first video data, wherein composing information comprises composing information that indicates whether the texture view, the depth view, or both the texture and depth view of the first video data are needed to parse the second video data.

### Claim 31 (depends on 26)

The method of claim 26, further comprising:
composing a supplemental enhancement information (SEI) message box that includes a three dimensional scalability information SEI message associated with one or more views.

### Claim 32 (depends on 26)

The method of claim 26, wherein the track contains one or more depth views, the method further comprising at least one of composing information that indicates a spatial resolution of the one or more depth views in a 3VC Depth Resolution box and composing a three-dimensional video coding (3VC) decoder configuration record, wherein the 3VC decoder configuration record indicates a width and a height of a depth view included in the track.

### Claim 33 (depends on 26)

The method of claim 26, wherein the track is a first track, wherein the first track includes one of a depth view of a view and a texture view of the view, further comprising:
composing a second track of video data, wherein the second track includes the one of the depth view of the view and the texture view of the view that is not included in the first track.

### Claim 34 (depends on 33)

The method of claim 33, further comprising:
composing a track reference for the first track that references the second track, wherein the track reference includes at least one track reference type that indicates one of that the first track includes the depth view that is associated with the texture view stored in the second track, that the first track depends on the texture view stored in the second track, and that the first track depends on a depth view stored in the second track.

### Claim 35 (depends on 26)

The method of claim 26, wherein the track is a three-dimensional video coding (3VC) track, the method further comprising:
composing a 3VC decoder configuration record, wherein the 3VC decoder configuration record indicates a configuration record for a matching sample entry of the video data.

### Claim 36 (depends on 26)

The method of claim 26, wherein the track is three-dimensional video coding (3VC) track that includes one or more depth network abstraction layer (NAL) units, wherein composing the track further comprises composing at least one of a sample entry type ‘3vc1’ that allows extractors and a sample entry type ‘3vc2’ that disallows extractors.

### Claim 37

A device comprising:
a memory configured to store video data; and
one or more processors configured to:
compose a track of video data, wherein the track includes one or more views; and
compose information that indicates whether a texture view or a depth view of a reference view is required for decoding at least one of the one or more views in the track.

### Claim 38 (depends on 37)

The device of claim 37, wherein compose information further comprises compose a view identifier box in at least one of a sample entry and a multi-view group entry, wherein the at least one of the sample entry and the multi-view group entry are associated with the track.

### Claim 39 (depends on 38)

The device of claim 38, wherein compose information further comprises indicate in the view identifier box whether the track includes only texture views, only depth views, or texture and depth views.

### Claim 40 (depends on 38)

The device of claim 38, wherein compose information further comprises indicate in the view identifier box, for each view included in the track, whether the view is a texture view or a depth view.

### Claim 41 (depends on 37)

The device of claim 37, wherein the video data comprises a first video data that includes a texture view and a depth view, the device further configured to:
compose second video data based on the first video data, wherein compose information comprises compose information that indicates whether the texture view, the depth view, or both the texture and depth view of the first video data are needed to parse the second video data.

### Claim 42 (depends on 37)

The device of claim 37, the device further configured to:
compose a supplemental enhancement information (SEI) message box that includes a three dimensional scalability information SEI message associated with one or more views.

### Claim 43 (depends on 37)

The device of claim 37, wherein the track contains one or more depth views, the device further configured to perform at least one of compose information that indicates a spatial resolution of the one or more depth views in a 3VC Depth Resolution box and compose a three-dimensional video coding (3VC) decoder configuration record, wherein the 3VC decoder configuration record indicates a width and a height of a depth view included in the track.

### Claim 44 (depends on 37)

The device of claim 37, wherein the track is a first track, wherein the first track includes one of a depth view of a view and a texture view of the view, the device further configured to:
compose a second track of video data, wherein the second track includes the one of the depth view of the view and the texture view of the view that is not included in the first track.

### Claim 45 (depends on 44)

The device of claim 44, the device further configured to:
compose a track reference for the first track that references the second track, wherein the track reference includes at least one track reference type that indicates one of that the first track includes the depth view that is associated with the texture view stored in the second track, that the first track depends on the texture view stored in the second track, and that the first track depends on a depth view stored in the second track.

### Claim 46 (depends on 37)

The device of claim 37, wherein the track is a three-dimensional video coding (3VC) track, the device further configured to:
compose a 3VC decoder configuration record, wherein the 3VC decoder configuration record indicates a configuration record for a matching sample entry of the video data.

### Claim 47 (depends on 37)

The device of claim 37, wherein the track is three-dimensional video coding (3VC) track that includes one or more depth network abstraction layer (NAL) units, wherein compose the track further comprises composing at least one of a sample entry type ‘3vc1’ that allows extractors and a sample entry type ‘3vc2’ that disallows extractors.

### Claim 48

A non-transitory computer-readable storage medium having instructions stored thereon that upon execution cause one or more processors of a video coding device to:
compose a track of video data, wherein the track includes one or more views; and
compose information that indicates whether a texture view or a depth view of a reference view is required for decoding at least one of the one or more views in the track.

### Claim 49 (depends on 48)

The non-transitory computer-readable storage medium of claim 48, wherein compose information further comprises compose a view identifier box in at least one of a sample entry and a multi-view group entry, wherein the at least one of the sample entry and the multi-view group entry are associated with the track.

### Claim 50

An apparatus configured to compose a video file, the apparatus comprising:
means for composing a track of video data, wherein the track includes one or more views; and
means for composing information that indicates whether a texture view or a depth view of a reference view is required for decoding at least one of the one or more views in the track.
