# US 2014/0192153 A1 · Signaling of spatial resolution of depth views in multiview coding file format

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0192153 A1
- Document ID: US20140192153A1
- Status: Published application
- Kind: A1
- Application number: 14/137,358
- Filed: 2013-12-20
- Published: 2014-07-10
- Earliest claimed: 2013-01-04
- Assignees: QUALCOMM Incorporated
- Applicants: QUALCOMM Incorporated
- Inventors: Ye-Kui Wang; Ying Chen
- Web page: https://patentgrep.com/patent/US20140192153A1

## CPC

- H04N 13/161: Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597)
- H04N 5/76: Television signal recording
- H04N 5/919: by dividing samples or signal segments, e.g. television lines, among a plurality of recording channels
- H04N 9/8042: {involving data reduction}
- H04N 9/8205: {involving the multiplexing of an additional signal and the colour video signal}
- H04N 19/44: Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards
- H04N 5/765: Interface circuits between an apparatus for recording and another apparatus
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Techniques for encapsulating video streams containing multiple coded views in a media file are described herein. In one example, a method includes parsing a track of multiview video data, wherein the track includes at least one depth view. The method further includes parsing information to determine a spatial resolution associated with the depth view, wherein decoding the spatial resolution does not require parsing of a sequence parameter set of the depth view. Another example method includes composing a track of multiview video data, wherein the track includes the one or more views. The example method further includes composing information to indicate a spatial resolution associated with the depth view, wherein decoding the spatial resolution does not require parsing of a sequence parameter set of the depth view.

## Claims

### Claim 1

A method of processing video data, the method comprising:
parsing a track of multiview video data, wherein the track includes at least one depth view; and
parsing information to determine a spatial resolution associated with the depth view, wherein decoding the spatial resolution does not require parsing of a sequence parameter set of the depth view.

### Claim 2 (depends on 1)

The method of claim 1, wherein parsing information further comprises parsing the spatial resolution from a 3VC Depth Resolution box from at least one of a 3VC Configuration Box and directly from a sample entry.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
parsing a 3VC decoder configuration record from the 3VC Configuration Box, wherein the 3VC Configuration Box is included in at least one of a sample entry of type ‘3vc1’ that allows extractors and a sample entry type ‘3vc2’ that disallows extractors.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
parsing a view identifier box from at least one of a sample entry and a multi-view group entry to determine at least one of whether a texture view or a depth view of a reference view is required for decoding at least one of the one or more views in the track, whether the track includes only depth views or texture and depth views, and, for each view included in the track, whether the view is a texture view or a depth view, wherein the at least one of the sample entry and the multi-view group entry are associated with the track.

### Claim 5 (depends on 1)

The method of claim 1, wherein the multiview video data is a first set of multiview video data, and wherein the track further includes at least one texture view, the method further comprising:
parsing a second set of multiview video data based on the first set of multiview video data, wherein parsing information comprises parsing information to determine whether the first texture view, the first depth view, or both the first texture and first depth view of the first set of multiview video data are needed to decode the second set of multiview video data.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
parsing a supplemental enhancement information (SEI) message box to determine a three dimensional scalability information SEI message associated with one or more of the views.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
parsing a three-dimensional video coding (3VC) decoder configuration record to determine a width and a height of the depth view.

### Claim 8 (depends on 1)

The method of claim 1, wherein the track is a first track, the method further comprising:
parsing a second track of multiview video data, wherein the second track includes a texture view corresponding to the depth view, wherein the texture view is not included in the first track.

### Claim 9

A device comprising:
a memory configured to store video data; and
one or more processors configured to:
parse a track of multiview video data, wherein the track includes one or more views, including at least one depth view; and
parse information to determine a spatial resolution associated with the depth view, wherein decoding the spatial resolution does not require parsing of a sequence parameter set of the depth view.

### Claim 10 (depends on 9)

The device of claim 9, wherein parse information further comprises parse the spatial resolution from a 3VC Depth Resolution box from at least one of a 3VC Configuration Box and directly from a sample entry.

### Claim 11 (depends on 9)

The device of claim 9, the device further configured to:
parse a 3VC decoder configuration record from the 3VC Configuration Box, wherein the 3VC Configuration Box is included in at least one of a sample entry of type ‘3vc1’ that allows extractors and a sample entry type ‘3vc2’ that disallows extractors.

### Claim 12 (depends on 9)

The device of claim 9, the device further configured to:
parse a view identifier box from at least one of a sample entry and a multi-view group entry to determine at least one of whether a texture view or a depth view of a reference view is required for decoding at least one of the one or more views in the track, whether the track includes only depth views or texture and depth views, and, for each view included in the track, whether the view is a texture view or a depth view, wherein the at least one of the sample entry and the multi-view group entry are associated with the track.

### Claim 13 (depends on 9)

The device of claim 9, wherein the multiview video data is a first set of multiview video data, and wherein the track further includes at least one texture view, the device further configured to:
parse a second set of multiview video data based on the first set of multiview video data, wherein parsing information comprises parsing information to determine whether the first texture view, the first depth view, or both the first texture and first depth view of the first set of multiview video data are needed to decode the second set of multiview video data.

### Claim 14 (depends on 9)

The device of claim 9, further configured to:
parse a supplemental enhancement information (SEI) message box to determine a three dimensional scalability information SEI message associated with one or more of the views.

### Claim 15 (depends on 9)

The device of claim 9, further configured to:
parse a three-dimensional video coding (3VC) decoder configuration record to determine a width and a height of the depth view.

### Claim 16 (depends on 9)

The device of claim 9, wherein the track is a first track, the device further configured to:
parse a second track of multiview video data, wherein the second track includes a texture view corresponding to the depth view, wherein the texture view is not included in the first track.

### Claim 17

A non-transitory computer-readable storage medium having instructions stored thereon that upon execution cause one or more processors of a video coding device to:
parse a track of multiview video data, wherein the track includes one or more views, including at least one depth view; and
parse information to determine a spatial resolution associated with the depth view, wherein decoding the spatial resolution does not require parsing of a sequence parameter set of the depth view.

### Claim 18 (depends on 17)

The non-transitory computer-readable storage medium of claim 17, wherein parse information further comprises parse the spatial resolution from a 3VC Depth Resolution box from at least one of a 3VC Configuration Box and directly from a sample entry.

### Claim 19 (depends on 17)

The non-transitory computer-readable storage medium of claim 17, the instructions stored thereon further cause the one or more processors of the video coding device to:
parse a 3VC decoder configuration record from the 3VC Configuration Box, wherein the 3VC Configuration Box is included in at least one of a sample entry of type ‘3vc1’ that allows extractors and a sample entry type ‘3vc2’ that disallows extractors.

### Claim 20

An apparatus configured to parse a video file including coded video content, the apparatus comprising:
means for parsing a track of multiview video data, wherein the track includes one or more views, including at least one depth view; and
means for parsing information to determine a spatial resolution associated with the depth view, wherein decoding the spatial resolution does not require parsing of a sequence parameter set of the depth view.

### Claim 21 (depends on 20)

The apparatus of claim 20, wherein means for parsing information further comprises means for parsing the spatial resolution from a 3VC Depth Resolution box from at least one of a 3VC Configuration Box and directly from a sample entry.

### Claim 22 (depends on 20)

The apparatus of claim 20, further comprising:
means for parsing a 3VC decoder configuration record from the 3VC Configuration Box, wherein the 3VC Configuration Box is included in at least one of a sample entry of type ‘3vc1’ that allows extractors and a sample entry type ‘3vc2’ that disallows extractors.

### Claim 23

A method of processing video data, the method comprising:
composing a track of multiview video data, wherein the track includes the one or more views; and
composing information to indicate a spatial resolution associated with the depth view, wherein decoding the spatial resolution does not require parsing of a sequence parameter set of the depth view.

### Claim 24 (depends on 23)

The method of claim 23, wherein composing information further comprises composing the spatial resolution in a 3VC Depth Resolution box in at least one of a 3VC Configuration Box and directly in a sample entry.

### Claim 25 (depends on 23)

The method of claim 23, further comprising:
composing a 3VC decoder configuration record in the 3VC Configuration Box, wherein the 3VC Configuration Box is included in at least one of a sample entry of type ‘3vc1’ that allows extractors and a sample entry type ‘3vc2’ that disallows extractors.

### Claim 26 (depends on 23)

The method of claim 23, further comprising:
composing a view identifier box from at least one of a sample entry and a multi-view group entry to indicate at least one of whether a texture view or a depth view of a reference view is required for decoding at least one of the one or more views in the track, whether the track includes only depth views or texture and depth views, and, for each view included in the track, whether the view is a texture view or a depth view, wherein the at least one of the sample entry and the multi-view group entry are associated with the track.

### Claim 27 (depends on 23)

The method of claim 23, wherein the multiview video data is a first set of multiview video data, and wherein the track further includes at least one texture view, the method further comprising:
composing a second set of multiview video data based on the first set of multiview video data, wherein composing information further comprises composing information to indicate whether the first texture view, the first depth view, or both the first texture and first depth view of the first set of multiview video data are needed to decode the second set of multiview video data.

### Claim 28 (depends on 23)

The method of claim 23, further comprising:
composing a supplemental enhancement information (SEI) message box to indicate a three dimensional scalability information SEI message associated with one or more of the views.

### Claim 29 (depends on 23)

The method of claim 23, further comprising:
composing a three-dimensional video coding (3VC) decoder configuration record to indicate a width and a height of the depth view.

### Claim 30 (depends on 23)

The method of claim 23, wherein the track is a first track, the method further comprising:
composing a second track of multiview video data, wherein the second track includes a texture view corresponding to the depth view, wherein the texture view is not included in the first track.

### Claim 31

A device comprising:
a memory configured to store video data; and
one or more processors configured to:
compose a track of multiview video data, wherein the track includes one or more views, including at least one depth view; and
compose information to indicate a spatial resolution associated with the depth view, wherein decoding the spatial resolution does not require parsing of a sequence parameter set of the depth view.

### Claim 32 (depends on 31)

The device of claim 31, wherein parse information further comprises compose the spatial resolution in a 3VC Depth Resolution box in at least one of a 3VC Configuration Box and directly in a sample entry.

### Claim 33 (depends on 31)

The device of claim 31, the device further configured to:
compose a 3VC decoder configuration record in the 3VC Configuration Box, wherein the 3VC Configuration Box is included in at least one of a sample entry of type ‘3vc1’ that allows extractors and a sample entry type ‘3vc2’ that disallows extractors.

### Claim 34 (depends on 31)

The device of claim 31, the device further configured to:
compose a view identifier box from at least one of a sample entry and a multi-view group entry to indicate at least one of whether a texture view or a depth view of a reference view is required for decoding at least one of the one or more views in the track, whether the track includes only depth views or texture and depth views, and, for each view included in the track, whether the view is a texture view or a depth view, wherein the at least one of the sample entry and the multi-view group entry are associated with the track.

### Claim 35 (depends on 31)

The device of claim 31, wherein the multiview video data is a first set of multiview video data, and wherein the track further includes at least one texture view, the device further configured to:
compose a second set of multiview video data based on the first set of multiview video data, wherein composing information further comprises composing information to indicate whether the first texture view, the first depth view, or both the first texture and first depth view of the first set of multiview video data are needed to decode the second set of multiview video data.

### Claim 36 (depends on 31)

The device of claim 31, further configured to:
compose a supplemental enhancement information (SEI) message box to indicate a three dimensional scalability information SEI message associated with one or more of the views.

### Claim 37 (depends on 31)

The device of claim 31, further configured to:
compose a three-dimensional video coding (3VC) decoder configuration record to indicate a width and a height of the depth view.

### Claim 38 (depends on 31)

The device of claim 31, wherein the track is a first track, the device further configured to:
compose a second track of multiview video data, wherein the second track includes a texture view corresponding to the depth view, wherein the texture view is not included in the first track.

### Claim 39

A non-transitory computer-readable storage medium having instructions stored thereon that upon execution cause one or more processors of a video coding device to:
compose a track of multiview video data, wherein the track includes one or more views, including at least one depth view; and
compose information to indicate a spatial resolution associated with the depth view, wherein decoding the spatial resolution does not require parsing of a sequence parameter set of the depth view.

### Claim 40 (depends on 39)

The non-transitory computer-readable storage medium of claim 39, wherein compose information further comprises compose the spatial resolution in a 3VC Depth Resolution box in at least one of a 3VC Configuration Box and directly in a sample entry.

### Claim 41 (depends on 39)

The non-transitory computer-readable storage medium of claim 39, the instructions stored thereon further cause the one or more processors of the video coding device to:
compose a 3VC decoder configuration record in the 3VC Configuration Box, wherein the 3VC Configuration Box is included in at least one of a sample entry of type ‘3vc1’ that allows extractors and a sample entry type ‘3vc2’ that disallows extractors.

### Claim 42

An apparatus configured to parse a video file including coded video content, the apparatus comprising:
means for composing a track of multiview video data, wherein the track includes one or more views, including at least one depth view; and
means for composing information to indicate a spatial resolution associated with the depth view, wherein decoding the spatial resolution does not require parsing of a sequence parameter set of the depth view.

### Claim 43 (depends on 42)

The apparatus of claim 42, wherein means for composing information further comprises means for composing the spatial resolution in a 3VC Depth Resolution box in at least one of a 3VC Configuration Box and directly in a sample entry.

### Claim 44 (depends on 42)

The apparatus of claim 42, further comprising:
means for composing a 3VC decoder configuration record in the 3VC Configuration Box, wherein the 3VC Configuration Box is included in at least one of a sample entry of type ‘3vc1’ that allows extractors and a sample entry type ‘3vc2’ that disallows extractors.
