# US 10,764,575 B2 · Coding MCTS-nested SEI messages to exclude other SEI messages that are not MCTS-nested > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,764,575 B2 - Document ID: US10764575B2 - Status: Granted - Kind: B2 - Application number: 15/909,597 - Filed: 2018-03-01 - Published: 2018-09-06 - Granted: 2020-09-01 - Earliest claimed: 2017-03-03 - Assignees: QUALCOMM Incorporated - Applicants: QUALCOMM Incorporated - Inventors: Ye-Kui Wang - Web page: https://patentgrep.com/patent/US10764575B2 ## CPC - H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction - H04N 19/137: Motion inside a coding unit, e.g. average field, frame or block difference - H04N 19/174: the region being a slice, e.g. a line of blocks or a group of blocks - H04N 19/176: the region being a block, e.g. a macroblock - H04N 19/184: the unit being bits, e.g. of the compressed video stream - H04N 19/188: {the unit being a video data packet, e.g. a network abstraction layer [NAL] unit} - H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence) - H04N 19/55: Motion estimation with spatial constraints, e.g. at image or region borders - H04N 19/587: involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - H04N 19/31: in the temporal domain - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An example device for processing video data includes a memory configured to store video data; and one or more processors implemented in circuitry and configured to decode a supplemental enhancement information (SEI) network abstraction layer (NAL) unit of a video bitstream including the video data, the SEI NAL unit containing a motion constrained tile sets (MCTS) nesting SEI message; determine that the SEI NAL unit does not contain any non-MCTS-nesting SEI messages in response to the SEI NAL unit containing the MCTS nesting SEI message; and decode subsequent SEI messages of the SEI NAL unit as MCTS nesting SEI messages in response to the determination. ## Claims ### Claim 1 A method of decoding video data, the method comprising: decoding, by one or more processors implemented in circuitry of a device, a received supplemental enhancement information (SEI) network abstraction layer (NAL) unit of a video bitstream, the SEI NAL unit, as received by the device, containing a motion constrained tile sets (MCTS) nesting SEI message, the video bitstream conforming to a video coding standard, the video coding standard imposing a restriction on the video bitstream that the video bitstream as received by the device will not contain any non-MCTS-nesting SEI messages when the video bitstream as received by the device contains a respective MCTS nesting SEI message; determining, by the one or more processors and based on the restriction imposed on the video bitstream by the video coding standard, that the SEI NAL unit, as received by the device, does not contain any non-MCTS-nesting SEI messages in response to the SEI NAL unit containing the MCTS nesting SEI message; and decoding, by the one or more processors, subsequent SEI messages of the received SEI NAL unit as MCTS nesting SEI messages in response to the determination. ### Claim 2 (depends on 1) The method of claim 1, wherein decoding the SEI NAL unit comprises decoding values for one or more syntax elements of the MCTS nesting SEI message using an upper limit of 511 for the values. ### Claim 3 (depends on 2) The method of claim 2, wherein the one or more syntax elements include a syntax element representing a number of MCTS extraction information sets (MCTS-EIS) messages included in the SEI NAL unit. ### Claim 4 (depends on 2) The method of claim 2, wherein the one or more syntax elements include a syntax element representing a number of MCTSs associated with one MCTS extraction information set corresponding to the SEI NAL unit. ### Claim 5 (depends on 2) The method of claim 2, wherein the one or more syntax elements include a syntax element representing a number of MCTSs associated with the MCTS nesting SEI message. ### Claim 6 (depends on 1) The method of claim 1, the video bitstream comprising an original bitstream, the method further comprising: decoding a motion constrained tile sets (MCTS) extraction information set (MCTS-EIS) supplemental enhancement information (SEI) message of the original bitstream; and extracting an MCTS sub-bitstream from the original bitstream, the MCTS sub-bitstream including a set of two or more MCTSs. ### Claim 7 (depends on 6) The method of claim 6, further comprising signaling the tier and level information of the set of two or more MCTSs in a replacement MCTS-EIS SEI message of the extracted MCTS sub-bitstream. ### Claim 8 (depends on 6) The method of claim 6, wherein decoding the MCTS-EIS SEI message comprises decoding an extraction information set of the MCTS-EIS SEI message, the method further comprising determining the set of two or more MCTSs from the extraction information set of the MCTS-EIS SEI message. ### Claim 9 (depends on 6) The method of claim 6, wherein decoding the MCTS-EIS SEI message comprises decoding a list of extractable sets of MCTSs as a nested loop within a loop of extraction information sets of the MCTS-EIS SEI message. ### Claim 10 (depends on 6) The method of claim 6, further comprising signaling tier and level information of the set of two or more MCTSs in replacement sequence parameter sets (SPSs) of the extracted MCTS sub-bitstream. ### Claim 11 A device for decoding video data, the device comprising: a memory configured to store video data; and one or more processors implemented in circuitry and configured to: decode a received supplemental enhancement information (SEI) network abstraction layer (NAL) unit of a video bitstream including the video data, the SEI NAL unit, as received by the device, containing a motion constrained tile sets (MCTS) nesting SEI message, the video bitstream conforming to a video coding standard, the video coding standard imposing a restriction on the video bitstream that the video bitstream as received by the device will not contain any non-MCTS-nesting SEI messages when the video bitstream as received by the device contains a respective MCTS nesting SEI message; determine, based on the restriction imposed on the video bitstream by the video coding standard, that the SEI NAL unit, as received by the device, does not contain any non-MCTS-nesting SEI messages in response to the SEI NAL unit containing the MCTS nesting SEI message; and decode subsequent SEI messages of the received SEI NAL unit as MCTS nesting SEI messages in response to the determination. ### Claim 12 (depends on 11) The device of claim 11, wherein to decode the SEI NAL unit, the one or more processors are configured to decode values for one or more syntax elements of the MCTS nesting SEI message using an upper limit of 511 for the values. ### Claim 13 (depends on 12) The device of claim 12, wherein the one or more syntax elements include a syntax element representing a number of MCTS extraction information sets (MCTS-EIS) messages included in the SEI NAL unit. ### Claim 14 (depends on 12) The device of claim 12, wherein the one or more syntax elements include a syntax element representing a number of MCTSs associated with one MCTS extraction information set corresponding to the SEI NAL unit. ### Claim 15 (depends on 12) The device of claim 12, wherein the one or more syntax elements include a syntax element representing a number of MCTSs associated with the MCTS nesting SEI message. ### Claim 16 (depends on 11) The device of claim 11, the video bitstream comprising an original bitstream, wherein the one or more processors are further configured to: decode a motion constrained tile sets (MCTS) extraction information set (MCTS-EIS) supplemental enhancement information (SEI) message of the original bitstream; and extract an MCTS sub-bitstream from the original bitstream, the MCTS sub-bitstream including a set of two or more MCTSs. ### Claim 17 (depends on 16) The device of claim 16, wherein the one or more processors are further configured to signal the tier and level information of the set of two or more MCTSs in a replacement MCTS-EIS SEI message of the extracted MCTS sub-bitstream. ### Claim 18 (depends on 16) The device of claim 16, wherein to decode the MCTS-EIS SEI message, the one or more processors are configured to decode an extraction information set of the MCTS-EIS SEI message, and wherein the one or more processors are further configured to determine the set of two or more MCTSs from the extraction information set of the MCTS-EIS SEI message. ### Claim 19 (depends on 16) The device of claim 16, wherein to decode the MCTS-EIS SEI message, the one or more processors are configured to decode a list of extractable sets of MCTSs as a nested loop within a loop of extraction information sets of the MCTS-EIS SEI message. ### Claim 20 (depends on 16) The device of claim 16, wherein the one or more processors are further configured to signal tier and level information of the set of two or more MCTSs in replacement sequence parameter sets (SPSs) of the extracted MCTS sub-bitstream. ### Claim 21 (depends on 11) The device of claim 11, further comprising a display configured to display the video data. ### Claim 22 (depends on 11) The device of claim 11, wherein the device comprises one or more of a camera, a computer, a mobile device, a broadcast receiver device, or a set-top box. ### Claim 23 A device for decoding video data, the device comprising: means for decoding a received supplemental enhancement information (SEI) network abstraction layer (NAL) unit of a video bitstream, the SEI NAL unit, as received by the device, containing a motion constrained tile sets (MCTS) nesting SEI message, the video bitstream conforming to a video coding standard, the video coding standard imposing a restriction on the video bitstream that the video bitstream as received by the device will not contain any non-MCTS-nesting SEI messages when the video bitstream as received by the device contains a respective MCTS nesting SEI message; means for determining, based on the restriction imposed on the video bitstream by the video coding standard, that the SEI NAL unit, as received by the device, does not contain any non-MCTS-nesting SEI messages in response to the SEI NAL unit containing the MCTS nesting SEI message; and means for decoding subsequent SEI messages of the received SEI NAL unit as MCTS nesting SEI messages in response to the determination. ### Claim 24 (depends on 23) The device of claim 23, wherein the means for decoding the SEI NAL unit comprises means for decoding values for one or more syntax elements of the MCTS nesting SEI message using an upper limit of 511 for the values. ### Claim 25 (depends on 24) The device of claim 24, wherein the one or more syntax elements include a syntax element representing a number of MCTS extraction information sets (MCTS-EIS) messages included in the SEI NAL unit. ### Claim 26 (depends on 24) The device of claim 24, wherein the one or more syntax elements include a syntax element representing a number of MCTSs associated with one MCTS extraction information set corresponding to the SEI NAL unit. ### Claim 27 (depends on 24) The device of claim 24, wherein the one or more syntax elements include a syntax element representing a number of MCTSs associated with the MCTS nesting SEI message. ### Claim 28 (depends on 23) The device of claim 23, the video bitstream comprising an original bitstream, further comprising: means for decoding a motion constrained tile sets (MCTS) extraction information set (MCTS-EIS) supplemental enhancement information (SEI) message of the original bitstream; and means for extracting an MCTS sub-bitstream from the original bitstream, the MCTS sub-bitstream including a set of two or more MCTSs. ### Claim 29 (depends on 28) The device of claim 28, further comprising means for signaling the tier and level information of the set of two or more MCTSs in a replacement MCTS-EIS SEI message of the extracted MCTS sub-bitstream. ### Claim 30 (depends on 28) The device of claim 28, wherein the means for decoding the MCTS-EIS SEI message comprises means for decoding an extraction information set of the MCTS-EIS SEI message, further comprising means for determining the set of two or more MCTSs from the extraction information set of the MCTS-EIS SEI message. ### Claim 31 (depends on 28) The device of claim 28, wherein the means for decoding the MCTS-EIS SEI message comprises means for decoding a list of extractable sets of MCTSs as a nested loop within a loop of extraction information sets of the MCTS-EIS SEI message. ### Claim 32 (depends on 28) The device of claim 28, further comprising means for signaling tier and level information of the set of two or more MCTSs in replacement sequence parameter sets (SPSs) of the extracted MCTS sub-bitstream. ### Claim 33 A non-transitory computer-readable storage medium having stored thereon instructions that, when executed, cause a processor of a device to: decode a received supplemental enhancement information (SEI) network abstraction layer (NAL) unit of a video bitstream, the SEI NAL unit, as received by the device, containing a motion constrained tile sets (MCTS) nesting SEI message, the video bitstream conforming to a video coding standard, the video coding standard imposing a restriction on the video bitstream that the video bitstream as received by the device will not contain any non-MCTS-nesting SEI messages when the video bitstream as received by the device contains a respective MCTS nesting SEI message; determine, based on the restriction imposed on the video bitstream by the video coding standard, that the SEI NAL unit, as received by the device, does not contain any non-MCTS-nesting SEI messages in response to the SEI NAL unit containing the MCTS nesting SEI message; and decode subsequent SEI messages of the received SEI NAL unit as MCTS nesting SEI messages in response to the determination. ### Claim 34 (depends on 33) The non-transitory computer-readable storage medium of claim 33, wherein the instructions that cause the processor to decode the SEI NAL unit comprise instructions that cause the processor to decode values for one or more syntax elements of the MCTS nesting SEI message using an upper limit of 511 for the values. ### Claim 35 (depends on 34) The non-transitory computer-readable storage medium of claim 34, wherein the one or more syntax elements include a syntax element representing a number of MCTS extraction information sets (MCTS-EIS) messages included in the SEI NAL unit. ### Claim 36 (depends on 34) The non-transitory computer-readable storage medium of claim 34, wherein the one or more syntax elements include a syntax element representing a number of MCTSs associated with one MCTS extraction information set corresponding to the SEI NAL unit. ### Claim 37 (depends on 34) The non-transitory computer-readable storage medium of claim 34, wherein the one or more syntax elements include a syntax element representing a number of MCTSs associated with the MCTS nesting SEI message. ### Claim 38 (depends on 33) The non-transitory computer-readable storage medium of claim 33, the video bitstream comprising an original bitstream, further comprising instructions that cause the processor to: decode a motion constrained tile sets (MCTS) extraction information set (MCTS-EIS) supplemental enhancement information (SEI) message of the original bitstream; and extract an MCTS sub-bitstream from the original bitstream, the MCTS sub-bitstream including a set of two or more MCTSs. ### Claim 39 (depends on 38) The non-transitory computer-readable storage medium of claim 38, further comprising instructions that cause the processor to signal the tier and level information of the set of two or more MCTSs in a replacement MCTS-EIS SEI message of the extracted MCTS sub-bitstream. ### Claim 40 (depends on 38) The non-transitory computer-readable storage medium of claim 38, wherein the instructions that cause the processor to decode the MCTS-EIS SEI message comprise instructions that cause the processor to decode an extraction information set of the MCTS-EIS SEI message, further comprising instructions that cause the processor to determine the set of two or more MCTSs from the extraction information set of the MCTS-EIS SEI message. ### Claim 41 (depends on 38) The non-transitory computer-readable storage medium of claim 38, wherein the instructions that cause the processor to decode the MCTS-EIS SEI message comprise instructions that cause the processor to decode a list of extractable sets of MCTSs as a nested loop within a loop of extraction information sets of the MCTS-EIS SEI message. ### Claim 42 (depends on 38) The non-transitory computer-readable storage medium of claim 38, further comprising instructions that cause the processor to signal tier and level information of the set of two or more MCTSs in replacement sequence parameter sets (SPSs) of the extracted MCTS sub-bitstream.