# US 2014/0192877 A1 · Cross-layer cross-channel sample prediction > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0192877 A1 - Document ID: US20140192877A1 - Status: Published application - Kind: A1 - Application number: 13/977,578 - Filed: 2012-06-26 - Published: 2014-07-10 - Earliest claimed: 2012-06-26 - Assignees: Intel Corporation - Inventors: Lidong Xu; Yu Han; Wenhao Zhang; Yi-Jen Chiu; Hong Jiang - Web page: https://patentgrep.com/patent/US20140192877A1 ## CPC - H04N 19/59: involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution - H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction - H04N 19/147: according to rate distortion criteria (rate-distortion as a criterion for motion estimation H04N19/567) - H04N 19/186: the unit being a colour or a chrominance component - H04N 19/187: the unit being a scalable video layer - H04N 19/33: in the spatial domain - H04N 19/573: Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Systems, apparatus and methods are described including operations for video coding including cross-layer cross-channel sample prediction. ## Claims ### Claim at position 1 1-28. (canceled) ### Claim 29 A computer-implemented method for video coding, comprising: reconstructing a reference sample for a reference channel in a reference layer of video data; determining a target prediction sample for a target channel in a target layer based at least in part on the reference sample via cross-layer cross-channel prediction, wherein the target channel is a different channel than the reference channel; and coding the target channel based at least in part on the target prediction sample. ### Claim 30 (depends on 29) The method of claim 29, wherein the target layer is the same layer as the reference layer. ### Claim 31 (depends on 29) The method of claim 29, wherein when the reference layer comprises a base layer, the target layer comprises an enhancement layer, and wherein when the reference layer comprises an enhancement layer, the target layer comprises a higher enhancement layer. ### Claim 32 (depends on 29) The method of claim 29, wherein when the reference channel comprises a luma channel, the target channel comprises a chroma channel; and wherein when the reference channel comprises a chroma channel, the target channel comprises one of a luma channel or another chroma channel. ### Claim 33 (depends on 29) The method of claim 29, wherein the determination of the target prediction sample is performed during scalable video coding for one or more scalability types including spatial scaling, temporal scaling, quality scaling, and bit-depth scaling. ### Claim 34 (depends on 29) The method of claim 29, further comprising: reconstructing a further reference sample for a further reference layer and/or for a further reference channel of the video data. ### Claim 35 (depends on 29) The method of claim 29, further comprising: reconstructing a further reference sample for a further reference layer and/or for a further reference channel of the video data, wherein the determination of the target prediction sample for the target channel in the target layer is based at least in part on the further reference sample in addition to the reference sample, and wherein the target layer is a higher layer than the further reference layer and/or the target channel is a different channel than the further reference channel. ### Claim 36 (depends on 29) The method of claim 29, wherein the determination of the target prediction sample for the target channel in the target layer comprises selection of the reference layer and reference channel during decoding based at least in part on a flag associated with the target prediction sample during encoding. ### Claim 37 (depends on 29) The method of claim 29, wherein determining the target prediction sample comprises applying one of a linear relation model or a non-linear relation model. ### Claim 38 (depends on 29) The method of claim 29, further comprising: receiving, via a decoder portion of a coder, parameter values from an encoder portion of the coder, wherein the parameter values are associated with performing cross-layer cross-channel prediction, and wherein determining the target prediction sample comprises applying one of a linear relation model or a non-linear relation model based at least in part on the parameter values. ### Claim 39 (depends on 29) The method of claim 29, further comprising: determining, via a decoder portion of a coder, parameter values independent from and in parallel with an encoder portion of the coder, wherein the parameter values are associated with performing cross-layer cross-channel prediction, and wherein determining the target prediction sample comprises applying one of a linear relation model or a non-linear relation model based at least in part on the parameter values. ### Claim 40 (depends on 29) The method of claim 29, wherein model parameters are processed via one or more of the following operations: determining the target prediction sample by adaptively applying one of a one or more fixed relation model parameters, and adaptively determining one or more relation model parameters in response to model parameters associated with one or more layers and/or channels. ### Claim 41 (depends on 29) The method of claim 29, wherein the determination of the target prediction sample for the target channel via cross-layer cross-channel prediction is adaptively applied based at least in part on a rate distortion cost. ### Claim 42 (depends on 29) The method of claim 29, further comprising: reconstructing a further reference sample for a further reference layer and/or for a further reference channel of the video data, wherein the determination of the target prediction sample for the target channel in the target layer is based at least in part on the further reference sample in addition to the reference sample, wherein the target layer is a higher layer than the further reference layer and/or the target channel is a different channel than the further reference channel, wherein when the reference layer comprises a base layer, the target layer comprises an enhancement layer, and wherein when the reference layer comprises an enhancement layer, the target layer comprises a higher enhancement layer, wherein when the reference channel comprises a luma channel, the target channel comprises a chroma channel; and wherein when the reference channel comprises a chroma channel, the target channel comprises one of a luma channel or another chroma channel, wherein the determination of the target prediction sample is performed during scalable video coding for one or more scalability types including spatial scaling, temporal scaling, quality scaling, and bit-depth scaling, wherein the determination of the target prediction sample for the target channel in the target layer comprises selection of the reference layer and reference channel during decoding based at least in part on a flag associated with the target prediction sample during encoding, wherein parameter values are processed via one or more of the following operations: receiving, via a decoder portion of a coder, parameter values from an encoder portion of the coder, and determining, via a decoder portion of a coder, parameter values independent from and in parallel with an encoder portion of the coder, wherein the parameter values are associated with performing cross-layer cross-channel prediction, wherein determining the target prediction sample comprises applying one of a linear relation model or a non-linear relation model based at least in part on the parameter values, wherein model parameters are processed via one or more of the following operations: determining the target prediction sample by adaptively applying one of a one or more fixed relation model parameters, and adaptively determining one or more relation model parameters in response to model parameters associated with one or more layers and/or channels, and wherein the determination of the target prediction sample for the target channel via cross-layer cross-channel prediction is adaptively applied based at least in part on a rate distortion cost. ### Claim 43 A system for video coding on a computer, comprising: a display device configured to present video data; one or more processors communicatively coupled to the display device; one or more memory stores communicatively coupled to the one or more processors; a sample reconstruction logic module of the video coder communicatively coupled to the one or more processors and configured to reconstruct a reference sample for a reference channel in a reference layer of video data; and a cross-layer cross-channel prediction logic module of a video coder communicatively coupled to the sample reconstruction logic module and configured to determine a target prediction sample for a target channel in a target layer based at least in part on the reference sample via cross-layer cross-channel prediction, wherein the target channel is a different channel than the reference channel. ### Claim 44 (depends on 43) The system of claim 43, wherein the target layer is the same layer as the reference layer ### Claim 45 (depends on 43) The system of claim 43, wherein when the reference layer comprises a base layer, the target layer comprises an enhancement layer, and wherein when the reference layer comprises an enhancement layer, the target layer comprises a higher enhancement layer. ### Claim 46 (depends on 43) The system of claim 43, wherein when the reference channel comprises a luma channel, the target channel comprises a chroma channel; and wherein when the reference channel comprises a chroma channel, the target channel comprises one of a luma channel or another chroma channel. ### Claim 47 (depends on 43) The system of claim 43, wherein the sample reconstruction logic module is further configured to reconstruct a further reference sample for a further reference layer and/or for a further reference channel of the video data, wherein the determination of the target prediction sample for the target channel in the target layer is based at least in part on the further reference sample in addition to the reference sample, and wherein the target layer is a higher layer than the further reference layer and/or the target channel is a different channel than the further reference channel. ### Claim 48 (depends on 43) The system of claim 43, wherein the determination of the target prediction sample for the target channel in the target layer comprises selection of the reference layer and reference channel during decoding based at least in part on a flag associated with the target prediction sample during encoding. ### Claim 49 (depends on 43) The system of claim 43, wherein the sample reconstruction logic module is further configured to reconstruct a further reference sample for a further reference layer and/or for a further reference channel of the video data, wherein the determination of the target prediction sample for the target channel in the target layer is based at least in part on the further reference sample in addition to the reference sample, wherein the target layer is a higher layer than the further reference layer and/or the target channel is a different channel than the further reference channel, wherein when the reference layer comprises a base layer, the target layer comprises an enhancement layer, and wherein when the reference layer comprises an enhancement layer, the target layer comprises a higher enhancement layer, wherein when the reference channel comprises a luma channel, the target channel comprises a chroma channel; and wherein when the reference channel comprises a chroma channel, the target channel comprises one of a luma channel or another chroma channel, wherein the determination of the target prediction sample is performed during scalable video coding for one or more scalability types including spatial scaling, temporal scaling, quality scaling, and bit-depth scaling, wherein the determination of the target prediction sample for the target channel in the target layer comprises selection of the reference layer and reference channel during decoding based at least in part on a flag associated with the target prediction sample during encoding, wherein parameter values are processed via one or more of the following operations: receiving, via a decoder portion of a coder, parameter values from an encoder portion of the coder, and determining, via a decoder portion of a coder, parameter values independent from and in parallel with an encoder portion of the coder, wherein the parameter values are associated with performing cross-layer cross-channel prediction, wherein determining the target prediction sample comprises applying one of a linear relation model or a non-linear relation model based at least in part on the parameter values, wherein model parameters are processed via one or more of the following operations: determining the target prediction sample by adaptively applying one of a one or more fixed relation model parameters, and adaptively determining one or more relation model parameters in response to model parameters associated with one or more layers and/or channels, and wherein the determination of the target prediction sample for the target channel via cross-layer cross-channel prediction is adaptively applied based at least in part on a rate distortion cost. ### Claim 50 A system comprising: an antenna configured to receive an encoded bitstream of video data; and a video decoder communicatively coupled to the antenna and configured to decode the encoded bitstream, wherein the video decoder is configured to: reconstruct a reference sample for a reference channel in a reference layer of video data; determine a target prediction sample for a target channel in a target layer based at least in part on the reference sample via cross-layer cross-channel prediction, wherein the target channel is a different channel than the reference channel; and decode the target channel based at least in part on the target prediction sample. ### Claim 51 (depends on 50) The system of claim 50, wherein the video decoder is further configured to reconstruct a further reference sample for a further reference layer and/or for a further reference channel of the video data, wherein the determination of the target prediction sample for the target channel in the target layer is based at least in part on the further reference sample in addition to the reference sample, and wherein the target layer is a higher layer than the further reference layer and/or the target channel is a different channel than the further reference channel. ### Claim 52 (depends on 50) The system of claim 50, wherein the determination of the target prediction sample for the target channel in the target layer comprises selection of the reference layer and reference channel during decoding based at least in part on a flag associated with the target prediction sample during encoding. ### Claim 53 (depends on 50) The system of claim 50, wherein the video decoder is further configured to reconstruct a further reference sample for a further reference layer and/or for a further reference channel of the video data, wherein the determination of the target prediction sample for the target channel in the target layer is based at least in part on the further reference sample in addition to the reference sample, wherein the target layer is a higher layer than the further reference layer and/or the target channel is a different channel than the further reference channel, wherein when the reference layer comprises a base layer, the target layer comprises an enhancement layer, and wherein when the reference layer comprises an enhancement layer, the target layer comprises a higher enhancement layer, wherein when the reference channel comprises a luma channel, the target channel comprises a chroma channel; and wherein when the reference channel comprises a chroma channel, the target channel comprises one of a luma channel or another chroma channel; wherein the determination of the target prediction sample is performed during scalable video coding for one or more scalability types including spatial scaling, temporal scaling, quality scaling, and bit-depth scaling, wherein the determination of the target prediction sample for the target channel in the target layer comprises selection of the reference layer and reference channel during decoding based at least in part on a flag associated with the target prediction sample during encoding, wherein parameter values are processed via one or more of the following operations: receiving, via a decoder portion of a coder, parameter values from an encoder portion of the coder, and determining, via a decoder portion of a coder, parameter values independent from and in parallel with an encoder portion of the coder, wherein the parameter values are associated with performing cross-layer cross-channel prediction, wherein determining the target prediction sample comprises applying one of a linear relation model or a non-linear relation model based at least in part on the parameter values; wherein model parameters are processed via one or more of the following operations: determining the target prediction sample by adaptively applying one of a one or more fixed relation model parameters, and adaptively determining one or more relation model parameters in response to model parameters associated with one or more layers and/or channels, and wherein the determination of the target prediction sample for the target channel via cross-layer cross-channel prediction is adaptively applied based at least in part on a rate distortion cost.