# US 10,484,678 B2 · Method and apparatus of adaptive intra prediction for inter-layer and inter-view coding > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,484,678 B2 - Document ID: US10484678B2 - Status: Granted - Kind: B2 - Application number: 15/795,582 - Filed: 2017-10-27 - Published: 2018-03-08 - Granted: 2019-11-19 - Earliest claimed: 2012-06-22 - Assignees: Mediatek Inc. - Applicants: Mediatek Inc - Inventors: Chia-Yang Tsai; Tzu-Der Chuang; Ching-Yeh Chen; Yu-Wen Huang - Web page: https://patentgrep.com/patent/US10484678B2 ## CPC - H04N 19/105: Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction - H04N 19/136: Incoming video signal characteristics or properties - H04N 19/186: the unit being a colour or a chrominance component - H04N 19/30: using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence) - H04N 19/593: involving spatial prediction techniques - H04N 19/597: specially adapted for multi-view video sequence encoding - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A method of inter-layer or inter-view prediction for an inter-layer or inter-view video coding system is disclosed. The method includes receiving a to-be-processed block in the EL or the EV, determining a collocated block in the BL (Base layer) or the BV (Base View), wherein the collocated block is located at a location in the BL or the BV corresponding to the to-be-processed block in the EL (Enhancement Layer) or in the EV (Enhancement view), deriving a predictor for the to-be-processed block in the EL or the EV from the collocated block in the BL or the BV based on pixel data of the BL or the BV, wherein the predictor corresponds to a linear function of pixel data in the collocated block, and encoding or decoding the to-be-processed block in the EL or the EV using the predictor. ## Claims ### Claim 1 A method of inter-layer or inter-view prediction for an inter-layer or inter-view video coding system, wherein video data is configured into a Base Layer (BL) and an Enhancement Layer (EL) for the inter-layer video coding system, and the video data is configured into a Base View (BV) and an Enhancement View (EV) for the inter-view video coding system, the method comprising: receiving a to-be-processed block in the EL or the EV; determining a collocated block in the BL or the BV, wherein the collocated block is located at a location in the BL or the BV corresponding to the to-be-processed block in the EL or in the EV; deriving a predictor for the to-be-processed block in the EL or the EV from the collocated block in the BL or the BV based on pixel data of the BL or the BV, wherein the predictor corresponds to a linear function of pixel data in the collocated block according to P′EL/EV(x,y)=αP′BL/BV(x,y)+β, wherein P′EL/EV(x,y) corresponds to the predictor for the to-be-processed block in the EL or the EV, P′BL/BV(x,y) corresponds to the pixel data of the collocated block in the BL or the BV, and α and β are parameters, and wherein α and β are derived based on a least-squares method using two pixel sets corresponding to a prediction set (PS) associated with the EL or the EV and a collocated set (CS) associated with the BL or the BV, wherein the PS is formed by first boundary pixels above the to-be-predicted block of the EL or the EV, and second boundary pixels adjacent to the left of the to-be-predicted block of the EL or the EV, and the CS is formed by third boundary pixels above the collocated block of the BL or the BV, and fourth boundary pixels to the left of the collocated block of the BL or the BV; and encoding or decoding the to-be-processed block in the EL or the EV using the predictor. ### Claim 2 (depends on 1) The method of claim 1, wherein the location of the collocated block in the BV corresponding to the to-be-processed block in the EV is derived based on depth information of the BV, the EV or both the BV and the EV. ### Claim 3 (depends on 1) The method of claim 1, wherein the collocated block is up-sampled before applying the linear function if the BL or the BV has lower spatial resolution than the EL or the EV. ### Claim 4 (depends on 3) The method of claim 3, wherein the PS is formed by first boundary pixels above the to-be-predicted block of the EL or the EV, and second boundary pixels adjacent to the left of the to-be-predicted block of the EL or the EV, and the CS is formed by sampling third boundary pixels above the collocated block of the BL or the BV, and sampling fourth boundary pixels to the left of the collocated block of the BL or the BV. ### Claim 5 (depends on 4) The method of claim 4, wherein sampling positions of the CS depend on spatial resolution ratio of the EL to the BL or the spatial resolution ratio of the EV to the BV, or the sampling positions of the CS depend on depth information of the BV, the EV or both of the BV and the EV. ### Claim 6 (depends on 5) The method of claim 5, wherein the sampling positions of the CS correspond to integer positions of the BL or the BV if the EL or the EV has lower spatial resolution than the BL or the BV. ### Claim 7 (depends on 4) The method of claim 4, wherein sampling positions of the PS depend on spatial resolution ratio of the EL to the BL, or the spatial resolution ratio of the EV to the BV. ### Claim 8 (depends on 4) The method of claim 4, wherein sampling positions of the PS and the CS are the same. ### Claim 9 (depends on 4) The method of claim 4, wherein a sampling filter is applied to the PS, the CS or both before said deriving the predictor for the to-be-processed block in the EL or the EV based on pixel data of the BL or the BV. ### Claim 10 (depends on 9) The method of claim 9, wherein two first sampling filters are applied to the first boundary pixels and the second boundary pixels separately, two second sampling filters are applied to the third boundary pixels and the fourth boundary pixels separately, or said two first sampling filters are applied to the first boundary pixels and the second boundary pixels separately and said two second sampling filters are applied to the third boundary pixels and the fourth boundary pixels separately. ### Claim 11 (depends on 1) The method of claim 1, wherein a flag is signaled in a layer level, a picture level, a slice level, a coding unit level, or a prediction unit level to indicate whether the predictor is used for the to-be-processed block in the EL or the EV. ### Claim 12 (depends on 1) The method of claim 1, wherein a flag is signaled to indicate whether the to-be-processed block in the EL or the EV is processed based on the BL or the BV, or the to-be-processed block in the EL or the EV is processed using one of other prediction modes, said other prediction modes comprise Merge mode, Inter prediction mode, and Intra prediction modes, and the to-be-processed block corresponds to a prediction unit or a coding unit. ### Claim 13 (depends on 1) The method of claim 1, wherein the BL and the EL, or the BV and the EV correspond to a luma component, chroma component, or depth component of the video data. ### Claim 14 An apparatus of inter-layer or inter-view prediction for an inter-layer or inter-view video coding system, wherein video data is configured into a Base Layer (BL) and an Enhancement Layer (EL) for the inter-layer video coding system, and the video data is configured into a Base View (BV) and an Enhancement View (EV) for the inter-view video coding system, the apparatus comprising one or more electronic circuits or processor configured to: receive a to-be-processed block in the EL or the EV; determine a collocated block in the BL or the BV, wherein the collocated block is located at a location in the BL or the BV corresponding to the to-be-processed block in the EL or in the EV; derive a predictor for the to-be-processed block in the EL or the EV from the collocated block in the BL or the BV based on pixel data of the BL or the BV, wherein the predictor corresponds to a linear function of pixel data in the collocated block according to P′EL/EV(x,y)=αP′BL/BV(x,y)+β, wherein P′EL/EV(x,y) corresponds to the predictor for the to-be-processed block in the EL or the EV, P′BL/BV(x,y) corresponds to the pixel data of the collocated block in the BL or the BV, and α and β are parameters, and wherein α and β are derived based on a least-squares method using two pixel sets corresponding to a prediction set (PS) associated with the EL or the EV and a collocated set (CS) associated with the BL or the BV, wherein the PS is formed by first boundary pixels above the to-be-predicted block of the EL or the EV, and second boundary pixels adjacent to the left of the to-be-predicted block of the EL or the EV, and the CS is formed by third boundary pixels above the collocated block of the BL or the BV, and fourth boundary pixels to the left of the collocated block of the BL or the BV; and encode or decode the to-be-processed block in the EL or the EV using the predictor. ### Claim 15 (depends on 14) The apparatus of claim 14, wherein the collocated block is up-sampled before applying the linear function if the BL or the BV has lower spatial resolution than the EL or the EV. ### Claim 16 (depends on 15) The apparatus of claim 15, wherein the PS is formed by first boundary pixels above the to-be-predicted block of the EL or the EV, and second boundary pixels adjacent to the left of the to-be-predicted block of the EL or the EV, and the CS is formed by sampling third boundary pixels above the collocated block of the BL or the BV, and sampling fourth boundary pixels to the left of the collocated block of the BL or the BV. ### Claim 17 (depends on 14) The apparatus of claim 14, wherein a flag is signaled to indicate whether the to-be-processed block in the EL or the EV is processed based on the BL or the BV, or the to-be-processed block in the EL or the EV is processed using one of other prediction modes, said other prediction modes comprise Merge mode, Inter prediction mode, and Intra prediction modes, and the to-be-processed block corresponds to a prediction unit or a coding unit. ### Claim 18 A non-transitory computer readable medium storing a computer-executable program, the computer-executable program, when executed, causing a decoder to perform the following steps: receiving a to-be-processed block in an Enhancement Layer (EL) for an inter-layer video coding system or an Enhancement View (EV) for an inter-view video coding system; determining a collocated block in a Base Layer (BL) for the inter-layer video coding system or a Base View (BV) for an inter-view video coding system, wherein the collocated block is located at a location in the BL or the BV corresponding to the to-be-processed block in the EL or in the EV; deriving a predictor for the to-be-processed block in the EL or the EV from the collocated block in the BL or the BV based on pixel data of the BL or the BV, wherein the predictor corresponds to a linear function of pixel data in the collocated block according to P′EL/EV(x,y)=αP′BL/BV(x,y)+β, wherein P′EL/EV(x,y) corresponds to the predictor for the to-be-processed block in the EL or the EV, P′BL/BV(x,y) corresponds to the pixel data of the collocated block in the BL or the BV, and α and β are parameters, and wherein α and β are derived based on a least-squares method using two pixel sets corresponding to a prediction set (PS) associated with the EL or the EV and a collocated set (CS) associated with the BL or the BV, wherein the PS is formed by first boundary pixels above the to-be-predicted block of the EL or the EV, and second boundary pixels adjacent to the left of the to-be-predicted block of the EL or the EV, and the CS is formed by third boundary pixels above the collocated block of the BL or the BV, and fourth boundary pixels to the left of the collocated block of the BL or the BV; and decoding the to-be-processed block in the EL or the EV using the predictor.