# US 10,321,142 B2 · Method and apparatus for video encoding for adaptive illumination compensation, method and apparatus for video decoding for adaptive illumination compensation > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,321,142 B2 - Document ID: US10321142B2 - Status: Granted - Kind: B2 - Application number: 14/905,364 - Filed: 2014-07-15 - Published: 2016-05-26 - Granted: 2019-06-11 - Earliest claimed: 2013-07-15 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Min-woo Park; Jin-young Lee; Yong-jin Cho; Byeong-doo Choi - Web page: https://patentgrep.com/patent/US10321142B2 ## CPC - H04N 19/33: in the spatial domain - H04N 19/103: Selection of coding mode or of prediction mode - H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635) - H04N 19/136: Incoming video signal characteristics or properties - H04N 19/176: the region being a block, e.g. a macroblock - H04N 19/186: the unit being a colour or a chrominance component - H04N 19/187: the unit being a scalable video layer - H04N 19/44: Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder - H04N 19/59: involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution - H04N 19/82: involving filtering within a prediction loop - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An interlayer video decoding method includes: selecting a luminance compensation model to be applied to a first layer reference block and determining a luminance compensation parameter for the selected luminance compensation model; and compensating for luminance of the first layer reference block by using the luminance compensation parameter and reconstructing a second layer image comprising a second layer current block. The determining of the luminance compensation parameter comprises determining the luminance compensation parameter based on any one of a color component of the second layer current block, information about a type of a picture comprising the second layer current block, and a prediction mode of the second layer current block. ## Claims ### Claim 1 An interlayer video decoding method comprising: reconstructing a first layer image based on encoding information acquired from a first layer bitstream; reconstructing a second layer current block by using interlayer prediction information acquired from a second layer bitstream and a first layer reference block corresponding to the second layer current block that is to be reconstructed in a first layer reconstruction image; selecting a luminance compensation model to be applied to the first layer reference block and determining a luminance compensation parameter for the selected luminance compensation model; and compensating for luminance of the first layer reference block by using the luminance compensation parameter and reconstructing a second layer image comprising the second layer current block, wherein the determining of the luminance compensation parameter comprises determining the luminance compensation parameter based on any one of a color component of the second layer current block, information about a type of a picture comprising the second layer current block, and a prediction mode of the second layer current block. ### Claim 2 (depends on 1) The interlayer video decoding method of claim 1, wherein the selecting of the luminance compensation model and the determining of the luminance compensation parameter comprise: selecting any one of a first luminance compensation model and a second luminance compensation model, wherein the first luminance compensation model is configured to compensate for luminance of the first layer reference block by determining a scale factor and a first offset and by adding the first offset to a value that is produced by multiplying each pixel value of the first layer reference block and the scale factor, and the second luminance compensation model is configured to compensate for the luminance of the first layer reference block by determining a second offset and adding the second offset to each pixel value of the first layer reference block; determining the scale factor and the first offset when the first luminance compensation model is selected; and determining the second offset when the second luminance compensation model is selected. ### Claim 3 (depends on 2) The interlayer video decoding method of claim 2, wherein the selecting of the luminance compensation model comprises selecting the first luminance compensation model when the color component of the second layer current block is a luma component and selecting the second luminance compensation model when the color component of the second layer current block is a chroma component. ### Claim 4 (depends on 2) The interlayer video decoding method of claim 2, wherein the selecting of the luminance compensation model comprises selecting the first luminance compensation model when the second layer current block is a block comprised in a texture picture and selecting the second luminance compensation model when the second layer current block is a block comprised in a depth map picture. ### Claim 5 (depends on 2) The interlayer video decoding method of claim 2, wherein the selecting of the luminance compensation model comprises selecting the first luminance compensation model when the prediction mode of the second layer current block is not a view synthesis prediction mode and selecting the second luminance compensation model when the prediction mode of the second layer current block is the view synthesis prediction mode. ### Claim 6 (depends on 2) The interlayer video decoding method of claim 2, wherein the selecting of the luminance compensation model comprises selecting the second luminance compensation model when any one of conditions is satisfied and selecting the first luminance compensation model when all of the conditions are not satisfied, wherein the conditions are that the color component of the second layer current block is a chroma component, the second layer current block is a block comprised in a depth map picture, and the prediction mode of the second layer current block is a view synthesis prediction mode. ### Claim 7 An interlayer video decoding method comprising: reconstructing a first layer image based on encoding information acquired from a first layer bitstream; reconstructing a second layer current block by using interlayer prediction information acquired from a second layer bitstream and a first layer reference block corresponding to the second layer current block that is to be reconstructed in a first layer reconstruction image; determining a luminance compensation parameter to be applied to the first layer reference block; and compensating for luminance of the first layer reference block by using the luminance compensation parameter and reconstructing a second layer image comprising the second layer current block, wherein, the determining of the luminance compensation parameter comprises, when the first layer reference block is located outside a boundary of the first layer reconstruction image, replacing a region outside the boundary and peripheral pixels of the region with pixels that are located inside the boundary of the first layer reconstruction image, and wherein the determining of the luminance compensation parameter further comprises determining the luminance compensation parameter based on any one of a color component of the second layer current block, information about a type of a picture comprising the second layer current block, and a prediction mode of the second layer current block. ### Claim 8 (depends on 7) The interlayer video decoding method of claim 7, wherein the replacing comprises padding pixels by replacing a section, ranging from the boundary of the first layer reconstruction image to an outer region of a boundary of the first layer reference block, with pixels that are located on the boundary of the first layer reconstruction image. ### Claim 9 An interlayer video encoding method comprising: generating a first layer bitstream comprising encoding information generated by encoding a first layer image; reconstructing a second layer current block by using a first layer reference block corresponding to the second layer current block to be reconstructed in a first layer reconstruction image; selecting a luminance compensation model to be applied to the first layer reference block and determining a luminance compensation parameter for the selected luminance compensation model; and generating a second layer bitstream comprising interlayer prediction information between the first layer reference block and the second layer current block of which luminance is to be compensated for by using the luminance compensation parameter, wherein the determining of the luminance compensation parameter comprises determining the luminance compensation parameter based on any one of a color component of the second layer current block, information about a type of a picture comprising the second layer current block, and a prediction mode of the second layer current block. ### Claim 10 (depends on 9) The interlayer video encoding method of claim 9, wherein the determining of the luminance compensation parameter comprises: selecting any one of a first luminance compensation model and a second luminance compensation model, wherein the first luminance compensation model is configured to compensate for luminance of the first layer reference block by determining a scale factor and a first offset and by adding the first offset to a value that is produced by multiplying each pixel value of the first layer reference block and the scale factor, and the second luminance compensation model is configured to compensate for the luminance of the first layer reference block by determining a second offset and adding the second offset to each pixel value of the first layer reference block; determining the scale factor and the first offset when the first luminance compensation model is selected; and determining the second offset when the second luminance compensation model is selected. ### Claim 11 (depends on 10) The interlayer video encoding method of claim 10, wherein selecting of the luminance compensation model comprises selecting the second luminance compensation model when any one of conditions is satisfied and selecting the first luminance compensation model when all of the conditions are not satisfied, wherein the conditions are that the color component of the second layer current block is a chroma component, the second layer current block is a block comprised in a depth map picture, and the prediction mode of the second layer current block is a view synthesis prediction mode. ### Claim 12 An interlayer video encoding method comprising: reconstructing a first layer image based on encoding information acquired from a first layer bitstream; reconstructing a second layer current block by using interlayer prediction information acquired from a second layer bitstream and a first layer reference block corresponding to the second layer current block to be reconstructed in a first layer reconstruction image; determining a luminance compensation parameter to be applied to the first layer reference block; and reconstructing a second layer image comprising the second layer current block by compensating for luminance of the first layer reference block by using the luminance compensation parameter, wherein the determining of the luminance compensation parameter comprises, when the first layer reference block is located outside a boundary of the first layer reconstruction image, replacing a region outside the boundary and peripheral pixels of the region with pixels that are located inside the boundary of the first layer reconstruction image, and wherein the determining of the luminance compensation parameter further comprises determining the luminance compensation parameter based on any one of a color component of the second layer current block, information about a type of a picture comprising the second layer current block, and a prediction mode of the second layer current block. ### Claim 13 (depends on 12) The interlayer video encoding method of claim 12, wherein the replacing comprises replacing a section, ranging from the boundary of the first layer reconstruction image to an outer region of a boundary of the first layer reference block, with pixels that are located on the boundary of the first layer reconstruction image and padding the pixels. ### Claim 14 An interlayer video decoding apparatus comprising: a first layer decoder configured to reconstruct a first layer image based on encoding information acquired from a first layer bitstream; a second layer decoder configured to reconstruct a second layer current block by using interlayer prediction information acquired from a second layer bitstream and a first layer reference block corresponding to the second layer current block that is to be reconstructed in a first layer reconstruction image; and a luminance compensation determiner configured to select a luminance compensation model to be applied to the first layer reference block and determine a luminance compensation parameter for the selected luminance compensation model, wherein the luminance compensation determiner is further configured to determine the luminance compensation parameter based on any one of a color component of the second layer current block, information about a type of a picture comprising the second layer current block, and a prediction mode of the second layer current block, and the second layer decoder is further configured to compensate for luminance of the first layer reference block by using the luminance compensation parameter and reconstruct a second layer image comprising the second layer current block. ### Claim 15 An interlayer video encoding apparatus comprising: a first layer encoder configured to generate a first layer bitstream comprising encoding information generated by encoding a first layer image; a second layer encoder configured to reconstruct a second layer current block by using a first layer reference block corresponding to the second layer current block to be reconstructed in a first layer reconstruction image; and a luminance compensation determiner configured to select a luminance compensation model to be applied to the first layer reference block and determine a luminance compensation parameter for the selected luminance compensation model, wherein the luminance compensation determiner is further configured to determine the luminance compensation parameter based on any one of a color component of the second layer current block, information about a type of a picture comprising the second layer current block, and a prediction mode of the second layer current block, and the second layer encoder is further configured to generate a second layer bitstream comprising interlayer prediction information between the first layer reference block and the second layer current block of which luminance is compensated for by using the luminance compensation parameter.