Method and Apparatus of Transform Selection Depending on Intra Prediction Mode in Video Coding System

Abstract

A method and apparatus for video coding. According to this method, input data associated with a current block are received, wherein the input data comprise residual data to be processed at an encoder side or coded transform data associated with the current block to be decoded at a decoder side. Transform process is applied to the input data, wherein the transform process determines a target transform for the current block. The target transform is selected from a transform candidate set including at least one additional transform candidate with respect to an original transform candidate set or the target transform is determined depending on an intra prediction mode associated with the current block, a reference region, or one or more neighbouring blocks. Transformed output is provided, wherein the transformed output comprises transform coefficients of the current block at the encoder side or recovered residual data at the decoder side.

Dependencies are inferred from the claim text.