Method of multiple quantization matrix sets for video coding

A method of processing transform blocks of video data performed by a video encoder or a video decoder, the method comprising:

• deriving a quantization matrix set based on quantization setting for a previous picture, wherein the quantization matrix set includes one or more quantization matrices corresponding to different block types;
• receiving input data associated with a transform block corresponding to a current block in a current picture;
• and
• applying quantization process or de-quantization process to the transform block using a corresponding quantization matrix from the quantization matrix set.

An apparatus for processing transform blocks of video data performed by a video encoder or a video decoder, the apparatus comprising one or more electronic circuits or a processor configured to:

• determine a plurality of quantization matrix sets, wherein each quantization matrix set includes one or more quantization matrices corresponding to different block types;
• receive input data associated with a transform block corresponding to a current block in a current picture;
• determine a selected quantization matrix set from the plurality of quantization matrix sets for the transform block;
• and
• apply quantization process or de-quantization process to the transform block using a corresponding quantization matrix from the selected quantization matrix set.