Restriction on number of context coded bins

An apparatus for processing video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor, cause the processor to:

• divide, for a conversion between a block of a video and a bitstream of the block, contexts used for residual coding associated with the block into different groups of contexts, wherein the contexts used for residual coding are divided into the different groups of contexts based on an initial state of the contexts and/or a probability of the contexts;
• apply controls on the different groups of contexts separately;
• and
• perform the conversion based on the controls,
• wherein each of the different groups of contexts has a threshold to control whether a context coded method can be applied.

A non-transitory computer-readable recording medium storing a bitstream of a video which is generated by a method performed by a video processing apparatus, wherein the method comprises:

• dividing contexts used for residual coding associated with a block of the video into different groups of contexts;
• applying controls on the different groups of contexts separately;
• and
• generating the bitstream based on the controls,
• wherein the contexts used for residual coding are divided into the different groups of contexts based on an initial state of the contexts and/or a probability of the contexts, and
• wherein each of the different groups of contexts has a threshold to control whether a context coded method can be applied.