Configurable neural network model depth in neural network-based video coding

An apparatus for coding video data comprising a processor and a non-transitory memory with instructions thereon, wherein the instructions upon execution by the processor cause the processor to:

• apply a neural network (NN) filter to an unfiltered sample of a video unit to generate a filtered sample, wherein the NN filter is based on a first NN filter model having a first depth, or a second NN filter model having a second depth, wherein the depth comprises a number of residual blocks of the respective NN filter model, and wherein the second depth is different than the first depth;
• and
• convert between a video media file and a bitstream based on the filtered sample,
• wherein the NN filter uses the first NN filter model for a first video unit in a first temporal layer or a first type of slice, and wherein the NN filter uses the second NN filter model for a second video unit in a second temporal layer or a second type of slice, and
• wherein the NN filter uses the first NN filter model for a third video unit in a third temporal layer, wherein the first temporal layer and the third temporal layer are in a same subgroup of temporal layers, and wherein the second temporal layer is in a different subgroup of temporal layers.

Method for storing a bitstream of a video, comprising:

• applying a neural network (NN) filter to an unfiltered sample of a video unit to generate a filtered sample, wherein the NN filter is based on a first NN filter model having a first depth, or a second NN filter model having a second depth, wherein the depth comprises a number of residual blocks of the respective NN filter model, and wherein the second depth is different than the first depth;
• generating the bitstream based on the filtered sample;
• and
• storing the bitstream in a non-transitory computer readable medium,
• wherein the NN filter uses the first NN filter model for a first video unit in a first temporal layer or a first type of slice, and wherein the NN filter uses the second NN filter model for a second video unit in a second temporal layer or a second type of slice, and
• wherein the NN filter uses the first NN filter model for a third video unit in a third temporal layer, wherein the first temporal layer and the third temporal layer are in a same subgroup of temporal layers, and wherein the second temporal layer is in a different subgroup of temporal layers.