Deep learning based image partitioning for video compression

A device for video processing, comprising:

• a memory, and
• a processor, configured to:
• obtain an output of a first layer associated with a deep learning (DL) algorithm based on a block of image data and a causal pixel of the block;
• concatenate the output of the first layer with compression information associated with the block;
• input the concatenated output to a second layer associated with the DL algorithm;
• partition the block into a plurality of smaller blocks based on an output of the second layer;
• and
• predict the plurality of smaller blocks.

A method for video processing, comprising:

• obtaining an output of a first layer associated with a deep learning (DL) algorithm based on a block of image data and a causal pixel of the block;
• concatenating the output of the first layer with compression information associated with the block;
• inputting the concatenated output to a second layer associated with the DL algorithm;
• partitioning the block into a plurality of smaller blocks based on an output of the second layer;
• and
• predicting the plurality of smaller blocks.

A non-transitory computer readable medium containing program instructions that, when executed by a processor, cause the processor to perform a method comprising:

• obtaining an output of a first layer associated with a deep learning (DL) algorithm based on a block of image data and a causal pixel of the block;
• concatenating the output of the first layer with compression information associated with the block;
• inputting the concatenated output to a second layer associated with the DL algorithm;
• partitioning the block into a plurality of smaller blocks based on an output of the second layer;
• and
• predicting the plurality of smaller blocks.