Adaptive Quantization Matrix for Extended Reality Video Encoding

A non-transitory computer readable medium, comprising computer code executable by at least one processor to:

• obtain an extended reality (XR) video frame comprising a background image and a virtual object overlaying at least a portion of the background image;
• divide the XR video frame into a virtual region and a real region, wherein the virtual region comprises at least a portion of the virtual object, and wherein the real region comprises a region of the background image separate from the virtual region;
• determine, for the virtual region, a corresponding first quantization parameter based on an initial quantization parameter associated with virtual regions;
• determine, for the real region, a corresponding second quantization parameter based on an initial quantization parameter associated with real regions;
• and
• encode the virtual region based on the corresponding first quantization parameter and the real region based on the corresponding second quantization parameter.

A device, comprising:

• an image capturing device configured to capture a background image;
• at least one processor;
• and
• at least one computer readable media comprising computer readable code executable by the at least one processor to:
• obtain an extended reality (XR) video frame comprising the background image and a virtual object overlaying at least a portion of the background image;
• divide the XR video frame into a virtual region and a real region, wherein the virtual region comprises at least a portion of the virtual object, and wherein the real region comprises a region of the background image separate from the virtual region;
• determine, for the virtual region, a corresponding first quantization parameter based on an initial quantization parameter associated with virtual regions;
• determine, for the real region, a corresponding second quantization parameter based on an initial quantization parameter associated with real regions;
• and
• encode the virtual region based on the corresponding first quantization parameter and the real region based on the corresponding second quantization parameter.