Depth map re-projection on user electronic devices

An extended reality (XR) display device comprising:

• a transceiver;
• one or more displays;
• one or more non-transitory computer-readable storage media including instructions;
• and
• one or more processors coupled to the storage media, the one or more processors configured to execute the instructions to:
• render, on one or more displays of the XR display device, a first sequence of image frames based on image data received from an external electronic device associated with the XR display device;
• detect an interruption to the image data received from the external electronic device associated with the XR display device;
• access a plurality of feature points from a depth map corresponding to the first sequence of image frames, wherein the plurality of feature points comprises movement and position information of one or more objects within the first sequence of image frames;
• perform a re-warping to at least partially re-render the one or more objects based at least in part on the plurality of feature points and spatiotemporal data;
• and
• render, on the one or more displays of the XR display device, a second sequence of image frames corresponding to the partial re-rendering of the one or more objects.

A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors of an extended reality (XR) display device, cause the one or more processors to:

• render, on one or more displays of the XR display device, a first sequence of image frames based on image data received from an external electronic device associated with the XR display device;
• detect an interruption to the image data received from the external electronic device associated with the XR display device;
• access a plurality of feature points from a depth map corresponding to the first sequence of image frames, wherein the plurality of feature points comprises movement and position information of one or more objects within the first sequence of image frames;
• perform a re-warping to at least partially re-render the one or more objects based at least in part on the plurality of feature points and spatiotemporal data;
• and
• render, on the one or more displays of the XR display device, a second sequence of image frames corresponding to the partial re-rendering of the one or more objects.

A method comprising, by an electronic device:

• generating image data corresponding to a first sequence of image frames;
• accessing a depth map corresponding to the first sequence of image frames;
• determining a plurality of feature points from the depth map corresponding to the first sequence of image frames based at least in part on parametric data reduction (PDR), wherein the plurality of feature points comprises movement and position information of one or more objects within the first sequence of image frames;
• and
• sending the image data and the plurality of feature points to an extended reality (XR) display device that is external to the electronic device.

An electronic device comprising:

• a transceiver;
• one or more non-transitory computer-readable storage media including instructions;
• and
• one or more processors coupled to the storage media, the one or more processors configured to execute the instructions to:
• generate image data corresponding to a first sequence of image frames;
• access a depth map corresponding to the first sequence of image frames;
• determine a plurality of feature points from the depth map corresponding to the first sequence of image frames based at least in part on parametric data reduction (PDR), wherein the plurality of feature points comprises movement and position information of one or more objects within the first sequence of image frames;
• and
• send the image data and the plurality of feature points to an extended reality (XR) display device that is external to the electronic device.

A non-transitory computer-readable medium comprising instructions that, when executed by one or more processors of an electronic device, cause the one or more processors to:

• generate image data corresponding to a first sequence of image frames;
• access a depth map corresponding to the first sequence of image frames;
• determine a plurality of feature points from the depth map corresponding to the first sequence of image frames based at least in part on parametric data reduction (PDR), wherein the plurality of feature points comprises movement and position information of one or more objects within the first sequence of image frames;
• and
• send the image data and the plurality of feature points to an extended reality (XR) display device that is external to the electronic device.