Providing 3D data for messages in a messaging system

A system comprising:

• a processor;
• and
• a memory including instructions that, when executed by the processor, cause the processor to perform operations comprising:
• applying, to image data and depth data, a 3D effect based at least in part on an augmented reality content generator, the applying the 3D effect comprising:
• generating a depth map using at least the depth data,
• generating a packed depth map based at least in part on the depth map, the generating the packed depth map comprising:
• converting a single channel floating point texture to a raw depth map, the raw depth map having a lower resolution than the image data, and
• generating multiple channels based at least in part on the raw depth map,
• generating a segmentation mask based at least on the image data, and
• performing background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data, the performing the background inpainting comprising performing a diffusion based inpainting technique that fills in a missing region by propagating image content from a boundary between the missing region and a background region to an interior of the missing region, wherein the background region comprises a particular region of the image data without a foreground subject and the missing region includes the foreground subject.

A non-transitory computer-readable medium comprising instructions, which when executed by a computing device, cause the computing device to perform operations comprising:

• applying, to image data and depth data, a 3D effect based at least in part on an augmented reality content generator, the applying the 3D effect comprising:
• generating a depth map using at least the depth data,
• generating a packed depth map based at least in part on the depth map, the generating the packed depth map comprising:
• converting a single channel floating point texture to a raw depth map, the raw depth map having a lower resolution than the image data, and
• generating multiple channels based at least in part on the raw depth map,
• generating a segmentation mask based at least on the image data, and
• performing background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data, the performing the background inpainting comprising performing a diffusion based inpainting technique that fills in a missing region by propagating image content from a boundary between the missing region and a background region to an interior of the missing region, wherein the background region comprises a particular region of the image data without a foreground subject and the missing region includes the foreground subject.