Framework for efficient generation and streaming of augmented frames of colors and depth data

A system comprising:

• a first electronic device, wherein the first electronic device is configured to,
• generate or receive image data, wherein the image data comprises a first frame having a first predetermined number of bits, wherein the first frame comprises color information associated with pixels of an image;
• generate or receive depth information, wherein the depth information comprises a distance of each of the pixels from a reference point;
• generate an augmented frame based on the image data and based on the depth information, wherein the augmented frame comprises a color frame portion and a frame extension attached to the color frame portion;
• and
• encode the augmented frame with an encoder to generate an encoded frame;
• wherein the color frame portion has a number of bits equivalent to the first predetermined number of bits comprises the color information associated with the pixels of the image;
• and
• wherein the frame extension has a number of bits equivalent to the first predetermined number of bits, and comprises the depth information associated with the pixels of the image.

A computer-readable memory having instructions stored thereon, the instructions executable by a processor to:

• generate or receive data of an image, wherein the image data comprises a first frame having a first predetermined number of bits, wherein the first frame comprises color information associated with pixels of the image;
• generate or receive depth information, wherein the depth information comprises the distance of each of the pixels of the image from a reference point;
• generate an augmented frame based on the image data and based on the depth information, wherein the augmented frame comprises a color frame portion and a frame extension attached to the color frame portion;
• and
• encode the augmented frame with an encoder to generate an encoded frame;
• wherein the color frame portion has a number of bits equivalent to the first predetermined number of bits and comprises the color information associated with the pixels of the image;
• and
• wherein the frame extension has a number of bits equivalent to the first predetermined number of bits and comprises the depth information associated with the pixels of the image.