Light field capture, compression, transmission and reconstruction

A method for displaying and distributing recorded data, comprising:

• capturing, by an imaging system, color data, depth data, and auxiliary data associated with a target scene, wherein the color data is represented in a Bayer pattern, and wherein the Bayer pattern includes a blue channel, two green channels, and a red channel;
• compressing the color data, the depth data, and the auxiliary data, wherein compressing the color data comprises:
• splitting each of the color data represented in the Bayer pattern into four individual color planes;
• forming at least one set of data by combining the four individual color planes;
• and
• compressing the at least one set of data using one or more compression techniques;
• and
• constructing, by the imaging system, a three-dimensional representation of the target scene based on the color data, the depth data, and the auxiliary data.

A non-transitory computer program medium having code stored thereon, the code, when executed by one or more processors, causing the one or more processors to:

• capture color data, depth data, and auxiliary data associated with a target scene, wherein the color data of the target scene represented in a Bayer pattern, wherein the Bayer pattern includes a blue channel, two green channels, and a red channel, and wherein the depth data comprises a point cloud dataset of the target scene;
• compress the color data, the depth data, and the auxiliary data, wherein compressing the color data comprises:
• splitting the color data represented in the Bayer pattern into four individual color planes;
• forming at least one set of data by combining the four individual color planes;
• and
• compressing the at least one set of data using one or more compression techniques;
• and
• construct a three-dimensional representation of the target scene based on the color data, the depth data, and the auxiliary data.

A non-transitory computer program medium of having code stored thereon, the code, when executed by the one or more processors, causing the one or more processors to:

• capture color data. depth data, and auxiliary data associated with a target scene, wherein the color data of the target scene represented in a Bayer pattern, wherein the Bayer pattern includes a blue channel, two green channels, and a red channel, and wherein the depth data comprises a point cloud dataset of the target scene;
• quantize the point cloud dataset into a three-dimensional volume having X units in width, Y units in length, and Z units in depth, X, Y, and Z being non-negative integers;
• and
• store the point cloud dataset in an image data format having a width of X and a height of Y, and wherein each pixel of the image data format is represented using N bits, N being greater than or equal to [[log]2(Z)];
• compress the color data, the depth data, and the auxiliary data;
• and
• construct a three-dimensional representation of the target scene based on the color data, the depth data, and the auxiliary data.

A method for displaying and distributing recorded data, comprising:

• capturing color data, depth data, and auxiliary data associated with a target scene, wherein the color data is represented in a Bayer pattern, and wherein the Bayer pattern includes a blue channel, two green channels, and a red channel;
• compressing the color data, the depth data, and the auxiliary data, wherein compressing the color data comprises:
• splitting each of the color data represented in the Bayer pattern into four individual color planes;
• forming at least one set of data by combining the four individual color planes;
• and
• compressing the at least one set of data using one or more compression techniques;
• and
• constructing a three-dimensional representation of the target scene based on the color data, the depth data, and the auxiliary data.