US 12,573,069 B2 · Systems and methods for generating and coding multiple focal planes from texture and depth

Abstract

System and methods are provided for using multi-format representation and coding of visual information. The system accesses an image data that comprises a texture data and a depth map; decomposes the depth map into a plurality of component depth maps (CDMs); and generates multiple focal planes (MFPs) comprising a plurality of focal planes. Each respective focal plane is based on the texture data and a respective CDM of the plurality of CDMs. The system selects a data subset including one or more of: (a) the texture data, (b) the depth map, (c) the plurality of CDMs, or (d) the plurality of focal planes; generates encoded data based on the selected data subset; and transmits, over a communication network, the encoded data to a client device to cause the client device to: generate for display or for further processing an image based on the encoded data.

Claims20

Dependent claims

A method comprising:

accessing image data that comprises texture data and a depth map;
decomposing the depth map into a plurality of component depth maps (CDMs);
generating, from the texture data and the CDMs, a plurality of multiple focal plane (MFP) data structures, wherein each MFP data structure is produced by pixel-wise combining the texture data with a respective CDM;
generating, from the depth map and the CDMs, a plurality of CDM-weighted depth plane (CDMFP) data structures;
selecting, based on a selection criterion, a data subset from among:
(a) the texture data, (b) the depth map, (c) the plurality of CDMs, (d) the plurality of MFP data structures, or (e) the plurality of CDMFP data structures;
generating encoded data based on the selected data subset to produce encoded data;
and
transmitting, over a communication network, the encoded data to a client device to cause the client device to generate for display an image based on the encoded data.

6 more elements

A system comprising:

control circuitry configured to:
access image data that comprises texture data and a depth map;
decompose the depth map into a plurality of component depth maps (CDMs);
generate, from the texture data and the CDMs, a plurality of multiple focal planes (MFP) data structures, wherein each MFP data structure is produced by pixel-wise combining the texture data with a respective CDM;
generate, from the depth map and the CDMs, a plurality of CDM-weighted depth plane (CDMFP) data structures;
select, based on a selection criterion, a data subset from among:
(a) the texture data, (b) the depth map, (c) the plurality of CDMs, (d) the plurality of MFP data structures, or (e) the plurality of CDMFP data structures;
and
generate encoded data based on the selected data subset to produce encoded data;
and
input/output circuitry configured to:
transmit, over a communication network, the encoded data to a client device to cause the client device to generate for display an image based on the encoded data.

9 more elements

Dependencies are inferred from the claim text.

Systems and methods for generating and coding multiple focal planes from texture and depth

Life of this patent

Systems and methods for generating and coding multiple focal planes from texture and depth

Life of this patent

Abstract

Claims20