Three-dimensional (3d) reconstructions of dynamic scenes using a reconfigurable hybrid imaging system

A computer-implemented system, comprising:

• a memory storage comprising instructions for a three-dimensional (3D) reconstruction of a dynamic scene;
• and
• one or more hardware processors in communication with the memory storage, wherein the one or more hardware processors execute the instructions to:
• receive a plurality of color image sequences from a plurality of color imaging sensors, and at least one depth image sequence from at least one depth imaging sensor, wherein a color imaging sensor quantity is larger than a depth imaging sensor quantity;
• generate a plurality of calibrated color image sequences and at least one calibrated depth image sequence based on the plurality of color imaging sequences and the at least one depth image sequence;
• construct a plurality of initial 3D patches using the plurality of calibrated color image sequences and the at least one calibrated depth image sequence;
• and
• generate a 3D patch cloud by expanding the plurality of initial 3D patches.

A non-transitory computer-readable medium storing computer instructions for a three-dimensional (3D) reconstruction of a dynamic scene which, when executed by one or more hardware processors, cause the one or more hardware processors to perform operations comprising:

• receiving a plurality of color image sequences from a plurality of color imaging sensors, and at least one depth image sequence from at least one depth imaging sensor, wherein a color imaging sensor quantity is larger than a depth imaging sensor quantity;
• generating a plurality of calibrated color image sequences and at least one calibrated depth image sequence based on the plurality of color imaging sequences and the at least one depth image sequence;
• constructing a plurality of initial 3D patches using the plurality of calibrated color image sequences and the at least one calibrated depth image sequence;
• and
• generating a 3D patch cloud by expanding the plurality of initial 3D patches.