Volumetric capture of objects with a single rgbd camera

A non-transitory computer-readable storage medium having stored thereon computer executable program code which, when executed on a computer system, causes the computer system to perform a method comprising:

• receiving a first image including color data and depth data;
• determining a viewpoint associated with an augmented reality (AR) and/or virtual reality (VR) display displaying a second image;
• receiving at least one calibration image including an object in the first image, the object being in a different pose as compared to a pose of the object in the first image;
• and
• generating the second image based on the first image, the viewpoint and the at least one calibration image.

An augmented reality (AR) and/or virtual reality (VR) system comprising:

• a sensor configured to capture color data and depth data;
• and
• a processor configured to:
• receive a first image from the sensor,
• receive a viewpoint from an AR and/or VR display displaying a second image,
• receive at least one calibration image including an object in the first image, the object being in a different pose as compared to a pose of the object in the first image, and
• generate the second image based on the first image, the viewpoint and the at least one calibration image.