Systems and methods for capturing, transporting, and reproducing three-dimensional simulations as interactive volumetric displays
AssigneeLiv, Inc.
InventorsJaroslav Stehlik, Alexander Brook Perry, Arthur Louis Brainville, Steffan Robert William Donal, Bunta Adrian-Nicolae, Omar Mohamed Ali Mudhir, Ajinyad Karwan Shewki
Life of this patent
Estimating the term…
Abstract
A system, method, and device are provided for creating a data processing pipeline to capture, transport, and interactively display in both recorded and real time any 3D volumetric simulation that was generated by a separate application. The system, method, and device enabling the interactive viewing of virtual and mixed reality simulations by a plurality of users.
Claims9
A method for processing simulated 3D volumetric environment data so that the simulated 3D volumetric environment can be played back and viewed interactively by at least one final user, the method using a plurality of capture cameras, the method comprising:
- (a) capturing from the simulated 3D volumetric environment at least the following data in a format using time tags:
- (i) intrinsic data from each of the capture cameras on a frame-by-frame basis,
- (ii) extrinsic data from each of the capture cameras on a frame-by-frame basis,
- (iii) color data from each of the capture cameras on a frame-by-frame basis,
- (iv) depth data from each of the capture cameras on a frame-by-frame basis, and
- (v) ambient audio;
- (b) compressing the time-tagged data captured in step (a) by:
- (i) compressing the frame-by-frame intrinsic and extrinsic color and depth data from each camera and
- (ii) compressing the ambient audio;
- and
- (c) preparing the time-tagged data compressed in step (b) for playback and viewing by the at least one final user by:
- (i) tessellate shading each camera frame as a grid of uniformly spaced unconnected quadratures,
- (ii) converting each of the quadratures into a specific location within the simulated 3D volumetric environment, and
- (iii) positioning each vertex of the quadratures in the 3D volumetric environment based on an X/Y position of each vertex of the quadratures in each camera's frame and depth, the depth being determined using the depth data for each frame,
- thereby enabling the simulated 3D volumetric environment to be played back and viewed interactively by the at least one final user.
Dependencies are inferred from the claim text.