Real-time animation motion capture

A non-transitory computer-readable medium containing computer program code that, when executed by operation of one or more computer processors, performs an operation comprising:

• configuring a recording aspect of a first take object through a selection of a first sensor data type and a second sensor data type within a take object region of a user interface, wherein the first sensor data type is different from the second sensor data type, and wherein the first take object is a unified and parameterized data object configured to combine and synchronize first data of the first sensor data type with second data of the second sensor data type;
• initiating, through selection of a graphic element of the user interface and for a first performance in a physical environment, simultaneous capture of first sensor data from a first sensor and second sensor data from a second sensor based on the selection of the first and second sensor data types, respectively:
• responsive to the selection of the graphic element, transitioning the user interface to an armed state for locking one or more recording attributes used for recording the first and second sensor data to generate combined captured sensor data including facial movement capture data and from the first sensor and body movement capture data from the second sensor, wherein the one or more recording attributes include at least one of (a) a character for which the combined recorded data should be used, (b) a recording path defining where the combined recorded data will be stored, (c) a display name for the first take object, (d) an audio selection for the first take object, (e) an indication to output the audio selection in the physical environment during recording of the first and second sensor data, and (f) an indication that the first and second sensor data will be recorded for the first take object;
• synchronizing the captured first sensor data with the captured second data to generate synchronized data that aligns a first data stream of the captured first sensor data with a second data stream of the captured second sensor data:
• storing the synchronized data as the first take object including at least one first motion capture element from the first performance;
• displaying an indication of the first take object on a timeline;
• generating an animatic based on the first take object;
• and
• generating an animation based on (a) the animatic, and (b) a modified take object created (i) by adding a second motion capture element from a second performance included in a second take object different from the first take object, or (ii) by replacing the first motion capture element with the second motion capture element.

A system comprising:

• one or more computer processors;
• and
• a memory containing a program which, when executed by the one or more computer processors, performs an operation, the operation comprising:
• configuring a recording aspect of a first take object through a selection of a first sensor data type and a second sensor data type within a take object region of a user interface, wherein the first sensor data type is different from the second sensor data type, and wherein the first take object is a unified and parameterized data object configured to combine and synchronize first data of the first sensor data type with second data of the second sensor data type;
• initiating, through selection of a graphic element of the user interface and for a first performance in a physical environment, simultaneous capture of first sensor data from a first sensor and second sensor data from a second sensor based on the selection of the first and second sensor data types, respectively;
• responsive to the selection of the graphic element, transitioning the user interface to an armed state for locking one or more recording attributes used for recording the first and second sensor data to generate combined captured sensor data including facial movement capture data from the first sensor and body movement capture data from the second sensor, wherein the one or more recording attributes include at least one of (a) a character for which the combined recorded data should be used, (b) a recording path defining where the combined recorded data will be stored, (c) a display name for the first take object, (d) an audio selection for the first take object, (e) an indication to output the audio selection in the physical environment during recording of the first and second sensor data, and (f) an indication that the first and second sensor data will be recorded for the first take object;
• synchronizing the captured first sensor data with the captured second data to generate synchronized data that aligns a first data stream of the captured first sensor data with a second data stream of the captured second sensor data;
• storing the synchronized data as the first take object including at least one first motion capture element from the first performance;
• displaying an indication of the first take object on a timeline;
• generating an animatic based on the first take object;
• and
• generating an animation based on (a) the animatic, and (b) a modified take object created (i) by adding a second motion capture element from a second performance included in a second take object different from the first take object, or (ii) by replacing the first motion capture element with the second motion capture element.