A system to automate match moving in a visual effects (VFX) process to insert computer graphics into live action footage for principal photography, the system comprising:
- a recording device comprising a first user interface showing the live action footage, wherein the recording device is a motion-capturing camera, that during system operation, is configured to be physically in motion during the live action footage for the principal photography during a period of the principal photography;
- a user device comprising a second user interface configured wherein the user device is mechanically connected to the recording device, wherein the user device is a smart device comprising a sensor array, wherein the sensor array captures at least a three-dimensional motion data, orientation data, and a velocity vector data of the recording device when the recording device is in motion and is capturing the live action footage for the principal photography;
- an attachment member configured to mechanically, adjustably, but not electronically, couple the user device to the recording device at a distance from the recording device so that when the recording device is in motion and is in the process of capturing the live action footage, the user device is also in motion via the attachment member;
- a server comprising a processor and a memory in communication with the processor, wherein the user device is in communication with the server, and wherein the server is configured to store a set of program modules executable by the processor and receive inputs and outputs from the user device, the program modules comprising:
- an input module for receiving input data from the user device regarding a lens profile of the recording device, the orientation of the user device with respect to the recording device, and the distance of the user device from the recording device;
- a calibration module configured to receive the data regarding the lens profile of the recording device, the orientation of the user device with respect to the recording device, and the distance of the user device from the recording device, and further receive the orientation data of the recording device, the three-dimensional motion data and the velocity vector data of the recording device using based on a changing position of the recording device and the user device over time, and continuously calibrate a position of the recording device during a recording session;
- a recorder module for receiving the orientation data, the three-dimensional motion data and the velocity vector data from the user device via the sensor array;
- a conversion module configured to combine the data regarding the lens profile of the recording device, the orientation of the user device with respect to the recording device, and the distance of the user device from the recording device, the orientation data of the recording device, the three-dimensional motion data and velocity vector data of the recording device based on a changing position of the recording device during the live action footage and the user device over time to form a combined data file comprising the lens profile, the orientation of the user device with respect to the recording device, the device using, the distance of the user device from the recording device, the orientation data of the recording device, the three-dimensional motion data and velocity vector data of the recording device based on a changing position of the recording device and the use device during the live action footage;
- a composite module configured use the combined data file and transform the data to a file format in response to a user input, wherein the composite module is configured to use the file format to produce an accurate three-dimensional match moving solve directly from the principal photography and to further automate the match moving process to insert the composite image into the principal photography.