Determining a camera control point for virtual production

A method for real-time camera model updating in a virtual production environment, comprising:

• initializing a camera model for a camera device that captures images of a scene, the camera model including extrinsic parameters, intrinsic parameters, and a distortion model;
• receiving motion capture data over time indicating current poses of the camera device;
• receiving current image data from the camera device;
• updating at least one of (i) a parameter of the camera model or (ii) the distortion model, based on the motion capture data and the current image data;
• and
• rendering content for display in the virtual production environment based on the update to the camera model.

One or more non-transitory computer-readable storage media storing instructions that, upon execution by one or more processors of a system, cause the system to perform operations comprising:

• initializing a camera model for a camera device that captures images of a scene, the camera model including extrinsic parameters, intrinsic parameters, and a distortion model;
• receiving motion capture data over time indicating current poses of the camera device;
• receiving current image data from the camera device;
• updating at least one of (i) a parameter of the camera model or (ii) the distortion model, based on the motion capture data and the current image data;
• and
• rendering content for display in a virtual production environment based on the update to the camera model.