Plate reconstruction of obscured views of captured imagery using arbitrary captured inputs
AssigneeWeta Digital Limited
InventorsKimball D. Thurston, III, Peter M. Hillman
Life of this patent
Estimating the term…
Abstract
An imagery processing system obtains capture inputs from capture devices that might have capture parameters and characteristics that differ from those of a main imagery capture device. By normalizing outputs of those capture devices, potentially arbitrary capture devices could be used for reconstructing portions of a scene captured by the main imagery capture device when reconstructing a plate of the scene to replace an object in the scene with what the object obscured in the scene. Reconstruction could be of one main image, a stereo pair of images, or some number, N, of images where N>2.
Claims20
A computer-implemented method of reconstructing a plate by processing images of a scene from a main imaging device using capture device inputs from capture devices recording the same scene, the method comprising:
- receiving reference stage parameters and normalization parameters associated with the capture devices;
- storing the normalization parameters;
- receiving main input from the main imaging device, including a primary object that is at least partially obscuring an obscured object;
- receiving the capture device inputs from the capture devices;
- normalizing the capture device inputs using normalization parameters to form normalized captured inputs;
- identifying a plate for reconstruction that includes the primary object;
- aligning two or more normalized captured inputs;
- obtaining reconstruction selections in the identified plate to remove the primary object from the plate;
- and
- reconstructing the plate based on the selections, the normalized aligned captured inputs, and the reconstruction selections to form a reconstructed plate showing the portions of the obscured object that were obscured by the primary object.
An apparatus for reconstructing a plate by processing images of a scene from a main imaging device using capture device inputs from capture devices recording the same scene, the apparatus comprising:
- one or more processors;
- one or more non-transitory processor-readable media including instructions executable by the one or more processors for:
- receiving reference stage parameters and normalization parameters associated with the capture devices;
- storing the normalization parameters;
- receiving main input from the main imaging device, including a primary object that is at least partially obscuring an obscured object;
- receiving the capture device inputs from the capture devices;
- normalizing the capture device inputs using normalization parameters to form normalized captured inputs;
- identifying a plate for reconstruction that includes the primary object;
- aligning two or more normalized captured inputs;
- obtaining reconstruction selections in the identified plate to remove the primary object from the plate;
- and
- reconstructing the plate based on the selections, the normalized aligned captured inputs, and the reconstruction selections to form a reconstructed plate showing the portions of the obscured object that were obscured by the primary object.
A non-transitory processor-readable medium for reconstructing a plate by processing images of a scene from a main imaging device using capture device inputs from capture devices recording the same scene, the non-transitory processor-readable medium including instructions executable by one or more processors for:
- receiving reference stage parameters and normalization parameters associated with the capture devices;
- storing the normalization parameters;
- receiving main input from the main imaging device, including a primary object that is at least partially obscuring an obscured object;
- receiving the capture device inputs from the capture devices;
- normalizing the capture device inputs using normalization parameters to form normalized captured inputs;
- identifying a plate for reconstruction that includes the primary object;
- aligning two or more normalized captured inputs;
- obtaining reconstruction selections in the identified plate to remove the primary object from the plate;
- and
- reconstructing the plate based on the selections, the normalized aligned captured inputs, and the reconstruction selections to form a reconstructed plate showing the portions of the obscured object that were obscured by the primary object.
Dependencies are inferred from the claim text.