Image modification of motion captured scene for reconstruction of obscured views using uncoordinated cameras
AssigneeUnity Technologies SF
InventorsKimball D. Thurston, III, Peter M. Hillman
Life of this patent
Estimating the term…
Abstract
An imagery processing system determines alternative pixel color values for pixels of captured imagery where the alternative pixel color values are obtained from alternative sources. A main imagery capture device, such as a camera, captures main imagery such as still images and/or video sequences, of a live action scene. Alternative devices capture imagery of the live action scene, in some spectra and form, and that alternative imagery is processed to provide user-selectable alternatives for pixel ranges from the main imagery.
Claims18
A computer-implemented method of processing images from a main imaging device using capture device inputs from capture devices, the method comprising:
- obtaining a main image from a main image camera at a first position, wherein the main image comprises a main pixel array derived from a view of a live action scene, wherein the main image includes images of motion capture fiducials;
- obtaining a plurality of alternative images from one or more alternative cameras at positions that are uncoordinated with the main camera's first position, wherein each alternative image in the plurality of images comprises an alternative array of pixels;
- determining positions and orientations for the alternative cameras;
- and
- transferring the main image, alternative images, alternative camera positions and orientations for use in mapping pixels of the alternative array of pixels to pixels of the main pixel array.
Dependencies are inferred from the claim text.