US 2022/0067972 A1 · MULTI-PRESENCE DETECTION FOR PERFORMANCE CAPTURE

Abstract

The present description relates relate to recalibration of a sensor device for performance capture, by detecting a miscalibration problem with sensor device and assessment of the problem. A recalibration system includes sensor devices initially calibrated at a recording site. A recording site change occurs and afterwards, a failure to match virtual rays projected from one sensor device with virtual rays projected from the active marker is detected. In response to determining the failure, the active marker is signaled to emit a unique display of light. The failure of the rays to match is assessed based on whether sensor devices capture the unique display of light. Three-dimensional (3-D) coordinates of an active marker is reconstructed from marker data of the calibrated sensor devices. A problematic sensor device is recalibrated based on the assessment, using the 3-D coordinates of the active marker from marker data of the remaining calibrated sensor devices, without stopping the recording.

Claims20

Dependent claims

A method for recalibrating a sensor device to capture light from an active marker during a recording for a virtual production, the method comprising:

providing a first sensor device, a second sensor device, and a third sensor device, each of the sensor devices being initially calibrated at a recording site to capture marker data for three-dimensional (3-D) coordinates of an active marker;
after a recording site change, determining a failure of virtual rays projected from the first sensor device to match with virtual rays projected from the active marker;
in response to determining the failure, signaling for the active marker to emit a unique display of light;
assessing the failure based on at least one of the first sensor device, the second sensor device, or the third sensor device capturing the unique display of light;
and
without stopping the recording, recalibrating the first sensor device based on the assessment, using 3-D coordinates of the active marker from marker data of the second sensor device and the third sensor device.

3 more elements

A system for recalibrating a sensor device to capture active marker light during a recording associated with a virtual production, the system comprising:

a first sensor device, a second sensor device, and a third sensor device, each of the sensor devices being initially calibrated at a recording site to capture marker data for three-dimensional (3-D) coordinates of an active marker;
a plurality of active markers;
at least one computing device comprising one or more processors and a tangible processor-readable storage device including instructions for:
after a recording site change, determining a failure of virtual rays projected from the first sensor device to match with virtual rays projected from the active marker;
in response to determining the failure, signaling for the active marker to emit a unique display of light;
assessing the failure based on at least one of the first sensor device the second sensor device, or the third sensor device capturing the unique display of light;
and
without stopping the recording, recalibrating the first sensor device based on the assessment, using 3-D coordinates of the active marker from marker data of the second sensor device and the third sensor device.

5 more elements

A non-transitory computer-readable storage medium carrying program instructions thereon for recalibrating a sensor device to capture active marker light during a recording associated with a virtual production, the program instructions when executed by one or more processors cause the one or more processors to perform operations comprising:

receiving initial calibration information for a first sensor device, a second sensor device, and a third sensor device, each of the sensor devices being initially calibrated at a recording site to capture marker data for three-dimensional (3-D) coordinates of an active marker;
after a recording site change, determining a failure of virtual rays projected from the first sensor device to match with virtual rays projected from the active marker;
in response to determining the failure, signaling for the active marker to emit a unique display of light;
assessing the failure based on at least one of the first sensor device, the second sensor device, or the third sensor device capturing the unique display of light;
and
without stopping the recording, recalibrating the first sensor device based on the assessment, using 3-D coordinates of the active marker from marker data of the second sensor device and the third sensor device.

3 more elements

Dependencies are inferred from the claim text.

Multi-presence detection for performance capture

Life of this patent

Multi-presence detection for performance capture

Life of this patent

Abstract

Claims20