US 12,651,456 B1 · System for generating a real-time object-focused video

Abstract

A system for generating a real-time object-focused video using minimal camera arrays with pre-computed sports-field-optimized spatial mapping. The system positions virtual cameras to maintain tracked objects in focused, straight-ahead orientations while supporting one-dimensional movement between two cameras using geometric interpolation and two-dimensional movement within three-camera triangular configurations using barycentric coordinates. Computer spatial mapping with discretized depth information optimized for fast-moving object tracking in sports environments eliminates real-time depth calculation overhead, avoiding latency bottleneck and enabling ultra-low latency processing suitable for live sports broadcasting. The system includes predictive camera set switching using mathematical positioning variables, multi-object tracking capabilities with distributed processing frameworks, and intelligent 2D occlusion handling optimized for broadcast video output with parallax-induced occlusion management. Video synthesis techniques including adaptive geometric transformation, and multi-resolution image processing achieve rapid processing performance for live broadcasting applications while preventing discrete camera switching artifacts through continuous interpolation coefficients that eliminate abrupt perspective transitions.

Claims20

Dependent claims

A system for generating real-time object-focused video, comprising:

a processor;
and
a non-transitory, processor-readable medium storing instructions that, when executed by the processor, cause the processor to:
identify at least one moving object within a coverage area using a convolutional neural network,
represent spatial data for positions within the coverage area as a plurality of depth vectors that defines a resolution that is based on the at least one moving object,
automatically determine virtual camera positions to track the at least one moving object from a desired orientation, based on a weighted combination of a plurality of cameras associated with the coverage area, and
generate virtual camera viewpoints based on the virtual camera positions by interpolating video feeds from the plurality of cameras based on the plurality of depth vectors.

4 more elements

Dependencies are inferred from the claim text.

System for generating a real-time object-focused video

Life of this patent

System for generating a real-time object-focused video

Life of this patent

Abstract

Claims20