Optimizations for live event, real-time, 3D object tracking
OwnerJames A. Aman, William R. Hallerinventors
Life of this patent
Estimating the term…
Abstract
During a sporting or similar event, participants and objects are automatically tracked using a scalable matrix of fixed, non-adjustable overhead cameras that form a view of the entire performance area. The participants and objects are identified with attached visible or non-visible markers that are detected using image analysis. A real-time database of two-dimensional movement locations is created from the resulting information, which is then used to automatically direct multiple fixed, adjustable side-view cameras for capturing and recording the event. Image analysis of this side-view video detects additional markers providing a three-dimensional model of the participants and objects.
Claims20
A system for automatically videoing the movements of one or more participants or objects as they move about within the entire performance area of a sporting, theatre or concert event, throughout the entire time duration of the event, comprising:
- a first set of multiple stationary overhead cameras, not capable of pan, tilt or zoom movement, sufficient to form a contiguous field-of-view of said entire performance area, for generating a first video stream of images continuously throughout said entire time duration;
- a first algorithm operated on a computer system exclusively and solely responsive to said first stream of video images for continuously and simultaneously analyzing the images from all cameras in said first set of multiple stationary cameras in order to detect the presence of each participant or object within each and every camera's view, to determine for each detected participant or object its relative two-dimensional centroid coordinates within that view, and to use this determined information from all said first set cameras for updating a real-time tracking database of at least the two-dimensional centroid location of each participant or object, relative to said entire performance area, where said real-time tracking database includes all current and past said centroid locations determined throughout said entire time of said event, and
- a second algorithm operated on a computer system exclusively and solely responsive to said real-time tracking database for automatically and individually adjusting the current view of each camera in a second set of multiple stationary cameras, capable of pan, tilt and zoom movement distinct from said first set of stationary cameras, wherein each said second set camera is automatically directed without operator intervention to maintain an independent view of the participants or objects, where said second set of cameras outputs a second stream of video images for viewing and recording, and wherein said second stream of video images is not used to either determine any participant's or object's two-dimensional centroid locations or to otherwise update said real-time tracking database.
A method for automatically videoing the movements of one or more participants or objects as they move about within the entire performance area of a sporting, theatre or concert event, throughout the entire time duration of the event, comprising the steps of:
- capturing a first stream of video images using a first set of multiple stationary overhead cameras, not capable of pan, tilt or zoom movement, sufficient to form a contiguous field-of-view of said entire performance area, and where each said first set camera provides images continuously throughout said entire time duration;
- simultaneously analyzing said first stream of video images from said first set of multiple stationary overhead cameras in order to continuously detect the presence of any one or more participants or objects within each and every camera's view, to determine each detected participant's or object's relative two-dimensional centroid coordinates within that view, and to use this determined information from all said first set cameras for undatine a real-time tracking database of the two-dimensional centroid location of each participant or object, relative to said entire performance area where said real-time tracking database includes all current and past said centroid locations determined throughout said entire time of said event;
- using said determined participant and object locations stored in said real-time tracking database to automatically and individually adjust, without the aid of an operator, the current view of each camera in a second set of multiple stationary cameras, capable of pan, tilt and zoom movement, distinct from said first set of stationary overhead cameras, and
- capturing a second stream of video images for viewing and recording from said second set of multiple stationary cameras, wherein said second stream of video images create independent views of one or more of the participants or objects within said entire performance area and wherein said second stream of video images is not used to either determine any participant's or object's two-dimensional centroid locations or to otherwise update said real-time tracking database.
Dependencies are inferred from the claim text.