US 5,892,554 AGranted

System and method for inserting static and dynamic images into a live video broadcast

AssigneePrinceton Video Image, Inc.

InventorsDarrell S. DiCicco, Karl Fant

Life of this patent

Estimating the term…

Loading patent…

Abstract

A live video insertion system efficiently places static or dynamic images into a live broadcast. The system initially identifies natural landmarks within the video scene that can be automatically identified and tracked as the field of view of the camera pans and zooms across the scene. The locations of the landmarks are mathematically modeled and stored as a constellation of locations on a mathematical grid. An arbitrary reference point, preferably not necessarily coincident with a selected natural landmark, is located within or without of the grid and used as an origin for the purpose of inserting the static or dynamic image within the field of view of the camera. For static images, it is frequently desirable to place an edge or border of the image to be inserted on the reference point. For dynamic insertions, the distance between the reference point and the inserted dynamic image is automatically changed from frame to frame in order to make the image appear as though it's translating or changing, or both.

Claims45

Dependent claims

A method of placing an insertable image into a live video broadcast scene containing natural landmarks, said method comprising the steps of:

a. creating a landmark model characteristic of a first set of natural landmarks in a given scene, said landmark model comprising a sub-pixel accurate, geometric relationship between landmarks;
b. superimposing a coordinate system on said landmark model capable of registering each landmark position at a sub-pixel level of accuracy to thereby create a reference array of landmark positions;
c. defining a required location of said insertable image with respect to said reference array;
d. scanning said scene with a video camera to create a current image;
e. identifying a second set of natural landmarks in said current image, corresponding to a sub-set of the original first set of natural landmarks, by using the landmark model;
f. comparing the sub-pixel location of multiple corresponding landmarks from the second set of natural landmarks located in said current image with their location in the reference array as defined by the landmark model and using that comparison to calculate the zoom and translation of the current scene with respect to the reference array of landmarks;
and,
g. inserting said insertable image into said current scene of said live video broadcast at a location in the current image corresponding to the defined required location, with sub-pixel accuracy,
wherein said insertable image appears natural in said live video broadcast.

6 more elements

A system for placing an insertable image into a live video broadcast scene containing natural landmarks, said system comprising the steps of:

a. creating means for creating a landmark model characteristic of a first set of natural landmarks in a given scene, said landmark model comprising a sub-pixel accurate, geometric relationship between landmarks;
b. superimposing means for superimposing a coordinate system on said landmark model capable of registering each landmark position at a sub-pixel level of accuracy to thereby create a reference array of landmark positions;
c. defining means for defining a required location of said insertable image with respect to said reference array;
d. scanning means for scanning said scene with a video camera to create a current image;
e. identifying means for identifying a second set of natural landmarks in said current image, corresponding to a sub-set of the original first set of natural landmarks, by using the landmark model;
f. comparing means for comparing the sub-pixel location of multiple corresponding landmarks from the second set of natural landmarks located in said current image with their location in the reference array as defined by the landmark model and using that comparison to calculate the zoom and translation of the current scene with respect to the reference array of landmarks;
and,
g. inserting means for inserting said insertable image into said current scene of said live video broadcast at a location in the current image corresponding to the defined required location c, with sub-pixel accuracy,
wherein said insertable image appears natural in said live video broadcast.

6 more elements

Dependencies are inferred from the claim text.