Systems and methods for generating a composite video based on a plurality of video streams using a frame schedular

A system for video compositing, comprising:

• a storage device for storing a composite timeline file;
• a timeline manager for reading said stored timeline file to identify rendering instructions and compositing instructions, wherein the timeline file identifies a particular period of time when data from a first video stream and data from a second video stream are to be displayed simultaneously;
• a plurality of software filter graphs, each having a rendering module for receiving one of a plurality of video streams and for rendering frames therefrom in response to said rendering instructions, wherein each filter graph transmits a frame ready signal when that filter graph renders a new frame, wherein the filter graphs include a first filter graph associated with the first video stream and a second filter graph associated with the second video stream;
• 3D hardware responsive to said plurality of filter graphs and said time line manager for creating a composite image in response to rendered frames and compositing instructions, respectively;
• and
• a frame scheduler responsive to said plurality of filter graphs for commanding said 3D hardware to create a new composite image when any of said filter graphs renders a new frame, wherein, during the particular period, the frame scheduler is configured to command the 3D hardware to create a new composite image whenever the first filter graph or the second filter graph transmits a frame ready signal.

A method for video compositing, comprising:

• reading rendering instructions and compositing instructions from a timeline file, wherein the timeline file identifies a particular period of time when data from a first video stream and data from a second video stream are to be displayed simultaneously;
• rendering frames from a plurality of video streams in response to said rendering instructions, wherein a frame ready signal is transmitted by one of a plurality of filter graphs when a new frame from any of the video streams is rendered, wherein a first filter graphs is associated with the first video stream and a second filter graph is associated with the second video stream;
• creating a composite image from said rendered frames and said compositing instructions;
• and
• controlling the frequency at which a new composite image is created in response to said rendering, wherein, during the particular period, a new composite image is created whenever the first filter graph or the second filter graph transmits a frame ready signal.

A computer readable memory device, carrying a set of instructions which, when executed, performs a method comprising:

• reading rendering instructions and compositing instructions from a timeline file, wherein the timeline file identifies a particular period of time when data from a first video stream and data from a second video stream are to be displayed simultaneously;
• rendering frames from a plurality of video streams in response to said rendering instructions, wherein a frame ready signal is transmitted by one of a plurality of filter graphs when a new frame from any of the video streams is rendered, wherein a first filter graphs is associated with the first video stream and a second filter graph is associated with the second video stream;
• creating a composite image from said rendered frames and said compositing instructions;
• and
• controlling the frequency at which a new composite image is created in response to said rendering, wherein, during the particular period, a new composite image is created whenever the first filter graph or the second filter graph transmits a frame ready signal.