System and method for combining multiple video streams

A method for combining image frames 1 through n, wherein n is an integer greater than or equal to two, comprising the steps of:

• (a) performing a partial rendering of image frames 1 through n;
• (b) dynamically sizing image frames 1 through n by calculating one or more image frame resolutions, and dynamically resizing the resulting frames to generate resized image frames 1 through n, wherein said dynamic sizing and resizing for image frames 1 through n comprises the steps of
• (1) rendering the current image frame into a frame buffer at an image frame resolution,
• (2) computing a rendering time based on how long it takes to render a previous image frame into said frame buffer,
• (3) comparing said rendering time to a high-water mark, wherein said high-water mark represents a second rendering time at which said image frame resolution would start to be reduced, and reducing said resolution for a next image frame if said rendering time exceeds said high-water mark, and
• (4) comparing said rendering time to a low-water mark, wherein said low-water mark represents a third rendering time at which said image resolution would start to be increased, and expanding said resolution for a next image frame, if said rendering time is below said low-water mark and said image frame resolution does not equal a target resolution, and
• (c) combining said resized image frames 1 through n to form a combined image frame for display.

A system for combining image frames 1 through n, wherein n is an integer greater than or equal to two, comprising:

• means for performing a partial rendering of image frames 1 through n;
• means for dynamically sizing image frames 1 through n by calculating one or more image frame resolutions, and dynamically resizing the resulting frames to generate resized image frames 1 through n, wherein said dynamic sizing and resizing means comprises
• means for rendering the current image frame into a frame buffer at an image frame resolution,
• means for computing a rendering time based on how long it takes to render a previous image frame into said frame buffer,
• means for comparing said rendering time to a high-water mark, wherein said high-water mark represents a second rendering time at which said image frame resolution would start to be reduced, and wherein said means for comparing said rendering time to a high-water mark reduces said resolution for a next image frame, if said rendering time exceeds said high-water mark, and
• means for comparing said rendering time to a low-water mark, wherein said low-water mark represents a third rendering time at which said image resolution would start to be increased, and wherein said means for comparing said rendering time to a low-water mark expands said resolution for a next image frame, if said rendering time is below said low-water mark and said image frame resolution does not equal a target resolution;
• and
• means for combining said resized image frames 1 through n to form a combined image frame, and displaying said combined image frame.