Method and system for optimized streaming game server
AssigneePlaycast Media Systems, Ltd.
InventorNatan Peterfreund
Life of this patent
Estimating the term…
Abstract
Exemplary embodiments include an interception mechanism for rendering commands generated by interactive applications, and a feed-forward control mechanism based on the processing of the commands on a rendering engine, on a pre-filtering module, and on a visual encoder. Also a feed-back control mechanism from the encoder is described. The mechanism is compression-quality optimized subject to some constraints on streaming bandwidth and system delay. The mechanisms allow controllable levels of detail for different rendered objects, controllable post filtering of rendered images, and controllable compression quality of each object in compressed images.
Claims20
A system for synthesizing a compressed video bit stream from an interactive three-dimensional (3-D) graphical application, the system comprising:
- means for processing an interactive application, frame by frame, wherein each frame comprises a plurality of objects;
- means for interception of a set of graphical rendering commands generated by the processing of the interactive application;
- means for extraction of a set of geomtric and texture information from the intercepted set of commands per object;
- means for generating a modified set of graphical commands;
- means for rendering image frames from the modified set;
- means for pre-processing of the rendered image frames;
- means for encoding of the pre-processed image frames;
- means for controlling the means for generating, the means for rendering, the means for pre-processing, and the means for encoding based on a measure of encoding quality;
- and
- means for defining a level of detail of rendered images based on a pre-analysis of the extracted geometric and texture information, wherein the means for defining a level of detail of rendered images comprises a level-of-interest based control that is based on a region of interest segmentation process in which a relative visual quality value is assigned to objects in a respective frame.
A system for synthesizing a compressed video bit stream from an interactive three-dimensional (3-D) graphical application, the system comprising:
- an interception device configured to intercept a set of graphical rendering commands generated by processing of the interactive 3-D graphical application;
- an extraction device configured to extract a set of geometric and texture information from the intercepted set of commands per object;
- a processing device configured to generate a modified set of graphical commands;
- a rendering device configured to render image frames from the modified set;
- a pre-processing device configured to pre-process the rendered image frames;
- an encoding device configured to encode the pre-processed image frames;
- a feed-back control device configured to control the processing device, the rendering device, the pre-processing device, and the encoding device based on a measure of encoding quality;
- and
- a feed-forward control device configured to define a level of detail of rendered images based on a pre-analysis of the extracted geometric and texture information, wherein the feed-forward control devices comprises a level-of-interest based control that is based on a region of interest segmentation process in which a relative visual quality value is assigned to objects in a respective frame.
A method for synthesizing a compressed video bit stream from an interactive three-dimensional (3-D) graphical application, the method comprising:
- processing an interactive 3-D graphical application, frame by frame, wherein each frame comprises a plurality of objects;
- intercepting a set of graphical rendering commands generated by the processing of the interactive 3-D graphical application;
- extracting a set of geometric and texture information from intercepted set of commands per object;
- generating a modified set of graphical commands;
- rendering image frames from the modified set;
- pre-processing the rendered image frames;
- encoding the pre-processed image frames;
- controlling, via a feed-back control device, the generating, the rendering, the pre-processing, and the encoding based on a measure of encoding quality;
- and
- defining, via a feed-forward control device, a level of detail of rendered images based on a pre-analysis of the extracted geometric and texture information, wherein the feed-forward control devices comprises a level-of-interest based control that is based on a region of interest segmentation process in which a relative visual quality value is assigned to objects in a respective frame.
A method for synthesizing a compressed video bit stream from an interactive three-dimensional (3-D) graphical application, the method comprising:
- providing an interception mechanism to intercept a set of rendering commands generated by an interactive 3-D graphical application;
- providing a processing mechanism for the intercepted commands;
- providing a feed-forward control mechanism configured to define a level of detail of rendered images based on a pre-analysis of the intercepted set of rendering commands, wherein the level of detail is defined according to a region of interest segmentation process in which a relative visual quality value is assigned to objects in a respective frame;
- providing a feed-back control mechanism from an encoder, wherein the feed-back control mechanism is configured to modify the defined level of detail of the rendered images based on an encoding quality criteria;
- and
- modifying the rendered images based on the feed-forward control mechanism and the feed-back control mechanism to optimize compression quality subject to a streaming bandwidth constraint and a system delay constraint.
A system for synthesizing a compressed video bit stream from an interactive three-dimensional (3-D) graphical application, comprising:
- an interception device configured to intercept a set of rendering commands generated by an interactive 3-D graphical application;
- a processing device for the intercepted set of rendering commands;
- a feed-forward control device configured to define a level of detail of rendered images based on a pre-analysis of the intercepted set of rendering commands, wherein the level of detail is defined according to a region of interest segmentation process in which a relative visual quality value is assigned to objects in a respective frame;
- a feed-back control device configured to modify the defined level of detail of the rendered images based on an encoding quality criteria;
- and
- programmed instructions configured to modify the rendered images according to data generated by the feed-forward control device and the feed-back control device to produce an optimized compression subject to a streaming bandwidth constraint and a system delay constraint.
Dependencies are inferred from the claim text.