Flow of streaming data through multiple processing modules

A computer-readable medium containing instructions for performing a method for transporting streaming data through multiple modules in a digital computer, the method comprising:

• setting values for a set of performance parameters for each of the modules, the set of performance parameters comprising a frame-size range parameter, the values indicating the weights of the parameters for respective ones of the modules;
• constructing a graph as a sequence of the modules for accepting and processing frames of streaming data to achieve desired output data;
• selecting one or more performance goals for the graph as a whole;
• dividing the graph into a set of pipes in response to the parameter values of the individual modules and the goals of the graph as a whole, wherein each pipe comprises at least one module, wherein each pipe has a maximum frame size, the maximum frame size based, at least in part, on the frame-size range parameters of the modules within the pipe, wherein non-final modules in the pipe, if any, are capable of processing data in-place, and wherein a final module in the pipe is either a last module in the graph or is incapable of processing data in-place;
• and
• for each pipe, providing a common memory area accessible to the modules within the pipe for storing streaming data.

A method for transporting streaming data through multiple modules in a digital computer, comprising:

• constructing a graph as a connected sequence of the modules for accepting and processing frames of streaming data to achieve desired output data, wherein a frame-size parameter is associated with each module;
• dividing the graph into a set of pipes, wherein each pipe comprises at least one module, wherein each pipe has a maximum frame size, the maximum frame size based, at least in part, on the frame-size range parameters of the modules within the pipe, wherein non-final modules in the pipe, if any, are capable of processing data in-place, wherein a final module in the pipe is either a last module in the graph or is incapable of processing data in-place, and wherein at least one of the pipes includes multiple ones of the connected modules in the graph;
• for each of the pipes, selecting one module in that pipe for allocating the frames for the streaming data;
• and
• for each of the pipes, providing a common memory area accessible to the modules within the pipe for storing streaming data.

A computer-readable medium containing instructions for performing a method for transporting streaming data through multiple modules in a digital computer, the method comprising:

• constructing a graph as a connected sequence of the modules for accepting and processing frames of streaming data to achieve desired output data, wherein a frame-size parameter is associated with each module;
• dividing the graph into a set of pipes, wherein each pipe comprises at least one module, wherein each pipe has a maximum frame size, the maximum frame size based, at least in part, on the frame-size range parameters of the modules within the pipe, wherein non-final modules in the pipe, if any, are capable of processing data in-place, wherein a final module in the pipe is either a last module in the graph or is incapable of processing data in-place, and wherein at least one of the pipes includes multiple ones of the connected modules in the graph;
• for each of the pipes, selecting one module in that pipe for allocating the frames for the streaming data;
• and
• for each of the pipes, providing a common memory area accessible to the modules within the pipe for storing streaming data.

A computer system for transporting streaming data, comprising:

• a plurality of modules each having a set of performance parameter values, the set of performance parameters comprising a frame-size range parameter, the values indicating relative weights of the parameters for respective ones of the modules;
• a set of performance goals associated with the graph as a whole;
• and
• a flow manager for constructing a graph as a sequence of the modules for accepting and processing frames of streaming data to achieve desired output data in response to both the parameter values of the individual modules in the graph and the performance goals of the overall graph, for dividing the graph into a plurality of pipes, wherein each pipe comprises at least one module, wherein each pipe has a maximum frame size, the maximum frame size based, at least in part, on the frame-size range parameters of the modules within the pipe, wherein non-final modules in the pipe, if any, are capable of processing data in-place, and wherein a final module in the pipe is either a last module in the graph or is incapable of processing data in-place, and for providing, for each pipe, a common memory area accessible to the modules within the pipe for storing streaming data.