Method and apparatus for the efficient processing of data-intensive applications

A processing system for carrying out data-intensive computing applications, comprising:

• at least one data server capable of outputting stored test data;
• one or more host computing devices coupled to receive the test data from the data server;
• and
• one or more processing modules within each of the one or more host computing devices, wherein each of the processing modules within a corresponding one of the host computing devices is coupled to receive the test data from its corresponding one of the host computing devices, each processing module comprising:
• a memory arranged to store the algorithm input data in contiguous, parallel bit locations;
• a parallel execution module having a plurality of functional execution units, wherein each of the functional execution units is configured to perform a preassigned function dictated by the algorithm on predetermined bits of each iterative parallel set of algorithm input data;
• and
• a data flow module coupled to the memory and to the parallel execution module, configured and arranged to replicate in hardware the control constructs and expression evaluations of the algorithm, and distribute the input data to the plurality of function execution units in accordance with the control constructs and expression evaluations dictated by the algorithm.

A hardware processing architecture for performing repeated algorithm iterations, wherein an algorithm iteration associated with each parallel set of algorithm simulation data is output in each cycle of a clock signal, the processing architecture comprising:

• a memory arranged to store the algorithm simulation data in contiguous bit locations;
• a plurality of function execution means, each for performing a predetermined function of the algorithm given a predetermined portion of the simulation data;
• data distribution means coupled to the memory for receiving the simulation data, and for distributing the simulation data to each of the function execution means as dictated by the algorithm;
• control structure means, integrally interposed with the data distribution means, for replicating the algorithm control constructs and expression evaluations in hardware;
• and
• data synchronization means, integrally interposed with the data distribution means, for synchronizing the arrival of confluent simulation data streams at each of the function execution means and the control structure means,
• whereby one algorithm iteration is output in each clock cycle.

A method for transforming an algorithm into a hardware implementation of the algorithm, wherein the resulting algorithm implementation produces an algorithm output for each iterative loop of the algorithm in each clock cycle, the method comprising:

• outputting a parallel set of the stored test data from the processing memory in each of the clock cycles;
• repetitively performing predetermined functions of the algorithm on each of the parallel sets of test data output from the processing memory, using corresponding functional execution units;
• distributing the test data via discrete transmission paths to the functional execution units according to the control constructs and expression evaluations of the algorithm;
• and
• synchronizing the arrival of confluent test data streams for each of the predetermined functions, control constructs and expression evaluations of the algorithm implementation;
• and
• fully pipelining the predetermined functions, control constructs and expression evaluations to provide an output for each iterative loop of the algorithm in each clock cycle.