Intelligent data storage and processing using FPGA devices

A data processing apparatus comprising:

• a processing device for communicating with a computer system, the computer system including a processor, wherein the processing device comprises a re-configurable logic device configured to perform a plurality of tasks, thereby freeing the processor to perform other tasks;
• wherein the re-configurable logic device is configured to receive and process streaming data through a multi-functional pipeline deployed on the re-configurable logic device;
• wherein the multi-functional pipeline comprises a plurality of pipelined data processing engines, each pipelined data processing engine being configured to (1) receive streaming data and selectively perform a processing operation on the received streaming data, and (2) be responsive to a control instruction that defines whether that pipelined data processing engine is an activated data processing engine or a deactivated data processing engine, wherein an activated data processing engine is configured to perform the processing operation of that activated data processing engine on streaming data received thereby, and wherein a deactivated data processing engine remains in the pipeline but does not perform the processing operation of that activated data processing engine on streaming data received thereby, the deactivated data processing engine thereby being configured to act as a pass through, the multi-functional pipeline thereby being configured to provide a plurality of different pipeline functions in response to control instructions that are configured to selectively activate and deactivate the pipelined data processing engines, each pipeline function being the combined functionality of each activated pipelined data processing engine in the pipeline at a given time.