Method and apparatus for storage and retrieval of very large databases using a direct pipe

A method of connecting a computer process to a storage device comprising the steps of:

• creating a FIFO pipe fed by said computer process;
• selecting a member of a set of FIFO data stores, writing data from said FIFO pipe to said member, and writing said data from said member to said storage device;
• if said selected member is full then selecting a next member of said set of FIFO data stores, writing data from said FIFO pipe to said next member, and writing said data from said next member to said storage device said selecting step further comprising:
• reading a list of available data stores;
• wherein
• if said data has ended, then
• signaling a data manager to empty a final data store;
• waiting for said data manager to signal completion;
• and
• recording a response code for said FIFO pipe;
• and
• if said data has not ended and if said current data store is full, then
• signaling the data manager to empty the current data store;
• and
• marking the current data store as busy;
• repeating said selecting and testing a current data store until a data store is found to be not full and not busy and then proceeding as if not full;
• and if said current data store is not full, then
• repeating said steps of reading data, detecting the end, selecting, testing, and writing, until said end of data is detected.