Method and system for processing data

A system for processing data in a computing environment, comprising:

• a processor executing instructions stored in a memory device, wherein the processor, when executing the instructions:
• receives a plurality of non-sequential write operations for deduplication storage of the data;
• stores the data in a plurality of user file locations;
• accumulates the data in a plurality of buffers per a data structure, the data structure serving as a fragment map between the plurality of buffers and the plurality of user file locations;
• restructures the data in the plurality of buffers to form a complete sequence of a required sequence size of sequential data;
• provides the sequential data as a plurality of streams to a stream-based deduplication algorithm for processing and storage;
• and
• performs a defragmentation process after each of closing a plurality of user files, an arbitrary time period, and when the plurality of user files are determined to be quiescent, the defragmentation operation rearranging streams in each of the plurality of user files into a single stream.

A computer program product for processing data in a computing environment by a processor device, the computer program product comprising a non-transitory computer-readable storage medium comprising:

• computer code for receiving a plurality of non-sequential write operations for deduplication storage of the data;
• computer code for storing the data in a plurality of user file locations;
• computer code for accumulating the data in a plurality of buffers per a data structure, the data structure serving as a fragment map between the plurality of buffers and the plurality of user file locations;
• computer code for restructuring the data in the plurality of buffers to form a complete sequence of a required sequence size of sequential data;
• computer code for providing the sequential data as a plurality of streams to a stream-based deduplication algorithm for processing and storage;
• and
• computer code for performing a defragmentation process after each of closing a plurality of user files, an arbitrary time period, and when the plurality of user files are determined to be quiescent, the defragmentation operation rearranging streams in each of the plurality of user files into a single stream.