Dividing incoming data into multiple data streams and transforming the data for storage in a logical data object

A system of storing a logical object in a computing environment, comprising:

• a processor device, operable in the computing environment, wherein the processor device is adapted for:
• dividing incoming data corresponding to a logical data object into a plurality of independent streams,
• associating each data chunk of a plurality of obtained data chunks with a corresponding stream among the plurality of independent streams,
• transforming each data chunk on-the-fly, wherein transforming comprises at least one of compressing and encrypting each data chunk;
• sequentially accommodating the transformed data chunks and any derivatives thereof in accordance with an order the transformed data chunks are received, while keeping the association with the corresponding streams,
• generating a global index as a single meta-data stream accommodated in the logical data object and comprising information common to each of the plurality of independent streams and related to mapping between data in the logical data object and the obtained data chunks, wherein the information comprises one of block allocation events, block de-allocation events, and a starting point of index streams for each independent stream;
• storing, in a transformed logical data object, indexed data in the global index as persistent data in a first portion of a data block,
• storing, in the transformed logical data object, non-indexed data in the global index as semi-persistent data in a second portion of the data block, and
• reusing free data blocks corresponding to different data streams using semi-persistent free-block management.

A computer program product for storing a logical object by a processor device, the computer program product comprising a computer-readable storage memory including computer-readable program code portions stored therein, the computer-readable program code portions comprising:

• a first executable portion for dividing incoming data corresponding to a logical data object into a plurality of independent streams;
• a second executable portion for associating each data chunk of a plurality of obtained data chunks with a corresponding stream among the plurality of independent streams;
• a third executable portion for transforming each data chunk on-the-fly, wherein transforming comprises at least one of compressing and encrypting each data chunk;
• a fourth executable portion for sequentially accommodating the transformed data chunks and any derivatives thereof in accordance with an order the transformed data chunks are received, while keeping the association with the corresponding streams;
• a fifth executable portion for generating a global index as a single meta-data stream accommodated in the logical data object and comprising information common to each of the plurality of independent streams and related to mapping between data in the logical data object and the obtained data chunks, wherein the information comprises one of block allocation event, block de-allocation events, and a starting point of index streams for each independent stream;
• a sixth executable portion for storing, in a transformed logical data object, indexed data in the global index as persistent data in a first portion of a data block;
• a seventh executable portion for storing, in the transformed logical data object, non-indexed data in the global index as semi-persistent data in a second portion of the data block;
• and
• an eighth executable portion for reusing free data blocks corresponding to different data streams using semi-persistent free-block management.