Dispersed storage processing unit and methods with data aggregation for use in a dispersed storage system
AssigneeCleversafe, Inc.
InventorsZachary J. Mark, S. Christopher Gladwin
Life of this patent
Estimating the term…
Abstract
A new data block to be stored in the dispersed storage system is received. When it is determined that a previous data segment contains sufficient space for the new data block, the previous data segment is retrieved from a plurality of dispersed storage units. A revised data segment is generated by aggregating the new data block with at least one existing data block of the previous data segment. A plurality of slices are generated for the revised data segment. The plurality of slices are stored in the plurality of dispersed storage units.
Claims21
A method for use in a dispersed storage system, the method comprising:
- receiving a new data block to be stored in the dispersed storage system;
- determining when a previous data segment contains sufficient space for the new data block;
- when the previous data segment contains sufficient space for the new data block:
- retrieving the previous data segment from a plurality of dispersed storage units;
- generating a revised data segment by aggregating the new data block with at least one existing data block of the previous data segment;
- generating a plurality of slices for the revised data segment;
- and
- storing the plurality of slices in the plurality of dispersed storage units.
A dispersed storage processing unit for use in a dispersed storage system, the dispersed storage processing unit comprising:
- an access module that receives a new data block to be stored in the dispersed storage system, that determines when a previous data segment contains sufficient space for the new data block, when the previous data segment contains sufficient space for the new data block, the access module:
- retrieves the previous data segment from a plurality of dispersed storage units;
- and
- generates a revised data segment by aggregating the new data block with at least one existing data block of the previous data segment;
- a grid module, coupled to the access module, that generates a plurality of slices for the revised data segment;
- and
- a storage module, coupled to the grid module, that stores the plurality of slices in the plurality of dispersed storage units.
A method for use in a dispersed storage system, the method comprising:
- receiving a plurality of data blocks to be stored in the dispersed storage system, each of the plurality of data blocks including data block metadata and data;
- mapping each of the plurality of data blocks to a corresponding one of a plurality of aggregated data blocks of fixed length;
- packing the data from each of the a plurality of data blocks into a data section of the corresponding one of the plurality of aggregated data blocks, wherein data from at least one of the plurality of data blocks has a length that is less than a length of the data section of the corresponding one of the plurality of aggregated data blocks;
- generating aggregated metadata for each of the plurality of aggregated data blocks, based in part on the data block metadata from a corresponding one of the plurality of data blocks;
- and
- storing the plurality of aggregated data blocks in a plurality of dispersed storage units.
A method for use in a dispersed storage system, the method comprising:
- receiving a new data block to be stored in the dispersed storage system;
- generating a revised data segment by aggregating the new data block into an existing data segment stored in a plurality of dispersed storage units.
Dependencies are inferred from the claim text.