Streaming all-or-nothing encoding with random offset support
AssigneePure Storage, Inc.
InventorsJason K. Resch, Wesley B. Leggette
Life of this patent
Estimating the term…
Abstract
A method comprises dividing a data segment of a data object into a plurality of data chunks. The method continues with all-or-nothing (AONT) encoding each data chunk of the plurality of data chunks to produce a plurality of sets of AONT encoded data pieces. Note a set of AONT encoded data pieces includes T number of AONT encoded data pieces. The method continues by splitting and rearranging the plurality of sets of AONT encoded data pieces to produce the T number of sets of AONT encoded data pieces. The method continues by dispersed storage error encoding the T number of sets of AONT encoded data pieces to produce a set of encoded data slices, which include the T number+an R number of encoded data slices.
Claims18
A method comprises:
- dividing, by a computing device of a storage network, a data segment of a data object into a plurality of data chunks;
- all-or-nothing (AONT) encoding, by the computing device, each data chunk of the plurality of data chunks to produce a plurality of sets of AONT encoded data pieces, wherein each set of AONT encoded data pieces of the plurality of sets of AONT encoded data pieces includes a T number of AONT encoded data pieces, and wherein the T number corresponds to a minimum number of AONT encoded data pieces needed to reconstruct a data chunk of the plurality of data chunks;
- arranging, by the computing device, the plurality of sets of AONT encoded data pieces to produce T number of sets of rearranged AONT encoded data pieces;
- and
- dispersed storage error encoding, by the computing device, the T number of sets of rearranged AONT encoded data pieces to produce a set of encoded data slices, wherein the set of encoded data slices includes the T number+an R number of encoded data slices, wherein the T number corresponds to a minimum number of encoded data slices needed to reconstruct the data chunk, wherein a first set of AONT encoded data pieces of the plurality of sets of AONT encoded data can be reconstructed from a first section of any combination of the T number of encoded data slices of the set of encoded data slices, and wherein a first data chunk of the plurality of data chunks can be reconstructed from the first set of AONT encoded data pieces.
A computing device of a storage network comprises:
- memory;
- an interface;
- and
- a processing module, wherein the memory and the interface are operably coupled to the processing module, wherein the processing module is operable to:
- divide a data segment of a data object into a plurality of data chunks;
- all-or-nothing (AONT) encode each data chunk of the plurality of data chunks to produce a plurality of sets of AONT encoded data pieces, wherein each set of AONT encoded data pieces of the plurality of sets of AONT encoded data pieces includes a T number of AONT encoded data pieces, and wherein the T number corresponds to a minimum number of AONT encoded data pieces needed to reconstruct a data chunk of the plurality of data chunks;
- arrange the plurality of sets of AONT encoded data pieces to produce T number of sets of rearranged AONT encoded data pieces;
- and
- dispersed storage error encode the T number of sets of rearranged AONT encoded data pieces to produce a set of encoded data slices, wherein the set of encoded data slices includes the T number+an R number of encoded data slices, wherein the T number corresponds to a minimum number of encoded data slices needed to reconstruct the data chunk, wherein a first set of AONT encoded data pieces of the plurality of sets of AONT encoded data can be reconstructed from a first section of any combination of the T number of encoded data slices of the set of encoded data slices, and wherein a first data chunk of the plurality of data chunks can be reconstructed from the first set of AONT encoded data pieces.
A computer readable storage device comprises:
- at least one memory section that stores operational instructions that, when executed by a computing device of a storage network causes the computing device to:
- divide a data segment of a data object into a plurality of data chunks;
- all-or-nothing (AONT) encode each data chunk of the plurality of data chunks to produce a plurality of sets of AONT encoded data pieces, wherein each set of AONT encoded data pieces of the plurality of sets of AONT encoded data pieces includes a T number of AONT encoded data pieces, and wherein the T number corresponds to a minimum number of AONT encoded data pieces needed to reconstruct a data chunk of the plurality of data chunks;
- arrange the plurality of sets of AONT encoded data pieces to produce T number of sets of rearranged AONT encoded data pieces;
- and
- dispersed storage error encode the T number of sets of rearranged AONT encoded data pieces to produce a set of encoded data slices, wherein the set of encoded data slices includes the T number+an R number of encoded data slices, wherein the T number corresponds to a minimum number of encoded data slices needed to reconstruct the data chunk, wherein a first set of AONT encoded data pieces of the plurality of sets of AONT encoded data can be reconstructed from a first section of any combination of the T number of encoded data slices of the set of encoded data slices, and wherein a first data chunk of the plurality of data chunks can be reconstructed from the first set of AONT encoded data pieces.
Dependencies are inferred from the claim text.