# US 2013/0086448 A1 · Accessing large amounts of data in a dispersed storage network

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0086448 A1
- Document ID: US20130086448A1
- Status: Published application
- Kind: A1
- Application number: 13/588,391
- Filed: 2012-08-17
- Published: 2013-04-04
- Earliest claimed: 2011-10-04
- Assignees: Cleversafe, Inc.
- Inventors: Andrew Baptist; Ilya Volvovski; Greg Dhuse; Wesley Leggette; Jason K. Resch
- Web page: https://patentgrep.com/patent/US20130086448A1

## CPC

- G06F 11/00: Error detection; Error correction; Monitoring (error detection, correction or monitoring in information storage based on relative movement between record carrier and transducer G11B20/18; monitoring, i.e. supervising the progress of recording or reproducing G11B27/36; in static stores G11C29/00)
- G06F 3/06: Digital input from, or digital output to, record carriers {, e.g. RAID, emulated record carriers or networked record carriers}
- G06F 11/1076: {Parity data used in redundant arrays of independent storages, e.g. in RAID systems}
- H04L 9/085: {Secret sharing or secret splitting, e.g. threshold schemes}
- H04L 9/0863: {involving passwords or one-time passwords (network architectures or network communication protocols for using one-time keys in a packet data network H04L63/067)}
- H04L 9/0869: {involving random numbers or seeds}
- H04L 9/321: {involving a third party or a trusted authority}
- H04L 9/3263: {involving certificates, e.g. public key certificate [PKC] or attribute certificate [AC]; Public key infrastructure [PKI] arrangements (network architectures or network communication protocols for supporting authentication of entities using certificates in a packet data network H04L63/0823)}
- H04L 63/0823: {using certificates (cryptographic mechanisms or cryptographic arrangements for entity authentication involving certificates H04L9/3263)}
- G06F 3/0604: {Improving or facilitating administration, e.g. storage management}
- G06F 3/067: {Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]}
- G06F 11/1446: Point-in-time backing up or restoration of persistent data
- G06F 15/17331: {Distributed shared memory [DSM], e.g. remote direct memory access [RDMA]}
- G06F 21/33: using certificates
- G06F 2211/1028: Distributed, i.e. distributed RAID systems with parity
- H04L 2209/04: Masking or blinding
- H04L 2209/34: Encoding or coding, e.g. Huffman coding or error correction
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A method begins by a dispersed storage (DS) processing module obtaining a plurality of data objects for storage in a dispersed storage network (DSN) and determining one or more common data object aspects of a data object of the plurality of data objects. The method continues with the DS processing module disperse storage error encoding at least a portion of the data object to produce a set of encoded data slices and generating a set of DSN addresses for the set of encoded data slices, wherein each of the set of DSN addresses includes a field referencing the one or more common data object aspects. The method continues with the DS processing module outputting the set of encoded data slices for storage in the DSN based on the set of DSN addresses.

## Claims

### Claim 1

A method for storing large amounts of data, the method comprises:
obtaining a plurality of data objects for storage in a dispersed storage network (DSN);
determining one or more common data object aspects of a data object of the plurality of data objects, wherein a common data object aspect of the one or more common data object aspects is an aspect shared by two or more of the plurality of data objects;
disperse storage error encoding at least a portion of the data object to produce a set of encoded data slices;
generating a set of DSN addresses for the set of encoded data slices, wherein each of the set of DSN addresses includes a field referencing the one or more common data object aspects; and
outputting the set of encoded data slices for storage in the DSN based on the set of DSN addresses.

### Claim 2 (depends on 1)

The method of claim 1 further comprises:
creating a record for the data object in a common data object aspect database, wherein the record includes a data object identifier, information regarding the one or more common data object aspects, and a portions number indicating a number of portions constituting the data object, wherein the common data object aspect database includes a plurality of records for at least some of the plurality of data objects.

### Claim 3 (depends on 1)

The method of claim 1 further comprises:
the common data object aspect is one of a plurality of common data object aspects that includes two or more of: a time window aspect, a destination identifier (ID) of the data object, a source ID of the data object, one or more internet protocol (IP) addresses associated with the data object, a geographic location regarding the data object, data content information of the data object, data size of the data object, a data object type, a capturing unit ID that obtained the data object, and a vault ID.

### Claim 4 (depends on 1)

The method of claim 1, wherein generating a DSN address of the set of DSN addresses comprises:
generating a slice index field;
generating a data object aspect field;
generating a data object ID; and
generating a segment field regarding the at least a portion of the data object.

### Claim 5 (depends on 1)

The method of claim 1 further comprises:
decoding a decode threshold number of the set of encoded data slices for each portion of the data object to produce a reconstructed data object;
analyzing the reconstructed data object to identify additional common data object aspects;
disperse storage error encoding at least a portion of the reconstructed data object to produce a new set of encoded data slices;
generating a new set of DSN addresses for the new set of encoded data slices, wherein each of the new set of DSN addresses includes a field referencing the one or more common data object aspects and the additional common data object aspects; and outputting the new set of encoded data slices for storage in the DSN based on the new set of DSN addresses.

### Claim 6 (depends on 1)

The method of claim 1 further comprises:
dividing the data object into a plurality of portions;
disperse storage error encoding the plurality of portions to produce a plurality of sets of encoded data slices;
generating a plurality of sets of DSN addresses for the plurality of sets of encoded data slices, wherein each DSN address of the plurality of sets of DSN addresses includes a field referencing the one or more common data object aspects; and
outputting the plurality of sets of encoded data slices for storage in the DSN based on the plurality of sets of DSN addresses.

### Claim 7

A method for retrieving data objects having a common aspect, the method comprises:
selecting one or more common data object aspects from a plurality of common data object aspects to produce selected common data object aspects;
accessing a common data object aspect database based on the selected common data object aspects to identify a set of records, wherein a record of the common data object aspect database includes a data object identifier of a data object, information regarding one or more common data object aspects of the data object, and a portions number indicating a number of portions constituting the data object;
generating a set of dispersed storage network (DSN) addresses based on the data object identifier, the information regarding the one or more common data object aspects, and the portions number of a first record of the set of records;
retrieving at least a decode threshold number of encoded data slices from the DSN based on the set of DSN addresses; and
decoding the least a decode threshold number of encoded data slices in accordance with a dispersed storage error encoding function to reproduce at least a portion of a first data object.

### Claim 8 (depends on 7)

The method of claim 7, wherein the plurality of common data object aspects comprises two or more of:
a time window aspect, a destination identifier (ID) of the data object, a source ID of the data object, one or more internet protocol (IP) addresses associated with the data object, a geographic location regarding the data object, data content information of the data object, data size of the data object, a data object type, a capturing unit ID that obtained the data object, and a vault ID.

### Claim 9 (depends on 7)

The method of claim 7, wherein generating a DSN address of the set of DSN addresses comprises:
generating a slice index field based on the dispersed storage error encoding function;
generating a data object aspect field based on the selected common data object aspects;
generating a data object ID based on the data object identifier; and
generating a segment field based on the partitions number.

### Claim 10 (depends on 7)

The method of claim 7 further comprises:
generating a plurality of sets of DSN addresses based on the data object identifier, the information regarding the one or more common data object aspects, and the portions number;
retrieving at least a decode threshold number of encoded data slices from the DSN for each of the plurality of sets of DSN addresses;
decoding the least a decode threshold number of encoded data slices the DSN for each of the plurality of sets of DSN addresses in accordance with the dispersed storage error encoding function to reproduce a plurality of portions of the first data object; and
reproducing the first data object from the plurality of portions of the first data object.

### Claim 11 (depends on 7)

The method of claim 7 further comprises:
generating a second set of DSN addresses based on the data object identifier, the information regarding the one or more common data object aspects, and the portions number of a second record of the set of records;
retrieving at least a decode threshold number of second encoded data slices from the DSN based on the second set of DSN addresses; and
decoding the least a decode threshold number of second encoded data slices in accordance with the dispersed storage error encoding function to reproduce at least a portion of a second data object.

### Claim 12

A capturing unit comprises:
a first module, when operable within a computing device, causes the computing device to obtain a plurality of data objects for storage in a dispersed storage network (DSN);
a second module, when operable within the computing device, causes the computing device to determine one or more common data object aspects of a data object of the plurality of data objects, wherein a common data object aspect of the one or more common data object aspects is an aspect shared by two or more of the plurality of data objects;
a third module, when operable within the computing device, causes the computing device to disperse storage error encode at least a portion of the data object to produce a set of encoded data slices;
a fourth module, when operable within the computing device, causes the computing device to generate a set of DSN addresses for the set of encoded data slices, wherein each of the set of DSN addresses includes a field referencing the one or more common data object aspects; and
a fifth module, when operable within the computing device, causes the computing device to output the set of encoded data slices for storage in the DSN based on the set of DSN addresses.

### Claim 13 (depends on 12)

The capturing unit of claim 12 further comprises:
a sixth module, when operable within the computing device, causes the computing device to create a record for the data object in a common data object aspect database, wherein the record includes a data object identifier, information regarding the one or more common data object aspects, and a portions number indicating a number of portions constituting the data object, wherein the common data object aspect database includes a plurality of records for at least some of the plurality of data objects.

### Claim 14 (depends on 12)

The capturing unit of claim 12 further comprises:
the common data object aspect is one of a plurality of common data object aspects that includes two or more of: a time window aspect, a destination identifier (ID) of the data object, a source ID of the data object, one or more internet protocol (IP) addresses associated with the data object, a geographic location regarding the data object, data content information of the data object, data size of the data object, a data object type, a capturing unit ID that obtained the data object, and a vault ID.

### Claim 15 (depends on 12)

The capturing unit of claim 12, wherein the fourth module, when operable, generates a DSN address of the set of DSN addresses by:
generating a slice index field;
generating a data object aspect field;
generating a data object ID; and
generating a segment field regarding the at least a portion of the data object.

### Claim 16 (depends on 12)

The capturing unit of claim 12 further comprises:
a sixth module, when operable within the computing device, causes the computing device to decode a decode threshold number of the set of encoded data slices for each portion of the data object to produce a reconstructed data object;
the second module is further operable to analyze the reconstructed data object to identify additional common data object aspects;
the third module is further operable to disperse storage error encode at least a portion of the reconstructed data object to produce a new set of encoded data slices;
the fourth module is further operable to generate a new set of DSN addresses for the new set of encoded data slices, wherein each of the new set of DSN addresses includes a field referencing the one or more common data object aspects and the additional common data object aspects; and
the fifth module is further operable to output the new set of encoded data slices for storage in the DSN based on the new set of DSN addresses.

### Claim 17 (depends on 12)

The capturing unit of claim 12 further comprises:
the third module is further operable to:
divide the data object into a plurality of portions; and
disperse storage error encode the plurality of portions to produce a plurality of sets of encoded data slices;
the fourth module is further operable to generate a plurality of sets of DSN addresses for the plurality of sets of encoded data slices, wherein each DSN address of the plurality of sets of DSN addresses includes a field referencing the one or more common data object aspects; and
the fifth module is further operable to output the plurality of sets of encoded data slices for storage in the DSN based on the plurality of sets of DSN addresses.

### Claim 18

A retrieving unit comprises:
a first module, when operable within a computing device, causes the computing device to select one or more common data object aspects from a plurality of common data object aspects to produce selected common data object aspects;
a second module, when operable within the computing device, causes the computing device to access a common data object aspect database based on the selected common data object aspects to identify a set of records, wherein a record of the common data object aspect database includes a data object identifier of a data object, information regarding one or more common data object aspects of the data object, and a portions number indicating a number of portions constituting the data object;
a third module, when operable within the computing device, causes the computing device to generate a set of dispersed storage network (DSN) addresses based on the data object identifier, the information regarding the one or more common data object aspects, and the portions number of a first record of the set of records;
a fourth module, when operable within the computing device, causes the computing device to retrieve at least a decode threshold number of encoded data slices from the DSN based on the set of DSN addresses; and
a fifth module, when operable within the computing device, causes the computing device to decode the least a decode threshold number of encoded data slices in accordance with a dispersed storage error encoding function to reproduce at least a portion of a first data object.

### Claim 19 (depends on 18)

The retrieving unit of claim 18, wherein the plurality of common data object aspects comprises two or more of:
a time window aspect, a destination identifier (ID) of the data object, a source ID of the data object, one or more internet protocol (IP) addresses associated with the data object, a geographic location regarding the data object, data content information of the data object, data size of the data object, a data object type, a capturing unit ID that obtained the data object, and a vault ID.

### Claim 20 (depends on 18)

The retrieving unit of claim 18, wherein the third module is further operable to generate a DSN address of the set of DSN addresses by:
generating a slice index field based on the dispersed storage error encoding function;
generating a data object aspect field based on the selected common data object aspects;
generating a data object ID based on the data object identifier; and
generating a segment field based on the partitions number.

### Claim 21 (depends on 18)

The retrieving unit of claim 18 further comprises:
the third module further operable to generate a plurality of sets of DSN addresses based on the data object identifier, the information regarding the one or more common data object aspects, and the portions number;
the fourth module is further operable to retrieve at least a decode threshold number of encoded data slices from the DSN for each of the plurality of sets of DSN addresses; and
the fifth module is further operable to:
decode the at least a decode threshold number of encoded data slices from the DSN for each of the plurality of sets of DSN addresses in accordance with the dispersed storage error encoding function to reproduce a plurality of portions of the first data object; and
reproduce the first data object from the plurality of portions of the first data object.

### Claim 22 (depends on 18)

The retrieving unit of claim 18 further comprises:
the third module is further operable to generate a second set of DSN addresses based on the data object identifier, the information regarding the one or more common data object aspects, and the portions number of a second record of the set of records;
the fourth module is further operable to retrieve at least a decode threshold number of second encoded data slices from the DSN based on the second set of DSN addresses; and
the fifth module is further operable to decode the least a decode threshold number of second encoded data slices in accordance with the dispersed storage error encoding function to reproduce at least a portion of a second data object.
