US 9,852,017 B2 · Generating dispersed storage network event records

Abstract

A method begins by a dispersed storage (DS) processing module collecting an event record, a record regarding processing of an event request, and a plurality of records regarding processing of a plurality of sub-event requests to produce a collection of records. The event record includes information regarding an event, wherein the event is a user access operation or a system administrative operation initiated by a device affiliated with the DSN. The record regarding processing of the event request includes information regarding a dispersed storage (DS) processing module of the DSN processing the event request to produce the plurality of sub-event requests. The plurality of records regarding processing of the plurality of sub-event requests includes information regarding a plurality of DS units of the DSN processing the plurality of sub-event requests. The method continues with the DS processing module evaluating the collection of records to produce performance information regarding the DSN.

Drawings

Drawings are temporarily unavailable. Open the PDF at USPTO

Drawings

Claims18

Dependent claims

A method comprises:

sending, by a user device affiliated with a dispersed storage network (DSN), an event request that identifies an event, where the event is a data access operation;
generating, by the user device, an event record regarding the event;
processing, by a dispersed storage (DS) processing module, the event request to produce a plurality of sub-event requests, wherein the plurality of sub-event requests are related on one or more levels of processing of a set of error encoded data slices, wherein a data object is segmented into a plurality of data segments, a data segment of the plurality of data segments is dispersed storage error encoded in accordance with parameters of an error coding dispersal function to produce the set of error encoded data slices, wherein the parameters of an error coding dispersal function specifies that the set of error encoded data slices includes a pillar number of error encoded data slices that are distributedly stored across a plurality of DS units of the DSN such that no more than one error encoded data slice of the set of error encoded data slices is stored on any one DS unit of the plurality of DS units, wherein the error coding dispersal function also specifies a matrix having a first dimension corresponding to the pillar number and a second dimension that corresponds to a number of data segments of the plurality of data segments into which the data object is segmented, wherein at least one DS unit of the plurality of DS units stores error encoded data slices from different sets of error encoded data slices that are based on different data segments of the plurality of data segments, wherein the parameters of the error coding dispersal function also include a read threshold such that a read threshold number of error encoded data slices provides for reconstruction of the data segment and a write threshold such that a write threshold number of set of error encoded data slices provides for a successful transfer of the set of error encoded data slices from a first at least one location in the DSN to a second at least one location in the DSN, wherein the write threshold is greater than or equal to the read threshold for the pillar number of error encoded data slices;
generating, by the DS processing module, a record regarding the processing of the event request, wherein the record includes a first step descriptor corresponding to the read threshold number of error encoded data slices being read when the data access operation corresponds to a read operation of the data object, wherein the record includes a second step descriptor corresponding to the write threshold number of error encoded data slices being written when the data access operation corresponds to a write operation of the data object;
sending, by the DS processing module, the plurality of sub-event requests to the plurality of DS units of the DSN that distributedly store the set of error encoded data slices;
processing, by the plurality of DS units, the plurality of sub-event requests to produce a plurality of access operation responses and a plurality of records regarding processing of the plurality of sub-event requests;
processing, by the DS processing module, at least some of the plurality of access operation responses to produce a data access response and providing the data access response to the user device;
collecting, by a DS managing unit affiliated with the DSN, the event record, the record regarding the processing of the event request, and the plurality of records regarding the processing of the plurality of sub-event requests to produce a collection of records;
and
evaluating, by the DS managing unit, the collection of records to produce performance information regarding the DSN.

7 more elements

A method for execution by a DS managing unit affiliated with a dispersed storage network (DSN), the method comprises:

collecting an event record, a record regarding processing of an event request, and a plurality of records regarding processing of a plurality of sub-event requests to produce a collection of records, wherein:
the event record including information regarding an event, wherein the event is data access operation initiated by a user device affiliated with the DSN;
the record regarding processing of the event request including information regarding a dispersed storage (DS) processing module of the DSN processing the event request to produce the plurality of sub-event requests, wherein the plurality of sub-event requests are related on one or more levels of processing of a set of error encoded data slices, wherein a data object is segmented into a plurality of data segments, a data segment of the plurality of data segments is dispersed storage error encoded in accordance with parameters of an error coding dispersal function to produce the set of error encoded data slices,
wherein the parameters of an error coding dispersal function specifies that the set of error encoded data slices includes a pillar number of error encoded data slices that are distributedly stored across a plurality of DS units of the DSN such that no more than one error encoded data slice of the set of error encoded data slices is stored on any one DS unit of the plurality of DS units, wherein the error coding dispersal function also specifies a matrix having a first dimension corresponding to the pillar number and a second dimension that corresponds to a number of data segments of the plurality of data segments into which the data object is segmented, wherein at least one DS unit of the plurality of DS units stores error encoded data slices from different sets of error encoded data slices that are based on different data segments of the plurality of data segments, wherein the parameters of the error coding dispersal function also include a read threshold such that a read threshold number of error encoded data slices provides for reconstruction of the data segment and a write threshold such that a write threshold number of set of error encoded data slices provides for a successful transfer of the set of error encoded data slices from a first at least one location in the DSN to a second at least one location in the DSN, wherein the write threshold is greater than or equal to the read threshold for the pillar number of error encoded data slices;
the record regarding processing of the event request also including a first step descriptor corresponding to the read threshold number of error encoded data slices being read when the data access operation corresponds to a read operation of the data object, wherein the record includes a second step descriptor corresponding to the write threshold number of error encoded data slices being written when the data access operation corresponds to a write operation of the data object;
and
the plurality of records regarding processing of the plurality of sub-event requests including information regarding the plurality of DS units of the DSN that distributedly store the set of error encoded data slices processing the plurality of sub-event requests;
and
evaluating the collection of records to produce performance information regarding the DSN.

6 more elements

A dispersed storage network (DSN) comprises:

a dispersed storage (DS) managing unit comprising:
an interface configured to interface and communicate with the DSN;
memory that stores operational instructions;
and
a processing module operably coupled to the interface and to the memory, wherein the processing module, when operable within the DS managing unit based on the operational instructions, is configured to:
collect an event record, a record regarding processing of an event request, and a plurality of records regarding processing of a plurality of sub-event requests to produce a collection of records, wherein:
the event record including information regarding an event, wherein the event is a data access operation initiated by a user device affiliated with the DSN;
the record regarding processing of the event request including information regarding a dispersed storage (DS) processing module of the DSN processing the event request to produce the plurality of sub-event requests, wherein the plurality of sub-event requests are related on one or more levels of processing of a set of error encoded data slices, wherein a data object is segmented into a plurality of data segments, a data segment of the plurality of data segments is dispersed storage error encoded in accordance with parameters of an error coding dispersal function to produce the set of error encoded data slices, wherein the parameters of an error coding dispersal function specifies that the set of error encoded data slices includes a pillar number of error encoded data slices that are distributedly stored across a plurality of DS units of the DSN such that no more than one error encoded data slice of the set of error encoded data slices is stored on any one DS unit of the plurality of DS units, wherein the error coding dispersal function also specifies a matrix having a first dimension corresponding to the pillar number and a second dimension that corresponds to a number of data segments of the plurality of data segments into which the data object is segmented, wherein at least one DS unit of the plurality of DS units stores error encoded data slices from different sets of error encoded data slices that are based on different data segments of the plurality of data segments, wherein the parameters of the error coding dispersal function also include a read threshold such that a read threshold number of error encoded data slices provides for reconstruction of the data segment and a write threshold such that a write threshold number of set of error encoded data slices provides for a successful transfer of the set of error encoded data slices from a first at least one location in the DSN to a second at least one location in the DSN, wherein the write threshold is greater than or equal to the read threshold for the pillar number of error encoded data slices;
the record regarding processing of the event request also including a first step descriptor corresponding to the read threshold number of error encoded data slices being read when the data access operation corresponds to a read operation of the data object, wherein the record includes a second step descriptor corresponding to the write threshold number of error encoded data slices being written when the data access operation corresponds to a write operation of the data object;
and
the plurality of records regarding processing of the plurality of sub-event requests including information regarding a plurality of DS units of the DSN that distributedly store the set of error encoded data slices processing the plurality of sub-event requests;
and
further configured to:
evaluate the collection of records to produce performance information regarding the DSN.

11 more elements

Dependencies are inferred from the claim text.

Description22,052 words

Summary863 words

#Not Applicable

#Technical Field of the Invention

Brief description of the drawings27 figures

#FIG. 1 is a schematic block diagram of an embodiment of a computing system in accordance with the present invention;

#FIG. 2 is a schematic block diagram of an embodiment of a computing core in accordance with the present invention;

#FIG. 3 is a schematic block diagram of an embodiment of a distributed storage processing unit in accordance with the present invention;

Detailed description20,660 words

#FIG. 1 is a schematic block diagram of a computing system 10 that includes one or more of a first type of user devices 12, one or more of a second type of user devices 14, at least one distributed storage (DS) processing unit 16, at least one DS managing unit 18, at least one storage integrity processing unit 20, and a distributed storage network (DSN) memory 22 coupled via a network 24. The network 24 may include one or more wireless and/or wire lined communication systems; one or more private intranet systems and/or public internet systems; and/or one or more local area networks (LAN) and/or wide area networks (WAN).

#The DSN memory 22 includes a plurality of distributed storage (DS) units 36 for storing data of the system. Each of the DS units 36 includes a processing module and memory and may be located at a geographically different site than the other DS units (e.g., one in Chicago, one in Milwaukee, etc.).

#Each of the user devices 12-14, the DS processing unit 16, the DS managing unit 18, and the storage integrity processing unit 20 may be a portable computing device (e.g., a social networking device, a gaming device, a cell phone, a smart phone, a personal digital assistant, a digital music player, a digital video player, a laptop computer, a handheld computer, a video game controller, and/or any other portable device that includes a computing core) and/or a fixed computing device (e.g., a personal computer, a computer server, a cable set-top box, a satellite receiver, a television set, a printer, a fax machine, home entertainment equipment, a video game console, and/or any type of home or office computing equipment). Such a portable or fixed computing device includes a computing core 26 and one or more interfaces 30, 32, and/or 33. An embodiment of the computing core 26 will be described with reference to FIG. 2.

Facts

Application

13/547,769Filed 12 Jul 2012 · us provisional application

Priority

27 Jul 2011

Published

US 2013/0031247 A131 Jan 2013

Granted

26 Dec 2017

Term ends

12 Jul 2032

Estimated · how

20 years from earliest known nonprovisional domestic filing plus recorded patent term adjustment. Maintenance-fee lapses, terminal disclaimers and statutory extensions have not been checked. The continuity chain may be incomplete; this is not an enforceability determination.

Classification15 codes

G06F 11/0727
The processing taking place on a specific hardware platform or in a specific software environment: in a storage system, e.g. in a DASD or network…
G06F 11/0769
Error or fault reporting or storing: readable error formats, e.g. cross-platform generic formats, human understandable formats
G06F 11/0778
Error or fault reporting or storing: dumping, i.e. gathering error/state information after a fault for later diagnosis
G06F 11/079
Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of…

Timeline

27 Jul 2011Priority claimedParent application 61/512,122
12 Jul 2012Application filedUS 13/547,769
12 Jul 2012Assigned to Cleversafe, Inc.assignment of assignor's interest
31 Jan 2013PublishedUS 2013/0031247 A1
6 May 2016Assigned to International Business Machines Corporationassignment of assignor's interest
26 Dec 2017GrantedUS 9,852,017 B2
21 Jun 2019Assigned to Pure Storage, Inc.assignment of assignor's interest
14 Jan 2020Assigned to Pure Storage, Inc.corrective assignment to correct the 9992063 and 10334045 listed in error previously recorded on reel 049556 frame 0012. assignor(s) hereby confirms the assignor hereby confirms the assignment.
26 Aug 2020Assigned to Barclays Bank PLC AS Administrative Agentsecurity interest
11 Jun 2025Assigned to Pure Storage, Inc.termination and release of security interest in patent rights
12 Oct 2026TodayWithin its term
12 Jul 2032Term endsEstimated

Generating dispersed storage network event records

Life of this patent

Generating dispersed storage network event records

Life of this patent

Life of this patent

Abstract

Drawings

Drawings

Claims18

Description22,052 words

Drawings

Classification15 codes

Life of this patent

Description22,052 words