# US 2021/0334013 A1 · Method and Apparatus for Identifying a Device Missing from a Consistency Group

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0334013 A1
- Document ID: US20210334013A1
- Status: Published application
- Kind: A1
- Application number: 16/855,315
- Filed: 2020-04-22
- Published: 2021-10-28
- Earliest claimed: 2020-04-22
- Assignees: EMC IP Holding Company LLC
- Applicants: Emc IP Holding Company LLC
- Inventors: Peter Callewaert; Dennis Trulli, JR.
- Web page: https://patentgrep.com/patent/US20210334013A1

## CPC

- G06F 3/0683: {Plurality of storage devices}
- G06F 3/0619: {in relation to data integrity, e.g. data losses, bit errors}
- G06F 3/0631: {by allocating resources to storage systems}
- G06F 3/0653: {Monitoring storage devices or systems}
- G06F 3/0659: {Command handling arrangements, e.g. command buffers, queues, command scheduling}
- G06F 18/214: Generating training patterns; Bootstrap methods, e.g. bagging or boosting
- G06F 11/2064: {while ensuring consistency}
- G06F 2218/12: Classification; Matching
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A consistency group is defined to include a set of required devices on a set of storage systems. Write patterns on each of the required devices are monitored and write patterns on each of the other devices on the set of storage systems is monitored. Pairs of devices are formed, in which each pair includes one required device and one other device. Write patterns of the pairs of devices are compared to determine respective percentage coordinated write probabilities for pairs of devices. Write patterns of the pairs of devices are also compared to determine ratios of write operations for pairs of devices. A coordinate write probability above a threshold, or a determined ratio of write operations that occurs sufficiently frequently, is interpreted as an indication that one of the other devices should be included in the consistency group. A learning process is trained and used to analyze the write patterns.

## Claims

### Claim 1

A non-transitory tangible computer readable storage medium having stored thereon a computer program for identifying a device missing from a consistency group, the computer program including a set of instructions which, when executed by a computer, cause the computer to perform a method comprising the steps of:
defining a consistency group containing a first plurality of included devices, each of the plurality of included devices residing on a respective storage system in a set of one or more storage systems, the one or more storage systems also containing a second plurality of non-included devices;
monitoring write patterns on each of the first plurality of included devices;
monitoring write patterns on each of the second plurality of non-included devices;
comparing write patterns of each of the first plurality of included devices with write patterns of each of the second plurality of non-included devices; and
determining from the compared write patterns that one of the non-included devices should be added to the consistency group.

### Claim 2 (depends on 1)

The non-transitory tangible computer readable storage medium of claim 1, wherein the step of comparing write patterns comprises populating a device activity data structure with aggregated write information on each of the included devices and each of the non-included devices over a first monitoring interval.

### Claim 3 (depends on 2)

The non-transitory tangible computer readable storage medium of claim 2, further comprising replacing the aggregated write information in the device activity data structure in successive monitoring intervals.

### Claim 4 (depends on 2)

The non-transitory tangible computer readable storage medium of claim 2, further comprising populating a device pairing data structure with aggregated write information from the device activity data structure, the device pairing data structure having an entry for each possible pair of devices, in which each pair includes a respective included device and a respective non-included device.

### Claim 5 (depends on 4)

The non-transitory tangible computer readable storage medium of claim 4, further comprising updating the device pairing data structure in successive monitoring intervals.

### Claim 6 (depends on 5)

The non-transitory tangible computer readable storage medium of claim 5, wherein each entry further includes a coordinated write probability percentage comparing a percentage of monitoring intervals in which both respective devices had write activity with monitoring intervals in which only one of the respective devices had write activity.

### Claim 7 (depends on 6)

The non-transitory tangible computer readable storage medium of claim 6, wherein the step of determining, from the compared write patterns, that one of the non-included devices should be added to the consistency group, comprises determining that a coordinated write probability percentage threshold of one of the entries of the device pairing data structure is above a threshold.

### Claim 8 (depends on 5)

The non-transitory tangible computer readable storage medium of claim 5, wherein at least some of the entries further include ratios of numbers of write operations to respective devices.

### Claim 9 (depends on 8)

The non-transitory tangible computer readable storage medium of claim 8, wherein the step of determining, from the compared write patterns, that one of the non-included devices should be added to the consistency group, comprises determining that one of the ratios of numbers of write operations occurs with a frequency above a threshold.

### Claim 10

A method of training a learning process to identifying a device missing from a consistency group, the method comprising:
generating a set of training examples; and
using the set of training examples to train a learning process to identifying write patterns associated with a device missing from a consistency group;
wherein each training example is created by:
defining a consistency group containing a first plurality of included devices, each of the plurality of included devices residing on a respective storage system in a set of one or more storage systems, the one or more storage systems also containing a second plurality of non-included devices that are not included in the consistency group;
selecting one of the included devices;
monitoring write patterns on each of the non-selected included devices;
monitoring write patterns on the selected one of the included devices; and
comparing write patterns of each of the non-selected included devices with write patterns of the selected included device to determine coordinated write pattern activity between the selected included device and non-selected included devices.

### Claim 11 (depends on 10)

The method of claim 10, wherein the step of comparing write patterns comprises populating a device activity data structure with aggregated write information on the selected included device and each of the non-selected included devices.

### Claim 12 (depends on 11)

The method of claim 11, further comprising replacing the aggregated write information in the device activity data structure in successive monitoring intervals.

### Claim 13 (depends on 11)

The method of claim 11, further comprising populating a device pairing data structure with aggregated write information from the device activity data structure, the device pairing data structure having an entry for each possible pair of devices, in which each pair includes one of the non-selected included devices and the selected included device.

### Claim 14 (depends on 13)

The method of claim 13, further comprising updating the device pairing data structure in successive monitoring intervals.

### Claim 15 (depends on 14)

The method of claim 14, wherein each entry further includes a coordinated write probability percentage comparing a percentage of monitoring intervals in which both respective devices had write activity with monitoring intervals in which only one of the respective devices had write activity.

### Claim 16 (depends on 14)

The method of claim 14, wherein at least some of the entries further include ratios of numbers of write operations to respective devices.
