# US 2018/0322024 A1 · Storage apparatus, storage system, and control method of storage system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0322024 A1
- Document ID: US20180322024A1
- Status: Published application
- Kind: A1
- Application number: 15/749,014
- Filed: 2015-07-31
- Published: 2018-11-08
- Earliest claimed: 2015-07-31
- Assignees: Hitachi, Ltd.
- Applicants: Hitachi, Ltd.
- Inventors: Takashi NAGAO; Sadahiro SUGIMOTO; Tomohiro KAWAGUCHI; Norio SIMOZONO
- Web page: https://patentgrep.com/patent/US20180322024A1

## CPC

- G06F 11/2094: {Redundant storage or storage space (G06F11/2056 takes precedence)}
- G06F 3/0604: {Improving or facilitating administration, e.g. storage management}
- G06F 3/061: {Improving I/O performance}
- G06F 3/0614: {Improving the reliability of storage systems}
- G06F 3/065: {Replication mechanisms}
- G06F 3/0665: {at area level, e.g. provisioning of virtual or logical volumes}
- G06F 3/0683: {Plurality of storage devices}
- G06F 11/1662: {the resynchronized component or unit being a persistent storage device (re-synchronization of failed mirror storage G06F11/2082; rebuild or reconstruction of parity RAID storage G06F11/1008)}
- G06F 11/1666: {where the redundant component is memory or memory area}
- G06F 12/084: with a shared cache
- G06F 12/0871: Allocation or management of cache space
- G06F 3/0646: {Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems}
- G06F 11/1658: {Data re-synchronization of a redundant component, or initial sync of replacement, additional or spare unit}
- G06F 2212/1024: Latency reduction
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A storage system capable of dynamically securing free space when a certain storage apparatus is disused and reducing the influence on the system upon dynamically securing the free space without having to continuously secure, in a memory of another storage apparatus, free space capable of storing management information of the corresponding storage apparatus in preparation of a case where such storage apparatus is disused. Each storage apparatus comprises a memory including a management information storage area for storing management information and a cache area for storing cache information, and a processor which manages a status of the cache area. At least certain processors determine a storage apparatus to become a copy destination of the copy target management information. The storage apparatus of the copy destination releases at least a part of the cache area and stores the management information in the released cache area.

## Claims

### Claim 1

A storage system comprising a plurality of storage apparatuses including a first storage apparatus,
wherein each of the plurality of storage apparatuses comprises a memory which includes a management information storage area for storing management information and a cache area for storing cache information, and a processor which manages a status of the cache area,
wherein, when a memory of the first storage apparatus is to be disused, at least certain processors of the plurality of storage apparatuses determine a copy destination storage apparatus to become a copy destination of the copy target management information, which is the management information stored in the memory to be disused, based on the status of the cache area that is managed by each of the storage apparatuses other than the first storage apparatus, and
wherein the processor of the copy destination storage apparatus releases at least a part of the cache area of the memory of the copy destination storage apparatus, and stores the copy target management information in the released cache area.

### Claim 2 (depends on 1)

The storage system according to claim 1,
wherein the management information is information which is stored in at least one of the memories of the plurality of storage apparatuses and which can be referenced by at least one of the processors of the plurality of storage apparatuses from the memory when the plurality of storage apparatuses are operating,
wherein the cache information is information which can be deleted from any one of the memories of the plurality of storage apparatuses when same data is stored in a storage device equipped in at least one of the plurality of storage apparatuses,
wherein the status of the cache area includes at least information of an access frequency of the cache area, and
wherein, when there are a plurality of copy destination candidate storage apparatuses to become copy destination candidates of the management information stored in the memory to be disused among the plurality of storage apparatuses, the at least certain processors:
predict a deterioration in the access performance when the copy target management information is copied to each of the copy destination candidate storage apparatuses based on the access frequency of the cache area managed by each of the copy destination candidate storage apparatuses; and
determine, as the copy destination storage apparatus, a storage apparatus in which the predicted deterioration in the access performance is low among the plurality of copy destination candidate storage apparatuses.

### Claim 3 (depends on 2)

The storage system according to claim 2,
wherein the plurality of storage apparatuses comprise at least the first storage apparatus, a second storage apparatus, and the copy destination storage apparatus, wherein the copy target management information is made redundant by storing the copy target management information in a memory of the first storage apparatus and a memory of the second storage apparatus, respectively,
wherein, when the memory of the first storage apparatus is to be disused, the copy target management information is stored in the copy destination storage apparatus so as to make redundant the copy target management information by using the memory of the second storage apparatus and the memory of the copy destination storage apparatus, and
wherein the copy destination storage apparatus notifies a storage destination of the copy target management information to at least certain storage apparatuses among the plurality of storage apparatuses.

### Claim 4 (depends on 3)

The storage system according to claim 3,
wherein the copy destination candidate storage apparatuses are at least two or more storage apparatuses other than the first storage apparatus and the second storage apparatus among the plurality of storage apparatuses,
wherein each of the at least two or more copy destination candidate storage apparatuses predicts a deterioration in the access performance, and sends the predicted deterioration to the second storage apparatus,
wherein the second storage apparatus determines, as the copy destination storage apparatus, a copy destination candidate storage apparatus in which the predicted deterioration in the access performance is low based on the deterioration predicted by each of the at least two or more copy destination candidate storage apparatuses, and
wherein the copy destination storage apparatus copies the copy target management information from the second storage apparatus.

### Claim 5 (depends on 4)

The storage apparatus according to claim 4,
wherein the management information to be stored in the memory of each of the plurality of storage apparatuses includes:
integrated management information provided in each of the plurality of storage apparatuses;
shared management information which can be referenced by other storage apparatuses; and
individual management information which is management information to be individually managed by each storage apparatus and which includes information of an access frequency of the cache area of the corresponding storage apparatus, and wherein the copy target management information is the shared management
information stored in the memory of the first storage apparatus and the memory of the second storage apparatus, respectively.

### Claim 6 (depends on 5)

The storage system according to claim 5,
wherein the processor of the copy destination storage apparatus:
divides the cache area of the memory of the copy destination storage apparatus into a plurality of small areas, and manages an access frequency of each of the small areas; and
releases at least a part of the cache area by disusing the cache information stored in a small area with a low access frequency based on the access frequency of each of the small areas.

### Claim 7 (depends on 6)

The storage system according to claim 6,
wherein the processor of the copy destination storage apparatus rearranges the cache information of the copy destination storage apparatus based on the access frequency so that the cache area for storing the copy target management information will be a consecutive area.

### Claim 8 (depends on 6)

The storage system according to claim 6,
wherein the copy destination storage apparatus further includes one or more storage devices which configure a logical volume to be provided to a host computer,
wherein the processor of the copy destination storage apparatus:
manages a cache guarantee which is set in the logical volume; and
disuses the cache information stored in a small area of the cache area of the memory of the copy destination storage apparatus when the cache guarantee is satisfied even upon releasing the small area.

### Claim 9 (depends on 5)

The storage system according to claim 5,
wherein each of the plurality of storage apparatuses includes a plurality of memories, and
wherein each of storage apparatus makes redundant the individual management information which is managed individually by the corresponding storage apparatus by storing the individual management information in different memories within the corresponding storage apparatus.

### Claim 10 (depends on 9)

The storage system according to claim 9,
wherein each of the plurality of storage apparatuses comprises a plurality of controllers including a memory, and
wherein each storage apparatus makes redundant the individual management information which is managed individually by the corresponding storage apparatus by storing the individual management information in memories of different controllers within the corresponding storage apparatus.

### Claim 11 (depends on 5)

The storage system according to claim 5,
wherein the memory of the first storage apparatus is disused when the first storage apparatus is subject to a failure or when first storage apparatus is to be removed.

### Claim 12 (depends on 5)

The storage system according to claim 5,
wherein the management information of each storage apparatus includes at least one of either a program to be executed by one of the processors or information to be used in executing one of the programs, and
wherein the cache information of each storage apparatus includes at least one of either write data based on a write request from a host computer connected to the corresponding storage apparatus or read data to be used in response to a read request from the corresponding host computer.

### Claim 13 (depends on 5)

The storage system according to claim 5,
wherein, when one or more storage apparatuses are to be added to the storage system, the integrated management information and the copy target management information are stored in a memory of the storage apparatus to be added, and
wherein an area in which the copy target management information was stored is released within the memory of the copy destination storage apparatus, and the cache information is stored the released area.

### Claim 14

A storage apparatus, comprising:
a connection unit to be connected to a plurality of storage apparatuses each comprising a memory which includes a management information storage area for storing management information and a cache area for storing cache information, and a processor which manages a status of the cache area; and
a control unit which determines, when a memory of one storage apparatus among the plurality of storage apparatuses is to be disused, a storage apparatus other than the one storage apparatus in which at least a part of the cache area of the memory of the corresponding storage apparatus is released and management information stored in the memory to be disused is stored therein, based on the status of the cache area that is managed by each of the storage apparatuses other than the one storage apparatus.

### Claim 15

A control method of a storage system comprising a plurality of storage apparatuses, and a network which connects the plurality of storage apparatuses,
wherein the plurality of storage apparatuses comprise at least four or more storage apparatuses including the first storage apparatus and a second storage apparatus,
wherein each of the plurality of storage apparatuses comprises a memory which includes a management information storage area for storing management information and a cache area for storing cache information, and a processor which manages a status of the cache area,
wherein same management information is made redundant by storing the same management information in a memory of the first storage apparatus and a memory of the second storage apparatus, respectively,
wherein, when the memory of the first storage apparatus is to be disused, at least two or more storage apparatuses other than the first storage apparatus and the second storage apparatus are copy destination candidate storage apparatuses to become copy destination candidates of the same management information,
wherein each of the at least two or more copy destination candidate storage apparatuses predicts, based on an access frequency of the cache area managed by the corresponding copy destination candidate storage apparatus, a deterioration in the access performance when the same management information is copied to the corresponding copy destination candidate storage apparatus, and sends the predicted deterioration to the second storage apparatus,
wherein the second storage apparatus determines, as the copy destination storage apparatus, a copy destination candidate storage apparatus in which the predicted deterioration in the access performance is low based on the deterioration predicted by each of the at least two or more copy destination candidate storage apparatuses,
wherein the copy destination storage apparatus releases at least a part of the cache area of the memory of the copy destination storage apparatus, copies the same management information from the second storage apparatus, and stores the same management information in the released cache area, and
wherein the same management information is made redundant by using the memory of the second storage apparatus and the memory of the copy destination storage apparatus.
