# US 2008/0288947 A1 · Systems and methods of data storage management, such as dynamic data stream allocation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2008/0288947 A1
- Document ID: US20080288947A1
- Status: Published application
- Kind: A1
- Application number: 11/963,581
- Filed: 2007-12-21
- Published: 2008-11-20
- Earliest claimed: 2006-12-22
- Assignees: Commvault Systems, Inc.
- Inventors: Parag Gokhale; Michael F. Klose
- Web page: https://patentgrep.com/patent/US20080288947A1

## CPC

- G06F 16/13: File access structures, e.g. distributed indices (arrangements of input from, or output to, record carriers G06F3/06)
- G06F 3/0613: {in relation to throughput}
- G06F 3/0643: {Management of files}
- G06F 3/0644: {Management of space entities, e.g. partitions, extents, pools}
- G06F 3/0683: {Plurality of storage devices}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A system and method for choosing a stream to transfer data is described. In some cases, the system reviews running data storage operations and chooses a data stream based on the review. In some cases, the system chooses a stream based on the load of data to be transferred.

## Claims

### Claim 1

A method of transferring data to one or more storage media, the method comprising:
identifying data to be transferred to storage media;
receiving data transfer information associated with two or more data streams in a process of transferring data to the one or more storage media, wherein the data transfer information is related to a data transfer load of each of the two or more data streams;
selecting from the two or more data streams a data stream based at least in part on the received data transfer information; and
transferring the data using at least the selected data stream.

### Claim 2 (depends on 1)

The method of claim 1, wherein receiving data transfer information comprises:
receiving header information for the transferring data on the two or more data streams; and
determining the data transfer load based on the received header information.

### Claim 3 (depends on 1)

The method of claim 1, wherein receiving data transfer information comprises:
receiving transfer rate information from the two or more data streams; and
determining the data transfer load based on the received transfer rate information.

### Claim 4 (depends on 1)

The method of claim 1, wherein the selecting comprises selecting the data stream with a comparatively lesser data transfer load.

### Claim 5 (depends on 1)

The method of claim 1, wherein the selecting is based at least in part on transfer rate information for the two or more data streams.

### Claim 6 (depends on 1)

The method of claim 1, wherein the selecting is based at least in part on information related to available space on the one or more storage media.

### Claim 7 (depends on 1)

The method of claim 1, wherein transferring the data comprises storing the data to be transferred in a queue associated with the selected data stream.

### Claim 8 (depends on 1)

The method of claim 1, wherein transferring the data comprises:
at a first time, storing the data to be transferred in a first queue associated with the selected data stream; and
at a second time later than the first time, reassigning the data to be transferred from the first queue to a second queue associated with a data stream other than the selected data stream.

### Claim 9 (depends on 1)

The method of claim 1, wherein transferring the data comprises:
pre-allocating space on the storage media associated with the selected stream; and
transferring the data to be transferred to the pre-allocated space.

### Claim 10 (depends on 1)

The method of claim 1, wherein the data transfer information comprises a data transfer load currently associated with each of the two or more data streams.

### Claim 11 (depends on 1)

The method of claim 1, wherein the data transfer information comprises a future data transfer load associated with each of the two or more data streams.

### Claim 12 (depends on 1)

The method of claim 1, wherein the data transfer information comprises a predicted data transfer load associated with each of the two or more data streams.

### Claim 13

A system of dynamically allocating a data stream to send data to one or more storage devices, the system comprising:
a first storage subsystem, wherein the first storage subsystem transfers data to first storage media;
a second storage, wherein the second storage subsystem transfers data to second storage media; and
a dynamic allocation component, wherein the dynamic allocation component: receives load information associated with the first storage subsystem and the second storage subsystem; and
allocates the data to the one or more storage devices to a storage subsystem based at least in part on the received load information.

### Claim 14 (depends on 13)

The system of claim 13, wherein the dynamic selection component is contained within the first storage subsystem or the second storage subsystem.

### Claim 15 (depends on 13)

The system of claim 13, wherein the storage subsystem comprises:
a storage component, wherein the storage component selects the storage media; and
a data store component that transfers the data to be stored to the storage media.

### Claim 16 (depends on 13)

The system of claim 13, wherein the dynamic selection component is contained with a server that communicates with the storage subsystems.

### Claim 17 (depends on 13)

The system of claim 13, wherein the dynamic allocation component receives transfer rate information the first storage subsystem and the second storage subsystem and allocates the data based at least in part on the received transfer rate information.

### Claim 18 (depends on 13)

The system of claim 13, wherein the dynamic allocation component receives load information from a monitoring component.

### Claim 19 (depends on 13)

The system of claim 13, wherein the dynamic allocation component receives storage device information from the first storage subsystem and the second storage subsystem and allocates the data based at least in part on the received storage device information.

### Claim 20 (depends on 13)

The system of claim 13, wherein the dynamic selection component communicates with the storage subsystems via a network.

### Claim 21 (depends on 13)

The system of claim 13, wherein the first storage media and the second storage media are the same storage media.

### Claim 22 (depends on 13)

The system of claim 13, wherein the first storage subsystem and the second storage subsystem send data to the same storage media.

### Claim 23

A system for transferring data to one or more storage media, comprising:
means for receiving data to be transferred to storage media;
means, coupled to the means for receiving, for analyzing load information from two or more data streams in transferring data to the one or more storage media, wherein the load information is related to a data transfer load of each of the two or more data streams;
means, coupled to the means for analyzing, for selecting from the two or more data streams selects a data stream based at least in part on the received load information; and
means, coupled to the means for selecting, for transferring the data to be transferred to the selected data stream.

### Claim 24 (depends on 21)

The system of claim 21, wherein the means for selecting from the two or more data streams selects a data stream allocated less data than at least one other data stream.

### Claim 25

A computer-implemented method of modifying the performance of data storage operations, the method comprising:
automatically identifying an estimated time of completion for a set of data storage operations;
automatically comparing the estimated time of completion with a pre-determined allocated time for the data storage operations; and
when the estimated time is greater than the allocated time, automatically implementing one or more corrective measures to the data storage operations.

### Claim 26 (depends on 25)

The method of claim 25, wherein implementing one or more corrective measures includes allocating additional storage resources to the data storage operation.

### Claim 27 (depends on 25)

The method of claim 25, wherein implementing one or more corrective measures includes selecting a subset of data storage operations and completing the selected subset of data storage operations before performing unselected data storage operations.

### Claim 28 (depends on 25)

The method of claim 25, wherein implementing one or more corrective measures includes transferring some or all remaining data storage operations to alternate storage resources.

### Claim 29 (depends on 25)

The method of claim 25, wherein implementing one or more corrective measures includes reorganizing data storage operations based on performance of storage resources.

### Claim 30

A system of monitoring data storage operations being performed within a time window, comprising:
a time monitoring component, wherein the time monitoring component compares operation time of storage operations with the time window; and
a storage modification component, communicating with the time monitoring component, wherein the storage modification component modifies data storage operations based on information received from the time monitoring component.

### Claim 31 (depends on 30)

The system of claim 30, wherein the time monitoring component continuously compares the operation time of storage operations with the time window.

### Claim 32 (depends on 30)

The system of claim 30, wherein the time monitoring component compares the operation time of storage operations with the time window at pre-determined intervals within the time window.

### Claim 33 (depends on 30)

The system of claim 30, wherein the storage modification component modifies data storage operations to be performed within the current time window.

### Claim 34 (depends on 30)

The system of claim 30, wherein the storage modification component modifies data storage operations to be performed within a future time window.

### Claim 35

A method of dynamically selecting jobs of data to be transferred from a file system to data storage devices during at least one data storage operation, the method comprising:
determining an estimated time of completion of performing all pending jobs and transferring data from the file system to the storage devices;
when the estimated time of completion is greater than a threshold time of completion:
ordering the pending jobs based on a determined priority; and
performing jobs with a higher priority before jobs with a lower priority for transferring data from the file system to the storage devices.

### Claim 36 (depends on 35)

The method of claim 35, wherein the priority is based on the type of data within the jobs.

### Claim 37 (depends on 35)

The method of claim 35, wherein the priority is determined before the jobs are to be transferred.

### Claim 38 (depends on 35)

The method of claim 35, wherein the priority is determined based on the time comparison.

### Claim 39 (depends on 35)

The method of claim 35, wherein the priority is determined based on input received from a user related to the data storage operation.

### Claim 40 (depends on 35)

The method of claim 35, further comprising:
receiving information related to previous data storage operations; and
determining the priority of jobs based on the received information.

### Claim 41 (depends on 35)

The method of claim 35, further comprising:
receiving information related to performance of resources utilized by the data storage operation; and
determining the priority of jobs based on the received information.

### Claim 42 (depends on 35)

The method of claim 35, further comprising:
transferring at least some of the lower priority jobs to a future data storage operation.

### Claim 43 (depends on 35)

The method of claim 35, further comprising:
transferring at least some of the lower priority jobs to alternate resources.
