US 2023/0055813 A1 · PERFORMING RESYNCHRONIZATION JOBS IN A DISTRIBUTED STORAGE SYSTEM BASED ON A PARALLELISM POLICY

Abstract

The disclosure herein describes performing resynchronization (“resync”) jobs in a distributed storage system based on a parallelism policy. A resync job is obtained from a queue and input/output (I/O) resources that will be used during execution of the resync job are identified. Available bandwidth slots of each I/O resource of the identified I/O resources are determined. The parallelism policy is applied to the identified I/O resources and the available bandwidth slots. Based on the application of the parallelism policy, a bottleneck resource of the I/O resources is determined and a parallel I/O value is calculated based on the available bandwidth slots of the bottleneck resource, wherein the parallel I/O value indicates a quantity of I/O tasks that can be performed in parallel. The resync job is executed using the I/O resources, the execution of the resync job including performance of I/O tasks in parallel based on the parallel I/O value.

Claims20

Dependent claims

A system for performing resync jobs in a distributed storage system based on a parallelism policy, the system comprising:

at least one processor;
and
at least one memory comprising computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the at least one processor to:
obtain a resync job from a pending resync job queue, wherein the resync job includes information describing a current data location and a destination data location between which data will be transferred during performance of the resync job;
determine an input/output (I/O) path from the current data location to the destination data location;
identify, based on the determined I/O path using the parallelism policy, a plurality of I/O resources of the distributed storage system that will be used during execution of the obtained resync job;
and
cause the resync job to be executed using the plurality of I/O resources identified in the determined I/O path.

5 more elements

A computerized method for performing resync jobs in a distributed storage system based on a parallelism policy, the method comprising:

obtain a resync job from a pending resync job queue, wherein the resync job includes information describing a current data location and a destination data location between which data will be transferred during performance of the resync job;
determine an input/output (I/O) path from the current data location to the destination data location;
identify, based on the determined I/O path using the parallelism policy, a plurality of I/O resources of the distributed storage system that will be used during execution of the obtained resync job;
and
cause the resync job to be executed using the plurality of I/O resources identified in the determined I/O path.

2 more elements

One or more non-transitory computer storage media having computer-executable instructions for performing resync jobs in a distributed storage system based on a parallelism policy that, upon execution by a processor, cause the processor to at least:

obtain a resync job from a pending resync job queue, wherein the resync job includes information describing a current data location and a destination data location between which data will be transferred during performance of the resync job;
determine an input/output (I/O) path from the current data location to the destination data location;
identify, based on the determined I/O path using the parallelism policy, a plurality of I/O resources of the distributed storage system that will be used during execution of the obtained resync job;
and
cause the resync job to be executed using the plurality of I/O resources identified in the determined I/O path.

2 more elements

Dependencies are inferred from the claim text.

Performing resynchronization jobs in a distributed storage system based on a parallelism policy

Life of this patent

Performing resynchronization jobs in a distributed storage system based on a parallelism policy

Life of this patent

Abstract

Claims20