Dynamic data movement
AssigneeEMC Corporation
InventorKenneth A. Sell
Life of this patent
Estimating the term…
Abstract
A method, article of manufacture, and apparatus for processing information are disclosed. In some embodiments, this includes completing a disk operation, retrieving a NIC from a NIC queue, retrieving a list of files to transfer, and transferring data to a target disk based on the retrieved NIC and based on the list of files. In some embodiments, transferring data to a target disk includes writing data to a target disk, and wherein writing data to a target disk is the only disk operation performed on the target disk.
Claims15
A method for processing information, comprising:
- providing configuration information to a master node, wherein the configuration information includes a number of network interface cards on a plurality of hosts and a network interface card capacity for each of the number of network interface cards;
- creating a primary disk list and a mirror disk list from the plurality of hosts, wherein a primary disk in the primary disk list is at the same index as a corresponding mirror disk on the mirror disk list;
- ordering the mirror disk list such that primary disks are always read from and mirror disks are always written to, ordering comprising:
- shifting entries in the mirror disk list by a host number;
- shifting entries in the mirror disk list by modulo a number of mirrors per host;
- receiving a network interface card queue from the master node, wherein the network interface care queue is based on additional configuration information provided to the master node from additional hosts;
- retrieving a network interface card from the network interface card queue;
- retrieving a list of files to transfer;
- transferring data from the primary disk to the mirror disk based on the retrieved network interface card, the primary disk list, the mirror disk list, and the list of files, wherein smaller files on the list are transmitted before larger files;
- and
- dynamically changing the network interface card queue when the data transfer is complete.
A system for processing information, comprising a target disk, and a processor configured to:
- provide configuration information to a master node, wherein the configuration information includes a number of network interface cards on a plurality of hosts and a network interface card capacity for each of the number of network interface cards;
- create a primary disk list and a mirror disk list from the plurality of hosts, wherein a primary disk in the primary disk list is at the same index as a corresponding mirror disk on the mirror disk list;
- order the mirror disk list such that primary disks are always read from and mirror disks are always written to, ordering comprising:
- shift entries in the mirror disk list by a host number;
- shift entries in the mirror disk list by modulo a number of mirrors per host;
- receiving a network interface card queue from the master node, wherein the network interface card queue is based on additional configuration information provided to the master node from additional hosts;
- retrieve a network interface card from the network interface card queue;
- retrieve a list of files to transfer;
- transfer data from the primary disk to the mirror disk based on the retrieved network interface card, the primary disk list, the mirror disk list, and the list of files, wherein smaller files on the list are transmitted before larger files;
- and
- dynamically change the network interface card queue when the data transfer is complete.
A computer program product for processing information data, comprising a non-transitory computer readable medium having program instructions embodied therein for:
- providing configuration information to a master node, wherein the configuration information includes a number of network interface cards on a plurality of hosts and a network interface card capacity for each of the number of network interface cards;
- creating a primary disk list and a mirror disk list from the plurality of hosts, wherein a primary disk in the primary disk list is at the same index as a corresponding mirror disk on the mirror disk list;
- ordering the mirror disk list such that primary disks are always read from and mirror disks are always written to, ordering comprising:
- shifting entries in the mirror disk list by a host number;
- shifting entries in the mirror disk list by modulo a number of mirrors per host;
- receiving a network interface card queue from the master node, wherein the network interface card queue is based on additional configuration information provided to the master node from additional hosts;
- retrieving a network interface card from the network interface card queue;
- retrieving a list of files to transfer;
- transferring data from the primary disk to the mirror disk based on the retrieved network interface card, the primary disk list, the mirror disk list, and the list of files, wherein smaller files on the list are transmitted before larger files;
- and
- dynamically changing the network interface card queue when the data transfer is complete.
Dependencies are inferred from the claim text.