Systems and apparatuses for aggregating nodes to form an aggregated virtual storage for a virtualized desktop environment

A node storage aggregator comprising:

• interfaces configured to exchange data with nodes;
• a hash generator configured to generate a hash value for a portion of data;
• a metadata generator configured to generate data structures to store metadata in each of the nodes, the metadata including the hash value for the portion of data and node identifiers specifying a subset of nodes at which the portion of data is to be stored;
• a duplication module configured to generate duplicate portions of the data, and to store each of the duplicate portions of the data at each node in the subset of nodes;
• and
• a redundant node access module configured to read the metadata in parallel from each of the nodes, to determine non-responsive nodes in the subset of nodes, and to extract at least one duplicate portion of the data from responsive nodes in the subset of nodes.

A system including one or more processors and one or more memories, the system comprising:

• an aggregated virtual storage comprising subsets of memories in subsets of servers;
• a hypervisor comprising one or more computing devices including processors and memory including executable instructions configured to provide a virtualization layer for a plurality of virtual desktop machines;
• a deduplication application including executable instructions to deduplicate data received from a virtual desktop machine as the data is written to the aggregate virtual storage;
• and
• a node storage aggregator configured to disperse duplicative data comprising copies of original data by distributing the copies of original data and the original data among the subset of servers or a portion thereof, and generate a data structure for storage in each memory in a subset of memories in a subset of servers, each of the data structures being further configured to store a reference to duplicative data stored in a first number of servers in the subset of servers,
• wherein the duplicative data provides redundancy when a second number of servers in the subset of servers are inaccessible.

A method, comprising:

• exchanging data with nodes through interfaces of a node storage aggregator;
• generating, with a processor, a hash value for a portion of data;
• generating data structures to store metadata in each of the nodes, the metadata including the hash value for the portion of data and node identifiers specifying a subset of nodes at which the portion of data is to be stored;
• generating duplicate portions of the data;
• storing each of the duplicate portions of the data at each node in the subset of nodes;
• and
• reading the metadata in parallel from each of the nodes to determine non-responsive nodes in the subset of nodes, and to extract at least one duplicate portion of the data from responsive nodes in the subset of nodes.