Deduplication in a highly-distributed shared topology with direct-memory-access capable interconnect

A system for data storage, comprising:

• at least one storage controller;
• and
• multiple servers, which are configured to communicate over a network with the storage controller and with multiple multi-queue storage devices, to store data blocks on the storage devices, to access, using remote direct memory access, a shared data structure that maps hash values calculated over the data blocks to respective storage locations of the data blocks on the storage devices, and to deduplicate the data blocks stored on the storage device, by looking-up the shared data structure by the servers without executing code on a processor of the storage controller.

A server, comprising:

• a Network Interface Controller (NIC) configured to connect to a network;
• and
• a processor, which is configured to communicate over the network with at least one storage controller and with multiple multi-queue storage devices, to store data blocks on the storage devices, to access, using remote direct memory access, a shared data structure that maps hash values calculated over the data blocks to respective storage locations of the data blocks on the storage devices, and to deduplicate the data blocks stored on the storage device, by looking-up the shared data structure by the servers without executing code on any processor of the storage controller.