# US 2018/0321868 A1 · Devices, systems, and methods for reducing storage utilization with data deduplication

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0321868 A1
- Document ID: US20180321868A1
- Status: Published application
- Kind: A1
- Application number: 15/969,733
- Filed: 2018-05-02
- Published: 2018-11-08
- Earliest claimed: 2017-05-02
- Assignees: Smart Iops, Inc.
- Applicants: Smart IOPS, Inc.
- Inventors: Manuel Antonio d'Abreu; Ashutosh Kumar Das
- Web page: https://patentgrep.com/patent/US20180321868A1

## CPC

- G06F 3/0641: {De-duplication techniques}
- G06F 3/0608: {Saving storage space on storage systems}
- G06F 3/0688: {Non-volatile semiconductor memory arrays}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

In some aspects, devices, systems, and methods are provided that relate to data deduplication performed in data storage devices, such as solid-state drives (SSD) or drives of any other type. In some aspects, devices, systems, and methods are provided that relate to hierarchical data deduplication at a local and system level, such as in a storage system built with one or more SSDs having built-in data deduplication functionality. The hierarchical data deduplication utilizes the IDs in the data storage devices to decide if the incoming data has to be stored or if a copy of the incoming data is already stored. In hierarchical data deduplication, no IDs (or signatures) are required to be stored at a system level. In some aspects, data steering is provided that enables data storing coordination in a system that consists of a set of data storage device (e.g., SSDs) having built-in data deduplication.

## Claims

### Claim 1

A data storage device, comprising:
a plurality of memory devices comprising memory; and
a controller coupled to the plurality of memory devices and comprising logic to:
receive first data to be stored in the plurality of memory devices;
perform a first check to determine if a copy of the first data is already stored in the plurality of memory devices;
determine that the copy of the first data is already stored in the plurality of memory devices; and
store a pointer to the copy of the first data in the plurality of memory devices instead of storing the first data in the plurality of memory devices.

### Claim 2 (depends on 1)

The data storage device of claim 1, wherein the performing of the first check comprises computing a first ID for the first data, and wherein the determining that the copy of the first data is already stored in the plurality of memory devices comprises determining if the first ID exists in a table of IDs maintained by the controller, the table of IDs comprising IDs for data stored in the plurality of memory devices.

### Claim 3 (depends on 2)

The data storage device of claim 2, wherein the controller further comprises logic to:
receive second data to be stored in the plurality of memory devices, the second data different than the first data;
perform a second check to determine if a copy of the second data is already stored in the plurality of memory devices;
determine that the copy of the second data is not already stored in the plurality of memory devices; and
store the second data in the plurality of memory devices.

### Claim 4 (depends on 3)

The data storage device of claim 3, wherein the performing of the first check comprises computing a first ID for the first data;
wherein the determining that the copy of the first data is already stored in the plurality of memory devices comprises determining if the first ID exists in a table of IDs maintained by the controller, the table of IDs comprising IDs for data stored in the plurality of memory devices;
wherein the performing of the second check comprises computing a second ID for the second data; and
wherein the determining that the copy of the second data is not already stored in the plurality of memory devices comprises determining if the second ID exists in the table of IDs maintained by the controller.

### Claim 5 (depends on 4)

The data storage device of claim 4, wherein the controller further comprises logic to:
encode the second data according to one or more error-correcting code (ECC) techniques before storing the second data in the plurality of memory devices.

### Claim 6 (depends on 5)

The data storage device of claim 5, further comprising:
one or more memory cards coupled to the controller, the one or more memory cards comprising the plurality of memory devices; and
an interface to communicate with an accessing device, wherein the first data and the second data are received from the accessing device.

### Claim 7 (depends on 1)

The data storage device of claim 1, wherein the data storage device includes or corresponds to a solid-state drive (SSD).

### Claim 8 (depends on 1)

The data storage device of claim 1, wherein the controller further comprises logic to:
disable and enable performing checks to determine if copies of received data are already stored in the plurality of memory devices.

### Claim 9 (depends on 1)

The data storage device of claim 1, wherein the controller further comprises logic to:
maintain a table of IDs for data stored locally on the data storage device;
receive queries to determine if IDs exist locally on the data storage device;
search for the queried IDs locally on the data storage device; and
send responses to the queries indicating whether the queried IDs exist locally on the data storage device.

### Claim 10

A storage system, comprising:
a plurality of interfaces configured to couple to a plurality of data storage devices;
a processing component coupled to the plurality of interfaces to enable communication with the plurality of data storage devices when coupled to the plurality of interfaces;
memory coupled to the processing component, the memory comprising instructions, which when executed by the processing component, cause the processing component to:
receive first data to be stored in the plurality of data storage devices;
compute a first ID for the first data;
initiate a first query for each of the plurality of data storage devices to locally search for the first ID, wherein each of the plurality of data storage devices maintains a table of IDs for data stored locally;
receive responses to the first query from each of the plurality of data storage devices, wherein a first response to the first query is received from a first data storage device of the plurality of data storage devices, wherein the first response indicates that the first ID exists in a first table of IDs in the first data storage device; and
as a result of receiving the first response, store a pointer to a copy of the first data stored in the first data storage device instead of storing the first data in the plurality of memory devices, wherein the copy of the first data is linked to the first ID in the first table of IDs.

### Claim 11 (depends on 10)

The storage system of claim 10, wherein the instructions further cause the processing component to:
receive second data to be stored in the plurality of data storage devices, the second data different than the first data;
compute a second ID for the second data;
initiate a second query for each of the plurality of data storage devices to locally search for the second ID;
receive responses to the second query from each of the plurality of data storage devices, wherein all of the responses to the second query indicate that the first ID does not exist locally; and
as a result of receiving all of the responses to the second query indicating that the first ID does not exist locally, select one of the plurality of data storage devices to store the second data and send the second data to the selected data storage device for storage in the selected data storage device.

### Claim 12 (depends on 11)

The storage system of claim 11, wherein the first response comprises the pointer to the copy of the first data stored in the first data storage device.

### Claim 13 (depends on 11)

The storage system of claim 11, wherein the instructions further cause the processing component to:
encode the second data according to one or more error-correcting code (ECC) techniques before storing the second data in the selected data storage device.

### Claim 14 (depends on 11)

The storage system of claim 11, further comprising:
an accessing device coupled to the processing component, wherein the accessing device is configured to issue commands to the processing component to read data from or write data to the plurality of data storage devices, and wherein the first data and the second data are received from the accessing device.

### Claim 15 (depends on 11)

The storage system of claim 11, further comprising:
the plurality of data storage devices.

### Claim 16 (depends on 15)

The storage system of claim 15, wherein each of the plurality of data storage devices comprises:
a plurality of memory devices; and
a controller coupled to the plurality of memory devices and comprising logic to:
maintain a table of IDs for data stored locally on the data storage device;
receive queries to determine if IDs exist locally on the data storage device;
search for the queried IDs locally on the data storage device; and
send responses to the queries indicating whether the queried IDs exist locally on the data storage device.

### Claim 17 (depends on 16)

The storage system of claim 16, wherein one or more of the plurality of the data storage devices includes or corresponds to a solid-state drive (SSD).

### Claim 18 (depends on 10)

The storage system of claim 10, wherein the first query is initiated to each of the plurality of data storage devices in parallel.

### Claim 19 (depends on 10)

The storage system of claim 10, wherein the first ID is stored locally in the first data storage device without being stored at a system level.

### Claim 20 (depends on 10)

The storage system of claim 10, wherein the processing component is a management controller.
