# US 2020/0351370 A1 · Fault tolerant data coherence in large-scale distributed cache systems

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0351370 A1
- Document ID: US20200351370A1
- Status: Published application
- Kind: A1
- Application number: 16/697,019
- Filed: 2019-11-26
- Published: 2020-11-05
- Earliest claimed: 2019-05-03
- Assignees: Western Digital Technologies, Inc.
- Applicants: Western Digital Technologies, Inc.
- Inventors: Marjan Radi; Dejan Vucinic
- Web page: https://patentgrep.com/patent/US20200351370A1

## CPC

- G06F 12/0862: with prefetch
- G06F 12/0802: Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G06F 12/0806: Multiuser, multiprocessor or multiprocessing cache systems
- G06F 12/0817: using directory methods
- G06F 12/082: {Associative directories (G06F12/0822 takes precedence)}
- G06F 12/0822: {Copy directories (local copy tags for implementing a bus snooping protocol G06F12/0831)}
- G06F 12/0828: {with concurrent directory accessing, i.e. handling multiple concurrent coherency transactions}
- H04L 67/1097: for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
- H04L 67/568: Storing data temporarily at an intermediate stage, e.g. caching
- G06F 9/34: Addressing or accessing the instruction operand or the result {; Formation of operand address; Addressing modes (address translation G06F12/00)}
- G06F 9/3824: {Operand accessing}
- G06F 2212/154: Networked environment
- G06F 2212/602: Details relating to cache prefetching
- G06F 2212/6028: Prefetching based on hints or prefetch instructions
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A programmable switch includes a plurality of ports for communication with devices on a network. Circuitry of the programmable switch is configured to receive a cache line request from a client on the network to obtain a cache line for performing an operation by the client. A port is identified for communicating with a memory device storing the cache line. The memory device is one of a plurality of memory devices used for a distributed cache. The circuitry is further configured to update a cache directory for the distributed cache based on the cache line request, and send the cache line request to the memory device using the identified port. In one aspect, it is determined whether the cache line request is for modifying the cache line.

## Claims

### Claim 1

A programmable switch, comprising:
a plurality of ports for communication with devices on a network; and
circuitry configured to:
receive a cache line request from a client on the network to obtain a cache line for performing an operation by the client;
identify a port of the plurality of ports for communicating with a memory device storing the cache line, wherein the memory device is one of a plurality of memory devices used for a distributed cache;
update a cache directory for the distributed cache based on the cache line request; and
send the cache line request to the memory device using the identified port.

### Claim 2 (depends on 1)

The programmable switch of claim 1, wherein the circuitry is further configured to:
receive an additional cache line request from a different client to obtain the cache line;
determine a status of the cache line as being in progress of being modified by the client based on the updated cache directory; and
send a new request for a modified version of the cache line to the client to return the modified version of the cache line to the memory device.

### Claim 3 (depends on 1)

The programmable switch of claim 1, wherein the circuitry is further configured to:
determine whether the cache line request is for modifying the cache line; and
in response to determining that the cache line request is for modifying the cache line, updating a version number for the cache line in the cache directory.

### Claim 4 (depends on 1)

The programmable switch of claim 1, wherein the cache line request follows a custom packet format including one or more fields indicating a permission level for the operation to be performed by the client.

### Claim 5 (depends on 1)

The programmable switch of claim 1, wherein the cache line request follows a custom packet format including one or more fields indicating that the cache line request is a cache line memory message.

### Claim 6 (depends on 1)

The programmable switch of claim 1, wherein the programmable switch forms part of a Software Defined Networking (SDN).

### Claim 7 (depends on 1)

The programmable switch of claim 1, wherein the cache directory is configured to include network addresses for multiple devices on the network that store data corresponding to a memory address for the cache line.

### Claim 8 (depends on 1)

The programmable switch of claim 1, wherein the circuitry is further configured to send an indication of the cache directory update to at least one of another programmable switch on the network and a Software Defined Networking (SDN) controller to update one or more mirrored cache directories.

### Claim 9 (depends on 1)

The programmable switch of claim 1, wherein the circuitry is further configured to:
receive a request from a controller on the network for version numbers for cache lines that have been modified; and
send the controller version numbers for the cache lines that have been modified.

### Claim 10

A method of providing a distributed cache, the method comprising:
receiving a cache line request from a client on a network to obtain a cache line from a memory device of a plurality of memory devices used for a distributed cache;
determining whether the cache line request is for modifying the cache line;
updating a cache directory for the distributed cache based on the cache line request; and
sending the cache line request to the memory device.

### Claim 11 (depends on 10)

The method of claim 10, further comprising:
receiving an additional cache line request from a different client to obtain the cache line;
determining a status of the cache line as being in progress of being modified by the client based on the updated cache directory; and
sending a new request for a modified version of the cache line to the client to return the modified version of the cache line to the memory device.

### Claim 12 (depends on 10)

The method of claim 10, wherein in response to determining that the cache line request is for modifying the cache line, the method further comprises updating a version number for the cache line in the cache directory.

### Claim 13 (depends on 10)

The method of claim 10, wherein the cache line request follows a custom packet format including one or more fields indicating a permission level for determining whether the cache line is to be modified or read by the client.

### Claim 14 (depends on 10)

The method of claim 10, wherein the cache line request follows a custom packet format including one or more fields indicating that the cache line request is a cache line memory message.

### Claim 15 (depends on 10)

The method of claim 10, wherein the cache directory is updated by a programmable switch that forms part of a Software Defined Networking (SDN).

### Claim 16 (depends on 10)

The method of claim 10, wherein the cache directory is configured to include network addresses for multiple devices on the network that store data corresponding to a memory address for the cache line.

### Claim 17 (depends on 10)

The method of claim 10, further comprising sending an indication of the cache directory update to at least one of a programmable switch on the network and a Software Defined Networking (SDN) controller to update one or more mirrored cache directories.

### Claim 18 (depends on 10)

The method of claim 10, further comprising:
receiving a request from a controller on the network for version numbers for cache lines that have been modified; and
sending version numbers to the controller for the cache lines that have been modified.

### Claim 19 (depends on 10)

The method of claim 10, wherein a status of the cache line in the cache directory indicates that multiple clients on the network have a shared read-only permission level.

### Claim 20

A non-transitory computer readable medium storing computer-executable instructions, wherein when the computer-executable instructions are executed by circuitry of a programmable switch, the computer-executable instructions cause the circuitry to:
receive a cache line request from a client to obtain a cache line for performing an operation by the client;
identify a port from among a plurality of ports of the programmable switch for communicating with a memory device storing the cache line, wherein the memory device is one of a plurality of memory devices used for a distributed cache;
update a cache directory for the distributed cache based on the cache line request; and
send the cache line request to the memory device using the identified port.

### Claim 21

A system for a distributed cache, the system comprising:
a plurality of memory devices storing at least part of the distributed cache;
a first programmable switch in communication with one or more of the plurality of memory devices, the first programmable switch including first circuitry; and
a second programmable switch in communication with the first programmable switch and with one or more of the plurality of memory devices, the second programmable switch including second circuitry; and
wherein the first circuitry and the second circuitry are configured to update respective cache directories for the distributed cache based on cache line requests received by at least one of the first programmable switch and the second programmable switch.

### Claim 22 (depends on 21)

The system of claim 21, wherein the first circuitry is further configured to send to the second programmable switch an indication of an update to the cache directory of the first programmable switch.

### Claim 23 (depends on 22)

The system of claim 22, wherein the second circuitry is further configured to update the cache directory of the second programmable switch in response to receiving the indication of the update to the cache directory of the first programmable switch.

### Claim 24 (depends on 21)

The system of claim 21, wherein the first circuitry is further configured to send an indication of an update to the cache directory of the first programmable switch to a Software Defined Networking (SDN) controller.

### Claim 25 (depends on 21)

The system of claim 21, wherein the first circuitry is further configured to:
receive a request from a controller in communication with the first programmable switch for version numbers for cache lines that have been modified; and
send the controller version numbers for the cache lines that have been modified.

### Claim 26 (depends on 21)

The system of claim 21, wherein the first circuitry is further configured to:
receive a cache line request from a client to obtain a cache line for performing an operation by the client;
identify a port from among a plurality of ports of the first programmable switch for communicating with a memory device of the plurality of memory devices that stores the cache line;
update the cache directory of the first programmable switch based on the cache line request; and
send the cache line request to the memory device using the identified port.

### Claim 27 (depends on 26)

The system of claim 26, wherein the first circuitry is further configured to:
receive an additional cache line request from a different client to obtain the cache line;
determine a status of the cache line as being in progress of being modified by the client based on the updated cache directory; and
send a new request for a modified version of the cache line to the client to return the modified version of the cache line to the memory device.

### Claim 28 (depends on 26)

The system of claim 26, wherein the first circuitry is further configured to:
determine whether the cache line request is for modifying the cache line; and
in response to determining that the cache line request is for modifying the cache line, update a version number for the cache line in the cache directory of the first programmable switch.

### Claim 29 (depends on 26)

The system of claim 26, wherein the cache line request follows a custom packet format including one or more fields indicating a permission level for determining whether the cache line is to be modified or read by the client.

### Claim 30 (depends on 26)

The system of claim 26, wherein the cache line request follows a custom packet format including one or more fields indicating that the cache line request is a cache line memory message.

### Claim 31 (depends on 21)

The system of claim 21, wherein each cache directory of the first programmable switch and the second programmable switch is configured to include network addresses for multiple devices that store data corresponding to a memory address for a cache line.
