# US 2024/0202129 A1 · Swtiching controller, storage device and computing system for improving difference of access latency between memories

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0202129 A1
- Document ID: US20240202129A1
- Status: Published application
- Kind: A1
- Application number: 18/315,718
- Filed: 2023-05-11
- Published: 2024-06-20
- Earliest claimed: 2022-12-19
- Assignees: SK hynix Inc.
- Applicants: SK hynix Inc.
- Inventors: Min Ho HA
- Web page: https://patentgrep.com/patent/US20240202129A1

## CPC

- G06F 12/0888: using selective caching, e.g. bypass
- G06F 3/06: Digital input from, or digital output to, record carriers {, e.g. RAID, emulated record carriers or networked record carriers}
- G06F 3/0656: {Data buffering arrangements}
- G06F 12/0891: using clearing, invalidating or resetting means
- G06F 2212/1024: Latency reduction
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A switching controller controlling communication between a processor included in an external device and a memory included in a storage device may pre-fetch memory data into a buffer memory inside the switching controller and provides the data to the processor of the external device based on a command input for a predetermined period.

## Claims

### Claim 1

A storage device comprising:
a plurality of memories; and
a switching controller configured to communicate with each of the plurality of memories and to transmit a command input by a plurality of external devices to at least one of the plurality of memories, each of the plurality of memories including a plurality of storage blocks,
wherein the switching controller comprises,
a buffer memory corresponding to at least one of the plurality of external devices, and
a buffer memory control module configured to select data stored in at least one of the plurality of storage blocks and to store the selected data in the buffer memory, or to delete data stored in the buffer memory, based on the command input for a predetermined period.

### Claim 2 (depends on 1)

The storage device of claim 1, wherein the buffer memory control module selects the data stored in the at least one of the plurality of storage blocks based on at least one of an access frequency for each of the plurality of memories or an access frequency for each of the plurality of storage blocks according to the command input during the predetermined period, and stores the selected data in the buffer memory.

### Claim 3 (depends on 1)

The storage device of claim 1, wherein the buffer memory control module selects the data stored in the at least one of the plurality of storage blocks based on a read request frequency for the data during the predetermined period.

### Claim 4 (depends on 1)

The storage device of claim 1, wherein the buffer memory control module selects the data stored in the at least one of the plurality of storage blocks adjacent to a storage block whose data is stored in the buffer memory based on at least one of an access frequency and a read request frequency during the predetermined period, and stores the selected data in the buffer memory.

### Claim 5 (depends on 1)

The storage device of claim 1, wherein the at least one of the plurality of memories comprises a storage block including a first area accessed by a first external device and a second area accessed by a second external device.

### Claim 6 (depends on 5)

The storage device of claim 5, wherein the buffer memory control module determines, based on the sum of at least one of an access frequency or a read request frequency for the first area and at least one of an access frequency or a read request frequency for the second area, whether to store data of the storage block, including data of the first area and the second area, in the buffer memory.

### Claim 7 (depends on 5)

The storage device of claim 5, wherein the buffer memory control module determines, based on whether an access frequency or a read request frequency for the first area is equal to or greater than a preset reference value, or whether an access frequency or a read request frequency for the second area is equal to or greater than the preset reference value, whether to store data of the storage block, including data of the first area and the second area, in the buffer memory.

### Claim 8 (depends on 7)

The storage device of claim 7, wherein when the access frequency or the read request frequency for the first area is equal to or greater than the preset reference value, the buffer memory control module stores data of the storage block, including data of the first area and the second area, in the buffer memory.

### Claim 9 (depends on 8)

The storage device of claim 8, wherein, when a read request for data stored in the second area is issued by an external device, the data of the second area stored in the buffer memory is provided to the external device.

### Claim 10 (depends on 1)

The storage device of claim 1, wherein the switching controller further comprises a routing module for transmitting the command input by the plurality of external devices to at least one of the plurality of memories or the buffer memory.

### Claim 11 (depends on 10)

The storage device of claim 10, wherein the routing module transmits the command input by one of the plurality of external devices to the buffer memory, and
wherein, if data corresponding to the command input is stored in the buffer memory, the data stored in the buffer memory is transmitted to the one of the plurality of external devices through the routing module.

### Claim 12 (depends on 11)

The storage device of claim 11, wherein, when the data stored in the buffer memory is transmitted to the one of the plurality of external devices through the routing module, the buffer memory control module updates at least one of an access frequency or a read request frequency for the at least one of the plurality of storage blocks including the same data stored in the buffer memory.

### Claim 13 (depends on 11)

The storage device of claim 11, wherein, when data corresponding to the command input by one of the plurality of external devices is not stored in the buffer memory, the routing module transmits the command input to at least one of the plurality of memories, and
wherein the data stored in the at least one of the plurality of memories is transmitted to the one of the plurality of external devices through the routing module.

### Claim 14 (depends on 1)

The storage device of claim 1, wherein each of the plurality of external devices comprises at least one local memory.

### Claim 15 (depends on 1)

The storage device of claim 1, wherein the switching controller communicates with each of the plurality of external devices through the same interface as an interface communicating with each of the plurality of memories.

### Claim 16

A switching controller comprising:
at least one buffer memory;
a buffer memory control module configured to select data stored in at least one of a plurality of storage blocks included in each of a plurality of memories and to store the selected data into the at least one buffer memory, or delete data stored in the at least one buffer memory, based on a command for a predetermined period by a plurality of external devices; and
a routing module configured to transmit the command by the plurality of external devices to the plurality of memories or the at least one buffer memory.

### Claim 17 (depends on 16)

The switching controller of claim 16, wherein, when the command is input by the plurality of external devices, the routing module transmits the command to the at least one buffer memory, and
wherein, when data corresponding to the command is stored in the at least one buffer memory, the data stored in the at least one buffer memory is transmitted to at least one of the plurality of external devices through the routing module.

### Claim 18 (depends on 17)

The switching controller of claim 17, wherein, if data corresponding to the command is not stored in the at least one buffer memory, the routing module transmits the command to at least one of the plurality of memories, and data stored in the at least one of the plurality of memories is transmitted to at least one of the plurality of external devices through the routing module.

### Claim 19

A computing system comprising:
a plurality of external devices; and
a storage device including a buffer memory and comprising a plurality of memories and a switching controller for communicating with the plurality of memories and transmitting a command input by the plurality of external devices to at least one of the plurality of memories;
wherein entire data of a storage block included in at least one of the plurality of memories is stored in the buffer memory based on a command input to the storage device by a first external device of the plurality of external devices, and a part of the entire data stored in the buffer memory is transmitted to a second external device through the switching controller according to a command input to the storage device by the second external device.

### Claim 20 (depends on 19)

The computing system of claim 19, wherein, if the part of the entire data is transmitted to the second external device through the switching controller, at least one of an access frequency or a read request frequency for the entire data stored in the buffer memory is updated.
