# US 2021/0241804 A1 · Apparatus and method for improving input/output throughput of memory system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0241804 A1
- Document ID: US20210241804A1
- Status: Published application
- Kind: A1
- Application number: 17/234,624
- Filed: 2021-04-19
- Published: 2021-08-05
- Earliest claimed: 2019-07-15
- Assignees: SK hynix Inc.
- Applicants: SK hynix Inc.
- Inventors: Jeen PARK
- Web page: https://patentgrep.com/patent/US20210241804A1

## CPC

- G11C 7/1042: {using interleaving techniques, i.e. read-write of one part of the memory while preparing another part}
- G11C 29/50012: {of timing}
- G06F 13/1642: {with request queuing}
- G11C 7/1051: {Data output circuits, e.g. read-out amplifiers, data output buffers, data output registers, data output level conversion circuits}
- G11C 7/1078: {Data input circuits, e.g. write amplifiers, data input buffers, data input registers, data input level conversion circuits}
- G11C 7/22: Read-write [R-W] timing or clocking circuits; Read-write [R-W] control signal generators or management
- G11C 29/44: Indication or identification of errors, e.g. for repair
- G11C 2029/0409: {Online test}
- G11C: STATIC STORES (semiconductor memory devices H10B)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A memory system includes: a plurality of memory dies, and a controller selects a second read request, including at least a portion of a plurality of first read requests, so that the memory dies interleave and output data corresponding to the first read requests, and performs a correlation operation for the selected second read request, when the second read request is selected, the controller determines whether the correlation operation is performed or not before a time at which the second read request is selected, determines whether the correlation operation is successful or not, determines a pending credit in response to an operation state of the memory dies at the time at which the second read request is selected, and determines whether to perform the correlation operation or not for the second read request that is selected at the time at which the second read request is selected based on the pending credit.

## Claims

### Claim 1

A memory system, comprising:
a plurality of memory dies; and
a controller that is coupled to the memory dies through a plurality of channels,
the controller comprising circuitry that:
selects a second read request, including at least a portion of a plurality of first read requests transferred from an external device, so that the memory dies interleave and output data corresponding to the first read requests through the channels, and
performs a correlation operation for the selected second read request based on a pending credit,
wherein, when the second read request is selected, the controller increases or decreases the pending credit in response to an operation state of the memory dies at the time at which the second read request is selected.

### Claim 2 (depends on 1)

The memory system of claim 1, wherein the controller increases or decrease the pending credit according to whether the correlation operation is performed or not before a time at which the second read request is selected.

### Claim 3 (depends on 2)

The memory system of claim 2, wherein, when the correction operation is performed before a time at which the second read request is selected, the controller increases or decrease the pending credit according to whether the performed correlation operation is successful or not.

### Claim 4 (depends on 3)

The memory system of claim 3, wherein when the pending credit is less than a reference value, the controller processes the selected second read request without performing the correlation operation, and
when the pending credit is equal to or greater than the reference value, the controller performs the correlation operation for the selected second read request.

### Claim 5 (depends on 4)

The memory system of claim 4, wherein the controller decreases the pending credit when at least one of the memory dies is in an idle state at the time at which the second read request is selected.

### Claim 6 (depends on 5)

The memory system of claim 5, wherein the amount by which the pending credit is decreased is based on the number of memory dies that are in an idle state when the second read request is selected.

### Claim 7 (depends on 4)

The memory system of claim 4, wherein the controller increases the pending credit when the second read request is processed without performing the correlation operation before the time at which the second read request is selected.

### Claim 8 (depends on 7)

The memory system of claim 7, wherein the amount by which the pending credit is decreased is based on an expected processing time of the second read request that is processed without performing the correlation operation before the time at which the second read request is selected.

### Claim 9 (depends on 4)

The memory system of claim 4, wherein the controller adjusts an amount by which the pending credit is increased based on how much time expected to be saved due to the success of the correlation operation that is performed before the time at which second read request is selected, and adjusts an amount by which the pending credit is decreased based on an amount of time consumed due to the failure of the correlation operation that is performed before the time at which the second read request is selected.

### Claim 10 (depends on 4)

The memory system of claim 4, wherein when the second read request is not selected for more than a reference time after determining whether to perform the correlation operation or not based on the pending credit, and
the controller resets the pending credit to an initial value that is smaller than the reference value.

### Claim 11

A memory system, comprising:
a plurality of memory; and
a controller that is coupled to the memory dies through a plurality of channels,
the controller comprising circuitry that:
selects a second read request, including at least a portion of a plurality of first read requests transferred from an external device, so that the memory dies interleave and output data corresponding to the first read requests through the channels, and
performs a correlation operation for the selected second read request based on a pending credit,
wherein, when the second read request is selected, the controller increases or decreases the pending credit according to whether the correlation operation is performed or not before a time at which the second read request is selected.

### Claim 12 (depends on 11)

The memory system of claim 11, wherein the controller increases or decrease the pending credit in response to an operation state of the memory dies at the time at which the second read request is selected.

### Claim 13 (depends on 12)

The memory system of claim 12, wherein, when the correction operation is performed before a time at which the second read request is selected, the controller increases or decrease the pending credit according to whether the performed correlation operation is successful or not.

### Claim 14 (depends on 13)

The memory system of claim 13, wherein when the pending credit is less than a reference value, the controller processes the selected second read request without performing the correlation operation, and
when the pending credit is equal to or greater than the reference value, the controller performs the correlation operation for the selected second read request.

### Claim 15 (depends on 14)

The memory system of claim 14, wherein the controller decreases the pending credit when at least one of the memory dies is in an idle state at the time at which the second read request is selected.

### Claim 16 (depends on 15)

The memory system of claim 15, wherein the amount by which the pending credit is decreased is based on the number of memory dies that are in an idle state when the second read request is selected.

### Claim 17 (depends on 14)

The memory system of claim 14, wherein the controller increases the pending credit when the second read request is processed without performing the correlation operation before the time at which the second read request is selected.

### Claim 18 (depends on 17)

The memory system of claim 17, wherein the amount by which the pending credit is decreased is based on an expected processing time of the second read request that is processed without performing the correlation operation before the time at which the second read request is selected.

### Claim 19 (depends on 14)

The memory system of claim 14, wherein the controller adjusts an amount by which the pending credit is increased based on how much time expected to be saved due to the success of the correlation operation that is performed before the time at which second read request is selected, and adjusts an amount by which the pending credit is decreased based on an amount of time consumed due to the failure of the correlation operation that is performed before the time at which the second read request is selected.

### Claim 20 (depends on 14)

The memory system of claim 14, wherein when the second read request is not selected for more than a reference time after determining whether to perform the correlation operation or not based on the pending credit, and
the controller resets the pending credit to an initial value that is smaller than the reference value.
