# US 2024/0004791 A1 · Controller cache architeture

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0004791 A1
- Document ID: US20240004791A1
- Status: Published application
- Kind: A1
- Application number: 18/202,783
- Filed: 2023-05-26
- Published: 2024-01-04
- Earliest claimed: 2022-06-30
- Assignees: Micron Technology, Inc.
- Applicants: Micron Technology, Inc.
- Inventors: Emanuele Confalonieri; Nicola Del Gatto
- Web page: https://patentgrep.com/patent/US20240004791A1

## CPC

- G06F 12/0802: Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G06F 11/1076: {Parity data used in redundant arrays of independent storages, e.g. in RAID systems}
- G06F 12/0868: Data transfer between cache memory and other subsystems, e.g. storage devices or host systems
- G06F 12/0873: Mapping of cache memory to specific storage devices or parts thereof
- G06F 2212/1024: Latency reduction
- G06F 2212/262: configured as RAID
- G06F 2212/284: being distributed
- G06F 2212/312: In storage controller
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An apparatus can include a plurality of memory devices and a memory controller coupled to the plurality of memory devices via a plurality of memory channels. The plurality of memory channels are organized as a plurality of channel groups, and the memory controller comprises respective independent caches corresponding to the plurality of channel groups.

## Claims

### Claim 1

An apparatus, comprising:
a plurality of memory devices; and
a memory controller coupled to the plurality of memory devices via a plurality of memory channels;
wherein the plurality of memory channels are organized as a plurality of channel groups; and
wherein the memory controller comprises respective independent caches corresponding to the plurality of channel groups.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the plurality of channel groups comprises:
a first channel group comprising a first quantity of the plurality of memory channels; and
a second channel group comprising a second quantity of the plurality of memory channels;
wherein the first channel group includes first error correction circuitry that is operated, by the memory controller, in association with accessing memory devices corresponding to the first quantity of the plurality of memory channels; and
wherein the second channel group includes second error correction circuitry that is operated, by the memory controller and independently from the first error correction circuitry, in association with accessing memory devices corresponding to the second quantity of the plurality of memory channels.

### Claim 3 (depends on 2)

The apparatus of claim 2, wherein the plurality of channel groups comprises:
a third channel group comprising a third quantity of the plurality of memory channels; and
wherein the third channel group includes third error correction circuitry that is operated, by the memory controller and independently from the first error correction circuitry and the second error correction circuitry, in association with accessing memory devices corresponding to the third quantity of the plurality of memory channels.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the memory controller comprises a front end portion that includes a compute express link (CXL) controller coupled to a host via a CXL link.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the memory controller comprises at least three independent caches corresponding to respective channel groups, and wherein each respective channel group comprises at least two memory channels of the plurality of memory channels

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the respective independent caches correspond to different non-overlapping physical address ranges corresponding to the plurality of memory devices.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the apparatus is a high performance computing (HPC) data center.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein the plurality of memory devices are low power double data rate (LPDDR) 5 memory devices.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the memory controller is configured to operate the plurality of channel groups as independent respective reliability, availability, and serviceability (RAS) channels.

### Claim 10 (depends on 9)

The apparatus of claim 9, wherein the memory controller is configured to implement one of a chip kill error correction scheme and a RAID error recovery scheme on a per RAS channel basis.

### Claim 11

A method, comprising:
receiving, at a memory controller, a memory access request;
executing the memory access request by:
based on an address corresponding to the memory access request, determining a particular cache of a plurality of caches of the memory controller to which the address corresponds, wherein the plurality of caches correspond to respective channel groups with each channel group comprising a respective group of memory channels of a plurality of memory channels coupling memory devices to the memory controller; and
accessing memory devices of corresponding memory channels of the channel group to which the particular cache corresponds.

### Claim 12 (depends on 11)

The method of claim 11, further comprising accessing, in parallel, the memory devices of corresponding memory channels of the channel group to which the particular cache corresponds.

### Claim 13 (depends on 11)

The method of claim 11, further comprising operating the plurality of caches independently.

### Claim 14 (depends on 11)

The method of claim 11, wherein executing the memory access request comprises executing a read request.

### Claim 15 (depends on 11)

The method of claim 11, wherein executing the memory access request comprises executing a write request.

### Claim 16 (depends on 11)

The method of claim 11, wherein the respective channel groups include respective independent error correction circuits corresponding thereto.

### Claim 17

A memory controller, comprising:
a front end portion configured to be coupled to a host via an interface;
a back end portion configured to be coupled to a plurality of memory devices via a plurality of memory channels, wherein the plurality of memory channels are organized as a plurality of channel groups; and
a central portion comprising a plurality of independent caches, wherein each cache of the plurality of independent caches corresponds to a different one of the plurality of channel groups.

### Claim 18 (depends on 17)

The memory controller of claim 17, wherein the interface operates in accordance with a compute express link (CXL) protocol.

### Claim 19 (depends on 17)

The memory controller of claim 17, wherein the central portion includes, for each respective channel group:
first error circuitry configured to implement error detection/correction across the plurality of memory channels corresponding to the respective channel group; and
second error circuitry configured to implement error detection/correction on a per memory channel basis.

### Claim 20 (depends on 19)

The memory controller of claim 19, wherein the first error circuitry implements a redundant array of independent disks (RAID) error correction scheme, and wherein the second error circuitry implements an error correcting code (ECC) scheme or a cyclic redundancy check (CRC) scheme.
