# US 2024/0256448 A1 · Sense amplifiers as static random access memory cache

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0256448 A1
- Document ID: US20240256448A1
- Status: Published application
- Kind: A1
- Application number: 18/414,640
- Filed: 2024-01-17
- Published: 2024-08-01
- Earliest claimed: 2023-01-31
- Assignees: Micron Technology, Inc.
- Applicants: Micron Technology, Inc.
- Inventors: Peter L. Brown; Glen E. Hush; Troy A. Manning; Timothy P. Finkbeiner; Troy D. Larsen
- Web page: https://patentgrep.com/patent/US20240256448A1

## CPC

- G06F 12/0215: {with look ahead addressing means}
- G06F 12/0802: Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G11C 7/065: {Differential amplifiers of latching type}
- G11C 7/08: Control thereof
- G11C 11/4091: Sense or sense/refresh amplifiers, or associated sense circuitry, e.g. for coupled bit-line precharging, equalising or isolating
- G11C 11/4094: Bit-line management or control circuits
- G11C 11/4096: Input/output [I/O] data management or control circuits, e.g. reading or writing circuits, I/O drivers or bit-line switches
- G06F 2212/1024: Latency reduction
- G06F 2212/1028: Power efficiency
- G06F 2212/1032: Reliability improvement, data loss prevention, degraded operation etc
- G06F 2212/1041: Resource optimization
- G06F 2212/221: Static RAM
- G11C 2207/2245: Memory devices with an internal cache buffer
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G11C: STATIC STORES (semiconductor memory devices H10B)

## Abstract

Methods, systems, and devices related to sense amplifiers of a memory device serving as a Static Random Access Memory (SRAM) cache. For example, a memory array can be coupled to sense amplifiers. In a first mode, the sense amplifiers can be electrically disconnect from digit lines of the memory array. In the first mode, data and metadata of a cache line can be stored in the sense amplifiers when electrically disconnected from the number of digit lines. In the first mode, a portion of the data can be communicated, based on the metadata, from the sense amplifiers to the processing device. In a second mode, the sense amplifiers can connect to the memory array and sense data from the memory array.

## Claims

### Claim 1

An apparatus, comprising:
a memory array; and
a plurality of sense amplifiers coupled to the memory array and configured to:
in a first mode:
electrically disconnect from a number of digit lines of the memory array;
store first data and metadata when electrically disconnected from the number of digit lines, wherein the first data and the metadata comprise a cache line; and
communicate, based on the metadata, a portion of the first data of the cache line to a processing device external to the memory array and the plurality of sense amplifiers; and
in a second mode:
connect to the memory array; and
sense second data from the memory array.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the plurality of sense amplifiers are further configured to, in the first mode, serve as a static random access memory (SRAM) cache coupled to the processing device.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the plurality of sense amplifiers are further configured to, in the first mode:
receive third data of a different cache line from the processing device; and
store the third data when electrically disconnected from the number of digit lines.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the plurality of sense amplifiers are further configured to, in the first mode, perform a logical AND operation and a logical OR operation in association with masking a different portion of the first data stored in the plurality of sense amplifiers.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the memory array comprises a dynamic random access memory (DRAM) array.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the processing device is on-chip with the memory array and the plurality of sense amplifiers.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the plurality of sense amplifiers are further configured to:
prior to a refresh of the memory array:
switch from the first mode to the second mode; and
in the second mode, transfer the cache line from the plurality of sense amplifiers to a row of memory cells of the memory array; and
in the second mode and subsequent to the refresh, sense the cache line from the row of the memory cells,
wherein the row of memory cells is dedicated to storage of cache lines transferred from the plurality of sense amplifiers during the refresh of the memory array.

### Claim 8

A method, comprising:
storing first data of a first cache line and first metadata of the first cache line in a row of memory cells of a memory array of a dynamic random access memory (DRAM) device having a plurality of sense amplifiers coupled thereto, wherein first metadata is associated with the first data;
operating the plurality of sense amplifiers in a first mode in association with sensing second data stored in the array of memory cells; and
operating the plurality of sense amplifiers in a second mode in which the plurality of sense amplifiers serve as a static random access memory (SRAM) cache.

### Claim 9 (depends on 8)

The method of claim 8, further comprising, in the second mode:
communicating at least a portion of the first data from the plurality of sense amplifiers to a host coupled to the DRAM device; and
receiving, by the plurality of sense amplifiers, third data of a second cache line from the host.

### Claim 10 (depends on 9)

The method of claim 9, further comprising, in the second mode, prefetching a plurality of words of the second cache line from the plurality of sense amplifiers,
wherein prefetching the plurality of words comprises prefetching a corresponding tag associated with second metadata a single time, wherein the second metadata is associated with the second cache line.

### Claim 11 (depends on 9)

The method of claim 9, wherein the row of memory cells comprises a first row of memory cells of the memory array, and
wherein operating the plurality of sense amplifiers in the second mode comprises:
performing, using the plurality of sense amplifiers, a first logical AND operation on third data stored in the plurality of sense amplifiers and fourth data stored in a second row of memory cells of the memory array;
writing a result of the first logical AND operation stored in the plurality of sense amplifiers to a third row of memory cells of the memory array;
sensing, using the plurality of sense amplifiers, the first data and the first metadata from the first row of memory cells;
performing, using the plurality of sense amplifiers, a second logical AND operation on the first data and the first metadata stored in the plurality of sense amplifiers and fifth data stored in a fourth row of memory cells of the memory array; and
performing, using the plurality of sense amplifiers, a logical OR operation on a result of the second logical AND operation stored in the plurality of sense amplifiers and the result of the first logical AND operation stored in the third row of memory cells.

### Claim 12 (depends on 8)

The method of claim 8, further comprising:
writing third data and second metadata of a second cache line received from the host to the row of memory cells,
wherein the second metadata is associated with the third data; and
storing the first data, the first metadata, the third data, and the second metadata in the row of memory cells concurrently.

### Claim 13 (depends on 12)

The method of claim 12, wherein the row of memory cells comprises a first row of memory cells of the memory array, and
wherein writing the third data and the second metadata to the first row of memory cells comprises:
writing the third data and the second metadata stored in the plurality of sense amplifiers to a second row of memory cells of the memory array;
performing, using the plurality of sense amplifiers, a first logical AND operation on fourth data stored in the plurality of sense amplifiers and fifth data stored in a third row of memory cells of the memory array;
writing a result of the first logical AND operation stored in the plurality of sense amplifiers to a third row of memory cells of the memory array;
sensing, using the plurality of sense amplifiers, sixth data from the first row of memory cells;
performing, using the plurality of sense amplifiers, a second logical AND operation on the sixth data stored in the plurality of sense amplifiers and seventh data stored in a fourth row of memory cells of the memory array;
performing, using the plurality of sense amplifiers, a logical OR operation on a result of the second logical AND operation stored in the plurality of sense amplifiers and the result of the first logical AND operation stored in the third row of memory cells; and
writing a result of the logical OR operation stored in the plurality of sense amplifiers to the first row of memory cells.

### Claim 14

A system, comprising:
a memory device comprising a plurality of banks, each bank comprising a respective memory array coupled to a respective plurality of sense amplifiers; and
a processing device that is on-chip with and coupled to the memory device,
wherein each respective plurality of sense amplifiers is configured to:
in a first mode, store a plurality of cache lines, wherein each cache line comprises respective data and respective metadata;
in the first mode, communicate first data of a first cache line to the processing device;
in the first mode, store second data of a second cache line received from the processing device; and
in a second mode, sense third data from the memory array, wherein the third data is unassociated with a cache line.

### Claim 15 (depends on 14)

The system of claim 14, wherein each respective memory array of the plurality of banks is configured to:
store the data of the plurality of cache lines in a first portion of the memory array corresponding to a first address space of the memory array; and
store the metadata of the plurality of cache lines in a second portion of the memory array corresponding to a second address space of the memory array that is different than the first address space of the memory array.

### Claim 16 (depends on 15)

The system of claim 15, wherein the first portion of the memory array and the second portion of the memory array comprise a physically contiguous portion of the memory array.

### Claim 17 (depends on 15)

The system of claim 15, wherein each respective memory array is configured to store data unassociated with the plurality of cache lines in a third portion of the memory array,
wherein the third portion of the memory array correspond to a third address space of the memory array that is different than the first address space and the second address space.

### Claim 18 (depends on 14)

The system of claim 14, wherein each respective plurality of sense amplifiers is configured to, in association with the first mode, perform logical AND operations and logical OR operations in association with:
sensing a particular one of the plurality of cache lines from the memory array by the plurality of sense amplifiers; and
writing a different cache line, stored in the plurality of sense amplifiers, to the memory array.

### Claim 19 (depends on 14)

The system of claim 14, wherein each respective plurality of sense amplifiers is further configured to write a cache line stored therein to the memory array in advance of a refresh of the memory array.

### Claim 20 (depends on 14)

The system of claim 14, wherein each respective bank further comprises a multiplexer coupled to the plurality of sense amplifiers and an input/output (I/O) line of the memory device,
wherein the multiplexer is configured to receive a selection signal based on a cache hit, wherein the cache hit is determined based on the first metadata.
