# US 2021/0173779 A1 · Method and apparatus for using a storage system as main memory

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0173779 A1
- Document ID: US20210173779A1
- Status: Published application
- Kind: A1
- Application number: 17/180,530
- Filed: 2021-02-19
- Published: 2021-06-10
- Earliest claimed: 2018-06-18
- Assignees: FLC Technology Group, Inc.
- Applicants: FLC Technology Group, Inc.
- Inventors: Sehat Sutardja
- Web page: https://patentgrep.com/patent/US20210173779A1

## CPC

- G06F 12/0811: with multilevel cache hierarchies
- G06F 9/3816: {Instruction alignment, e.g. cache line crossing}
- G06F 9/5077: {Logical partitioning of resources; Management or configuration of virtualized resources (specific details on emulation or internal functioning of virtual machines G06F9/455)}
- G06F 12/0851: {Cache with interleaved addressing}
- G06F 12/0871: Allocation or management of cache space
- G06F 12/1009: using page tables, e.g. page table structures
- G06F 12/1027: using associative or pseudo-associative address translation means, e.g. translation look-aside buffer [TLB]
- G06F 12/084: with a shared cache
- G06F 12/0888: using selective caching, e.g. bypass
- G06F 12/0897: with two or more cache hierarchy levels (with multilevel cache hierarchies G06F12/0811)
- G06F 12/123: with age lists, e.g. queue, most recently used [MRU] list or least recently used [LRU] list
- G06F 2212/1024: Latency reduction
- G06F 2212/1041: Resource optimization
- G06F 2212/1048: Scalability
- G06F 2212/214: Solid state disk
- G06F 2212/311: In host system
- G06F 2212/463: File
- G06F 2212/684: TLB miss handling
- G06F 2212/7201: Logical to physical mapping or translation of blocks or pages
- Y02D 10/00: Energy efficient computing, e.g. low power processors, power management or thermal management
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

A data access system including a processor, multiple cache modules for the main memory, and a storage drive. The cache modules include a FLC controller and a main memory cache. The multiple cache modules function as main memory. The processor sends read/write requests (with physical address) to the cache module. The cache module includes two or more stages with each stage including a FLC controller and DRAM (with associated controller). If the first stage FLC module does not include the physical address, the request is forwarded to a second stage FLC module. If the second stage FLC module does not include the physical address, the request is forwarded to the storage drive, a partition reserved for main memory. The first stage FLC module has high speed, lower power operation while the second stage FLC is a low-cost implementation. Multiple FLC modules may connect to the processor in parallel.

## Claims

### Claim 1

A data storage and access system for use with a processor comprising:
a processor, having processor cache, the processor configured generate a data request for data;
a final level cache (FLC) cache system, configured to function as main memory and receive the data request, the FLC system comprising:
a first FLC module having a first FLC controller and first memory, the first FLC module receiving the data request from the processor;
a second FLC module having a second FLC controller and second memory, the second FLC module receiving, responsive to the first FLC module not having the data requested by the processor, the data request from the first FLC module; and
a storage drive configured with a main memory portion such that the storage drive receives the data request responsive to the second FLC module not having the data requested.

### Claim 2 (depends on 1)

The system of claim 1 wherein the data request includes a physical address and first FLC controller includes a loop-up table configured to translate the physical address to a first virtual address.

### Claim 3 (depends on 2)

The system of claim 2 wherein if the first FLC controller look-up table does not contain the physical address, the first FLC controller is configured to forward the data request with the physical address to the second FLC controller.

### Claim 4 (depends on 3)

The system of claim 3 wherein the second FLC controller includes a loop-up table configured to translate the physical address to a second virtual address.

### Claim 5 (depends on 4)

The system of claim 4 wherein if the second FLC controller look-up table does not contain the physical address, the second FLC controller is configured to forward the data request with the physical address to the storage drive.

### Claim 6 (depends on 1)

The system of claim 1 wherein the first FLC module is faster and has lower power consumption than the second FLC module.

### Claim 7 (depends on 1)

The system of claim 1 wherein the first memory is DRAM and includes a first memory controller and the second memory is DRAM and includes a second memory controller.

### Claim 8 (depends on 1)

The system of claim 1 wherein the storage drive is a magnetic disk driver, solid state memory or a hybrid drive.

### Claim 9 (depends on 1)

The system of claim 1 wherein the DRAM is serial DRAM.

### Claim 10 (depends on 1)

The system of claim 1 wherein the first FLC module is at least two times as fast as the second FLC module.

### Claim 11 (depends on 1)

The system of claim 1 wherein the first FLC module and the second FLC module are configured to perform predictive fetching of data stored at addresses expected to be accessed in the future.

### Claim 12

A method of operating a data access system, wherein the data access system comprises a processor having processor cache, a storage drive, a first final level cache (FLC) module which includes a first FLC controller and a first DRAM and a second FLC module which includes a second FLC controller and a second DRAM, the method comprising:
generating, with the processor, a request for data which includes a physical address;
providing the request for data to the first FLC module;
determining if the first FLC controller contains the physical address;
responsive to the first FLC controller containing the physical address, retrieving the data from the first DRAM and providing the data to the processor;
responsive to the first FLC controller not containing the physical address, forwarding the request for data and the physical address to the second FLC module;
determining if the second FLC controller contains the physical address; and
responsive to the second FLC controller containing the physical address, retrieving a cache line containing the data from the second DRAM and providing the cache line to the first FLC module.

### Claim 13 (depends on 12)

The method of claim 12 wherein determining if the first FLC controller contains the physical address comprises accessing an address cache storing address entries in the first FLC controller to reduce time taken for the determining.

### Claim 14 (depends on 12)

The method of claim 12 further comprising responsive to the second FLC controller not containing the physical address, forwarding the request for data and the physical address to the storage drive.

### Claim 15 (depends on 14)

The method of claim 14, further comprising the storage drive retrieving the data from a portion of the storage drive reserved as main memory, and providing the data to the second FLC module.

### Claim 16 (depends on 12)

The method of claim 12 further comprising, responsive to the first FLC controller containing the physical address and the providing of the data to the processor, updating a status register reflecting the recent use of a cache line containing the data.

### Claim 17 (depends on 12)

The method of claim 12 wherein retrieving the data from the second DRAM and providing the data to the first FLC module further comprises storing the physical address in the first FLC controller and storing the data in the first DRAM.

### Claim 18 (depends on 17)

The method of claim 17 wherein if the first DRAM does not have available space, then removing least recently used data from the first DRAM to make space for the data.

### Claim 19

A data storage and access system for use with a processor comprising:
a processor, having processor cache, the processor configured to generate a first data request for first data and a second data request for second data;
a first final level cache (FLC) cache system, communicating with the processor, configured to function as main memory cache and receive the first data request for the first data;
a second FLC cache system, communicating with the processor, configured to function as main memory cache and receive the second data request for the second data;
a storage drive configured with a main memory partition such that the main memory partition of the storage drive functions as main memory.

### Claim 20 (depends on 19)

The system of claim 19 further comprising a system bus and the processor communicates with the first FLC cache system and the second FLC cache system over the system bus such that addresses assigned to each FLC cache system are interleaved.

### Claim 21 (depends on 19)

The system of claim 19 wherein:
if the first data is not contained in the first FLC cache system, then the first data request is sent to the storage drive to retrieve the first data from the main memory partition of the storage drive; and
if the second data is not contained in the second FLC cache system, then the second data request is sent to the storage drive to retrieve the first data from the main memory partition of the storage drive.

### Claim 22 (depends on 19)

The system of claim 19 wherein the first FLC cache system comprises a first FLC module and a second FLC module and the second FLC cache system comprises a third FLC module and a fourth FLC module.

### Claim 23 (depends on 22)

The system of claim 22 wherein each of the FLC modules comprises a FLC controller and a memory.

### Claim 24 (depends on 23)

The system of claim 23 wherein the each FLC module maintains dedicated and unique look-up tables.
