In-memory data storage with transparent compression

A memory system comprising:

• a physical memory;
• and
• a storage aware memory controller for in-memory data processing, wherein the storage aware memory controller includes:
• a system for mapping the physical memory into a memory region and a storage region;
• a system for applying different error protections schemes, in which a fine-grained memory fault tolerance scheme is applied to data in the memory region and a course-grained memory fault tolerance scheme is applied to data in the storage region;
• and
• an in-memory storage filesystem that causes individual pages of data to be compressed and stored in the storage region, wherein each page of data is compressed into a set of codewords that are codeword aligned, and wherein the in-memory storage filesystem stores a compression-aware logical block address (CA-LBA) for each page of data.

Computer programming logic stored in a computer readable storage medium, which when executed by a processing core, provides storage aware memory control for in-memory data processing, and comprises:

• program logic for mapping physical memory space into a memory region and a storage region;
• program logic for applying different error protections schemes, in which a fine-grained memory fault tolerance scheme is applied to data in the memory region and a course-grained memory fault tolerance scheme is applied to data in the storage region;
• program logic that compresses and stores individual pages of data in the storage region, wherein each page of data is compressed into a set of codewords that are codeword aligned such that no codeword shares compressed data from different pages;
• and
• program logic for maintaining a compression-aware logical block address (CA-LBA) for each page of data.