Hybrid server with heterogeneous memory

A hybrid server system in an out-of-core processing environment comprising:

• a server comprising
• a memory system partitioned into a first set of memory managed by the server, and a second set of memory managed by a set of accelerator systems, wherein the memory system comprises heterogeneous memory types, and
• a data access manager communicatively coupled to the memory system;
• and
• a set of accelerator systems communicatively coupled to the server, wherein each accelerator system in the set of accelerator systems comprises at least one processing core, wherein each accelerator in the set of accelerators is assigned a private memory module within the memory system, and a public memory area within the memory system, wherein the public memory area is accessible by two or more accelerators in the set of accelerators, and
• wherein the data access manager is configured to
• identify a data set stored within at least one of the first set of memory and the second set of memory that is associated with at least one accelerator system in the set of accelerator systems;
• and
• transform the data set from a first format to a second format, wherein the second format is a format required by the at least one accelerator system.

A computer program product for managing data access in an out-of-core processing environment, the computer program product comprising:

• a non-transitory storage medium readable by a processing circuit and storing instructions for execution by the processing circuit for performing a method comprising:
• partitioning a memory system residing at a server into a first set of memory managed by the server and a second set of memory managed by a set of accelerator systems, the second set of memory being directly writeable to by the set of accelerator systems, wherein the set of accelerator systems are separate from communicatively coupled to the server, and wherein the memory system comprises heterogeneous memory types;
• identifying a data set stored within at least one of the first set of memory and the second set of memory that is associated with at least one accelerator system in the set of accelerator systems;
• and
• transforming the data set from a first format to a second format, wherein the second format is a format required by the at least one accelerator system.