Method and system for enhancing IOPS of a hard disk drive system based on storing metadata in host volatile memory and data in non-volatile memory using a shared controller

A computer system, comprising:

• a storage engine;
• a hard disk drive, wherein a first non-volatile solid state memory is accessible via a controller of the hard disk drive, and
• wherein the storage engine comprises a processor and a memory coupled to the processor and storing instructions which, when executed by the processor cause the processor to perform a method, the method comprising:
• receiving a request to write data to a hard disk drive;
• determining metadata associated with the data;
• storing the metadata in a volatile memory associated with the storage engine, wherein the metadata is stored in the volatile memory of the storage engine as a first entry based on a metadata index and a plurality of metadata content chunks;
• identifying a physical address in the first non-volatile solid-state memory to which to write the metadata;
• writing the metadata to the first non-volatile solid-state memory sequentially based on the identified physical address at a next available location of the first non-volatile solid-state memory,
• wherein the metadata is written as a second entry corresponding to the first entry and wherein the second entry includes:
• a Not-AND (NAND) offset index which corresponds to the metadata index:
• a physical address for a corresponding metadata content chunk prior to a current update;
• and
• the corresponding metadata content chunk;
• and
• writing the data to the hard disk drive.

An apparatus, comprising:

• a hard disk drive, wherein a first non-volatile solid state memory is accessible via a controller of the hard disk drive, and
• a storage engine configured to:
• receive a request to write data to a hard disk drive;
• determine metadata associated with the data;
• store the metadata in a volatile memory associated with the storage engine, wherein the metadata is stored in the volatile memory of the storage engine as a first entry based on a metadata index and a plurality of metadata content chunks;
• identify a physical address in the first non-volatile solid-state memory to which to write the metadata;
• write the metadata to the first non-volatile solid-state memory sequentially based on the identified physical address at a next available location of the first non-volatile solid-state memory,
• wherein the metadata is written as a second entry corresponding to the first entry and wherein the second entry includes:
• a Not-AND (NAND) offset index which corresponds to the metadata index:
• a physical address for a corresponding metadata content chunk prior to a current update;
• and
• the corresponding metadata content chunk;
• and
• write the data to the hard disk drive.