System and method of using persistent memory to support small-sized data append for object store

An object storage system, comprising:

• a storage medium comprising a data-alignment characteristic;
• persistent memory comprising non-volatile memory that is accessible in a random access, byte-addressable manner;
• and
• a controller coupled to the storage medium and the persistent memory, the controller being configured to:
• receive first object data for an object from an application for a first append operation;
• determine a size of a first portion of the first object data based, at least in part, on a size of the first object data and a size of the data-alignment characteristic of the storage medium, wherein the first portion of the first object data represents a first segment of the object;
• determine a size of a second portion of the first object data based, at least in part, on a remainder of the size of the first object data and the size of the data-alignment characteristic of the storage medium, wherein the second portion of the first object data represents a second segment of the object;
• store, in the storage medium, the first portion of the first object data;
• stage, in the persistent memory, the second portion of the first object data based on a size of the second portion of the first object data being greater than 0;
• receive second object data for the object from the application for a second append operation;
• determine a size of a first portion of the second object data based, at least in part, on a size of the second object data and a size of a data-alignment characteristic of the storage medium, wherein the first portion of the second object data represents a third segment of the object;
• determine a size of a second portion of the second object data based, at least in part, on the size of the second object data and the size of the data-alignment characteristic of the storage medium, wherein the second portion of the second object data represents a fourth segment of the object;
• store, in the storage medium, the first portion of the second object data;
• stage, in the persistent memory, the second portion of the second object data based on a size of the second portion of the second object data being greater than 0;
• store, in a mapping data structure in the persistent memory, an entry for the object, wherein the entry comprises:
• an object key,
• a first value,
• a second value, and
• a third value,
• wherein the object key indexes the first value, the second value, and the third value, the first value indicates a location of the first portion of the first object data in the storage medium, the second value indicates a location of the second portion of the first object data in the persistent memory, and the third value indicates a location of the second portion of the second object data in the persistent memory;
• and
• migrate, to the storage medium, the second portion of the first object data and the second portion of the second object data, wherein the second portion of the first object data and the second portion of the second object data collectively comprise a size that is based on the size of the data-alignment characteristic of the storage medium.

A method comprising:

• receiving first object data for an object from an application for a first append operation;
• determining a size of a first portion of the first object data based, at least in part, on a size of the first object data and a size of a data-alignment characteristic of a storage medium, wherein the first portion of the first object data represents a first segment of the object;
• determining a size of a second portion of the first object data based, at least in part, on a remainder of the size of the first object data and the size of the data-alignment characteristic of the storage medium, wherein the second portion of the first object data represents a second segment of the object;
• storing, in the storage medium, the first portion of the first object data;
• staging, in a persistent memory the second portion of the first object data based on a size of the second portion of the first object data being greater than 0, the persistent memory comprising non-volatile memory that is accessible in a random access, byte-addressable manner;
• receiving second object data for the object from the application for a second append operation;
• determining a size of a first portion of the second object data based, at least in part, on a size of the second object data and a size of a data-alignment characteristic of the storage medium, wherein the first portion of the second object data represents a third segment of the object;
• determining a size of a second portion of the second object data based, at least in part, on the size of the second object data and the size of the data-alignment characteristic of the storage medium, wherein the second portion of the second object data represents a fourth segment of the object;
• storing, in the storage medium, the first portion of the second object data;
• staging, in the persistent memory, the second portion of the second object data based on a size of the second portion of the second object data being greater than 0;
• storing, in a mapping data structure in the persistent memory, an entry for the object, wherein the entry comprises:
• an object key,
• a first value,
• a second value, and
• a third value,
• wherein the object key indexes the first value, the second value, and the third value, the first value indicates a location of the first portion of the first object data in the storage medium, the second value indicates a location of the second portion of the first object data in the persistent memory, and the third value indicates a location of the second portion of the second object data in the persistent memory;
• and
• migrating, to the storage medium, the second portion of the first object data and the second portion of the second object data, wherein the second portion of the first object data and the second portion of the second object collectively comprise a size that is based on the size of the data-alignment characteristic of the storage medium.