Method and apparatus for performing pipeline-based accessing management in a storage server

A host device, comprising:

• a processing circuit, arranged to control the host device to perform pipeline-based accessing management in a storage server, wherein the storage server comprises the host device and a storage device layer, the storage device layer comprises at least one storage device that is coupled to the host device, the host device is arranged to control operations of the storage server, and said at least one storage device is arranged to store information for the storage server, wherein:
• in response to a request of writing user data into the storage server, the host device within the storage server writes the user data into the storage device layer of the storage server and starts processing an object write command corresponding to the request of writing the user data with a pipeline architecture of the storage server;
• during processing the object write command with the pipeline architecture, the host device selects a fixed size buffer pool from a plurality of fixed size buffer pools according to a data size of the user data, wherein the plurality of fixed size buffer pools correspond to a plurality of buffer sizes, respectively;
• during processing the object write command with the pipeline architecture, the host device allocates a buffer from the fixed size buffer pool to be a pipeline module of at least one pipeline within the pipeline architecture, for performing buffering for said at least one pipeline, wherein the pipeline module is a hardware pipeline module outside the storage device layer, and multiple subsequent pipeline modules within said at least one pipeline belong to a plurality of program modules running on the processing circuit of the host device;
• and
• during processing the object write command with the pipeline architecture, the host device writes metadata corresponding to the user data into the allocated buffer, for controlling the storage server completing the request without generating write amplification of the metadata regarding the multiple subsequent pipeline modules.

A storage server, comprising:

• a host device, arranged to control operations of the storage server, the host device comprising:
• a processing circuit, arranged to control the host device to perform pipeline-based accessing management in the storage server;
• and
• a storage device layer, comprising:
• at least one storage device, coupled to the host device, arranged to store information for the storage server;
• wherein:
• in response to a request of writing user data into the storage server, the host device within the storage server writes the user data into the storage device layer of the storage server and starts processing an object write command corresponding to the request of writing the user data with a pipeline architecture of the storage server;
• during processing the object write command with the pipeline architecture, the host device selects a fixed size buffer pool from a plurality of fixed size buffer pools according to a data size of the user data, wherein the plurality of fixed size buffer pools correspond to a plurality of buffer sizes, respectively;
• during processing the object write command with the pipeline architecture, the host device allocates a buffer from the fixed size buffer pool to be a pipeline module of at least one pipeline within the pipeline architecture, for performing buffering for said at least one pipeline, wherein the pipeline module is a hardware pipeline module outside the storage device layer, and multiple subsequent pipeline modules within said at least one pipeline belong to a plurality of program modules running on the processing circuit of the host device;
• and
• during processing the object write command with the pipeline architecture, the host device writes metadata corresponding to the user data into the allocated buffer, for controlling the storage server completing the request without generating write amplification of the metadata regarding the multiple subsequent pipeline modules.