Optimized log storage for asynchronous log updates

A method, comprising:

• performing, by one or more computing devices:
• receiving a plurality of log records indicating updates to data stored for a storage client, wherein each of the plurality of log records indicates a different position in a log record sequence;
• storing the plurality of log records in a hot log portion of a non-volatile storage device that maintains data in the event of a system failure, wherein the plurality of log records are not guaranteed to be received according to the log record sequence;
• identifying one or more log records stored in the hot log portion to move to a cold log portion of a block-based storage device, wherein the selected one or more log records complete a next portion of the log record sequence not currently stored in the cold log portion;
• and
• storing together one or more log records to a data block in the cold log storage according to the log record sequence, wherein the one or more log records stored together include the updates to the data indicated in the one or more log records identified from the hot log portion of the block-based storage device.

A non-transitory, computer-readable storage medium, storing program instructions that when performed by one or more computing devices cause the one or more computing devices to implement a log-structured storage system that implements:

• receiving a plurality of log records indicating updates to data stored for a client of the log-structure storage system, wherein each of the plurality of log records indicates a different position in a log record sequence;
• storing the plurality of log records in a hot log portion of a block-based storage device, wherein the plurality of log records are stored in the hot log portion according to an order in which each of the plurality of log records is received at the storage node, wherein the plurality of log records are not guaranteed to be received according to the log record sequence;
• identifying one or more log records stored in the hot log portion to move to a cold log portion of the block-based storage device, wherein the selected one or more log records complete a next portion of the log record sequence not currently stored in the cold log portion;
• and
• storing together one or more log records in a data block in the cold log storage according to the log record sequence, wherein the one or more log records include the updates to the database indicated in the one or more log records read from the hot log portion of the block-based storage device.