Data storage system and method

A method comprising:

• a) receiving a first write operation request for a first file;
• b) receiving first real file data for the first write operation request;
• c) identifying a first set identifier for the first write operation request;
• d) appending a first write record concerning the first write operation request to a metadata array, the metadata array being append-only;
• e) appending the first real file data to a first file data array separate from the metadata array, the first file data array being append-only;
• f) identifying a first offset location for the first real file data in the first file data array and identifying a first length for the first real file data;
• g) appending the first offset location and the first length to the metadata array in a first payload record that includes the first set identifier;
• h) receiving a second write operation request for the first file and second real file data for the second write operation request;
• i) appending a second write record concerning the second write operation request to the metadata array;
• and
• j) appending a second payload record to the metadata array, wherein the second payload record includes the second real file data.

A method comprising:

• a) receiving a set, of modifying operations to a file, wherein the set of modifying operations includes:
• i) a first write operation to write first real file data,
• ii) a second write operation to write second real file data, and
• iii) a set identifier;
• b) appending the set of modifying operations to an append-only metadata array using a plurality of metadata records, the plurality of metadata records separately identifying the first and second write operations and associating both write operations with the set identifier;
• c) appending merged real file data to an append-only file data array distinct from the append-only metadata array, the merged real file data comprising a merger of the first real file data and the second real file data;
• d) identifying an offset location for the merged real file data in the append-only file data array and a length for the merged real file data;
• and
• e) appending the set identifier, the offset location and the length to the metadata array as an additional metadata record.

A method comprising:

• a) reading an append-only array by:
• i) identifying a first linkage root for the append-only array, the first linkage root linking to a first linkage information chunk;
• ii) using a first extent descriptor within the first linkage information chunk to access first data for the append-only array;
• iii) following a link in a second extent descriptor within the first linkage information chunk to a second linkage information chunk;
• and
• iv) using a third extent descriptor within the second linkage information chunk to access second data for the append-only array;
• wherein the first data was more recently added to the append-only array than the second data;
• and
• b) adding third data to the append-only array by:
• i) creating a third linkage information chunk, the third linkage information chunk containing:
• (1) a fourth extent descriptor identifying the third data, and
• (2) the first linkage root, and
• ii) creating a second linkage root for the append-only array linking to the third linkage information chunk, and
• iii) modifying a list that previously associated an identifier for the append-only array with the first linkage root so that the identifier for the append-only array is associated with the second linkage root.