Efficient large column values storage in columnar databases

A method, comprising:

• providing a database comprising a write storage, a read storage, and an auxiliary storage, and wherein the auxiliary storage is used to store a large column value of a row that is associated with either the write storage or the read storage, wherein the large column value comprises a column value that meets a set of large column value criteria;
• and
• operating the database using the write storage, the read storage, and the auxiliary storage wherein operating the database using the write storage, the read storage, and the auxiliary storage includes:
• receiving a read request to read the row;
• locating the row in the write storage or the read storage;
• determining that the row includes a set of large column value associating data;
• using the set of large column value associating data to generate a reconstructed column value;
• and
• generating the row based at least in part on the reconstructed column value.

A computer program product, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:

• providing a database comprising a write storage, a read storage, and an auxiliary storage, and wherein the auxiliary storage is used to store a large column value of a row that is associated with either the write storage or the read storage, wherein the large column value comprises a column value that meets a set of large column value criteria;
• and
• operating the database using the write storage, the read storage, and the auxiliary storage, wherein operating the database using the write storage, the read storage, and the auxiliary storage includes:
• receiving a read request to read the row;
• locating the row in the write storage or the read storage;
• determining that the row includes a set of large column value associating data;
• using the set of large column value associating data to generate a reconstructed column value;
• and
• generating the row based at least in part on the reconstructed column value.

A system, comprising:

• one or more processors configured to:
• provide a database comprising a write storage, a read storage, and an auxiliary storage, and wherein the auxiliary storage is used to store a large column value of a row that is associated with either the write storage or the read storage, wherein the large column value comprises a column value that meets a set of large column value criteria;
• and
• operate the database using the write storage, the read storage, and the auxiliary storage, wherein to operate the database using the write storage, the read storage, and the auxiliary storage includes to:
• receive an indication of a merge event;
• select one or more rows to merge from the write storage to the read storage;
• determine that the one or more rows include a set of large column value associating data;
• determine that a selected column value associated with the set of large column value associating data is large with respect to the read storage;
• and
• determine that the set of large column value associating data is to be added to the read storage;
• and
• one or more memories coupled to the one or more processors and configured to provide instructions to the one or more processors.

A system, comprising:

• one or more processors configured to:
• provide a database comprising a write storage, a read storage, and an auxiliary storage, and wherein the auxiliary storage is used to store a large column value of a row that is associated with either the write storage or the read storage, wherein the large column value comprises a column value that meets a set of large column value criteria;
• and
• operate the database using the write storage, the read storage, and the auxiliary storage, wherein to operate the database using the write storage, the read storage, and the auxiliary storage includes to:
• receive an indication of a merge event;
• select one or more rows to merge from the write storage to the read storage;
• determine that the one or more rows include a set of large column value associating data;
• determine that a selected column value associated with the set of large column value associating data is not large with respect to the read storage;
• generate a reconstructed column value using the set of large column value associating data;
• and
• determine that the reconstructed column value is to be added to a corresponding column in the read storage;
• and
• one or more memories coupled to the one or more processors and configured to provide instructions to the one or more processors.

A system, comprising:

• one or more processors configured to:
• provide a database comprising a write storage, a read storage, and an auxiliary storage, and wherein the auxiliary storage is used to store a large column value of a row that is associated with either the write storage or the read storage, wherein the large column value comprises a column value that meets a set of large column value criteria;
• and
• operate the database using the write storage, the read storage, and the auxiliary storage, wherein to operate the database using the write storage, the read storage, and the auxiliary storage includes to:
• receive a delete request to delete the row;
• determine that the row is located in the write storage;
• determine that the row includes a set of large column value associating data;
• use the set of large column value associating data to locate a corresponding column value in the auxiliary storage;
• delete the corresponding column value from the auxiliary storage;
• and
• delete the row from the write storage;
• and
• one or more memories coupled to the one or more processors and configured to provide instructions to the one or more processors.

A system, comprising:

• one or more processors configured to:
• provide a database comprising a write storage, a read storage, and an auxiliary storage, and wherein the auxiliary storage is used to store a large column value of a row that is associated with either the write storage or the read storage, wherein the large column value comprises a column value that meets a set of large column value criteria;
• and
• operate the database using the write storage, the read storage, and the auxiliary storage, wherein to operate the database using the write storage, the read storage, and the auxiliary storage includes to:
• receive a delete request to delete the row;
• determine that the row is located in the read storage;
• determine that the row includes a set of large column value associating data;
• set a corresponding flag in a delete bitmap corresponding to the row;
• use the set of large column value associating data to locate a corresponding column value in the auxiliary storage;
• and
• delete the corresponding column value from the auxiliary storage;
• and
• one or more memories coupled to the one or more processors and configured to provide instructions to the one or more processors.

A system, comprising:

• one or more processors configured to:
• provide a database comprising a write storage, a read storage, and an auxiliary storage, and wherein the auxiliary storage is used to store a large column value of a row that is associated with either the write storage or the read storage, wherein the large column value comprises a column value that meets a set of large column value criteria;
• and
• operate the database using the write storage, the read storage, and the auxiliary storage, wherein to operate the database using the write storage, the read storage, and the auxiliary storage includes to:
• receive an update request to update the row;
• determine that the row is located in the write storage;
• determine that the update request includes a selected column value;
• determine that the selected column value is large;
• store the selected column value in the auxiliary storage;
• generate a new set of large column value associating data corresponding to the selected column value;
• and
• store a new row in the write storage using at least any existing column value(s) of the row, the new set of large column value associating data, and any existing set(s) of large column value associating data of the row;
• and
• one or more memories coupled to the one or more processors and configured to provide instructions to the one or more processors.

A system, comprising:

• one or more processors configured to:
• provide a database comprising a write storage, a read storage, and an auxiliary storage, and wherein the auxiliary storage is used to store a large column value of a row that is associated with either the write storage or the read storage, wherein the large column value comprises a column value that meets a set of large column value criteria;
• and
• operate the database using the write storage, the read storage, and the auxiliary storage, wherein to operate the database using the write storage, the read storage, and the auxiliary storage includes to:
• receive an update request to update the row;
• determine that the row is located in the read storage;
• determine that the update request includes a selected column value;
• determine that the selected column value is large;
• store the selected column value in the auxiliary storage;
• generate a new set of large column value associating data corresponding to the selected column value;
• store a new row in the write storage using at least any existing column value(s) of the row, the new set of large column value associating data, and any existing set(s) of large column value associating data of the row;
• and
• set a corresponding flag in a delete bitmap corresponding to the row;
• and
• one or more memories coupled to the one or more processors and configured to provide instructions to the one or more processors.