Methods and Systems for Performing Transparent Object Migration Across Storage Tiers

A combined non-transitory data repository comprising a data processing device coupled to a relational data store and a non-relational data store, the data processing device of the combined data repository to perform operations comprising:

• retrieving a complete search index row from the non-relational data store, the search index row having a plurality of columns having row values containing metadata about the search index row;
• updating the metadata and at least a portion of the row values of the plurality of columns to form an updated search index row having the plurality of columns, wherein a subset of the plurality of columns corresponding to the portion of the row values is updated;
• sending the updated search index row with its row values to the non-relational data store, wherein the updated search index row replaces the search index row;
• modifying a search index associated with the updated search index row by at least one of (a) sending the updated search index row with its row values to the non-relational data store, and (b) replacing or shadowing a correspondingly existing search index row with the updated search index row;
• defining search index metadata using a cached custom index object;
• sending the search index metadata to the non-relational data store using one or more requests as part of a specified object;
• calculating index statistics through normal queries of the non-relational data store;
• storing the calculated index statistics in existing statistics tables;
• and
• resending the search index metadata to the non-relational data store by modifying a sequence number for a corresponding combination of the statistic tables and organizations upon creation or deletion of an index, wherein the calculated index statistics of the statistics tables are periodically updated using a scheduled batch process.

A non-transitory computer-readable medium having stored thereon instructions which, when executed by a computing device associated with a combined data repository having a relational data store and a non-relational data store, causes the computing device to perform operations comprising:

• defining the search index metadata using a cache custom index object;
• sending the search index metadata to the non-relational data store using one or more requests as part of an object;
• retrieving a replaced row from the non-relational data store;
• modifying the search index by at least one of (a) sending an updated search index row with its row values to the non-relational data store, and (b) replacing or shadowing a correspondingly existing search index row with the updated search index row;
• calculating index statistics through normal queries of the non-relational data store;
• storing the calculated index statistics in existing statistics tables;
• and
• resending the search index metadata by modifying a sequence number for a corresponding combination of the statistic tables and organizations upon creation or deletion of an index, wherein the statistics tables are periodically updated using a scheduled batch process.

In a combined non-transitory data repository having a relational data store and a non-relational data store, a method comprising:

• retrieving a complete search index row from the non-relational data store, the search index row having a plurality of columns having row values containing metadata about the search index row;
• updating the metadata and at least a portion of the row values of the plurality of columns to form an updated search index row having the plurality of columns, wherein a subset of the plurality of columns corresponding to the portion of the row values is updated;
• sending the updated search index row with its row values to the non-relational data store, wherein the updated search index row replaces the search index row;
• modifying a search index associated with the updated search index row by at least one of (a) sending the updated search index row with its row values to the non-relational data store, and (b) replacing or shadowing a correspondingly existing search index row with the updated search index row;
• defining search index metadata using a cached custom index object;
• sending the search index metadata to the non-relational data store using one or more requests as part of a specified object;
• resending the search index metadata by modifying a sequence number for a corresponding combination of the statistic tables and organizations upon creation or deletion of an index;
• calculating index statistics through normal queries of the non-relational data store;
• storing the calculated index statistics in existing statistics tables;
• and
• periodically updating the calculated index statistics of the statistics tables using a scheduled batch process.

A non-transitory computer-readable medium having stored thereon instructions which, when executed by a computing device associated with a combined data repository having a relational data store and a non-relational data store, causes the computing device to perform operations comprising:

• retrieving a complete search index row from the non-relational data store, the search index row having a plurality of columns having row values containing metadata about the search index row;
• updating the metadata and at least a portion of the row values of the plurality of columns to form an updated search index row having the plurality of columns, wherein a subset of the plurality of columns corresponding to the portion of the row values is updated;
• sending the updated search index row with its row values to the non-relational data store, wherein the updated search index row replaces the search index row;
• modifying a search index associated with the updated search index row by at least one of (a) sending the updated search index row with its row values to the non-relational data store, and (b) replacing or shadowing a correspondingly existing search index row with the updated search index row;
• defining search index metadata using a cached custom index object;
• sending the search index metadata to the non-relational data store using one or more requests as part of a specified object;
• resending the search index metadata by modifying a sequence number for a corresponding combination of the statistic tables and organizations upon creation or deletion of an index;
• calculating index statistics through normal queries of the non-relational data store;
• storing the calculated index statistics in existing statistics tables;
• and
• periodically updating the calculated index statistics of the statistics tables using a scheduled batch process.

A database system comprising a combined non-transitory data repository comprising a data processing device coupled to a relational data store and a non-relational data store, the data processing device of the combined non-transitory data repository to perform operations comprising:

• defining, based on a cache custom index object, a search index associated with column values and metadata;
• sending the search index to the non-relational data store using one or more requests as part of an object;
• retrieving a replaced row from the non-relational data store;
• modifying the search index by at least one of (a) sending an updated search index row with its row values to the non-relational data store, and (b) replacing or shadowing a correspondingly existing search index row with the updated search index row;
• calculating index statistics through normal queries of the non-relational data store;
• storing the calculated index statistics in existing statistics tables;
• and
• resending the search index to the non-relational data store by incrementing a sequence number up for a corresponding combination of the statistics tables and organizations upon creation or deletion of an index, wherein the statistics tables are periodically updated using a scheduled batch process.

A non-transitory computer-readable medium having stored thereon instructions which, when executed by a computing device associated with a combined data repository having a relational data store and a non-relational data store, causes the computing device to perform operations comprising:

• defining, based on a cache custom index object, a search index associated with column values and metadata;
• sending the search index to the non-relational data store using one or more requests as part of an object;
• retrieving a replaced row from the non-relational data store;
• modifying the search index by at least one of (a) sending an updated search index row with its row values to the non-relational data store, and (b) replacing or shadowing a correspondingly existing search index row with the updated search index row;
• calculating index statistics through normal queries of the non-relational data store;
• storing the calculated index statistics in existing statistics tables;
• and
• resending the search index to the non-relational data store by incrementing a sequence number up for a corresponding combination of the statistics tables and organizations upon creation or deletion of an index, wherein the statistics tables are periodically updated using a scheduled batch process.