Method, apparatus and computer program product for improving data indexing in a group-based communication platform

An apparatus for improving data indexing in a group-based communication platform, the group-based communication platform having a computed collection and one or more live collections, the apparatus comprising at least one processor and at least one non-transitory memory including program code, the at least one non-transitory memory and the program code configured to, with the at least one processor, cause the apparatus to at least:

• generate, by a server circuitry, a new collection at a snapshot time point, wherein the new collection comprises a plurality of shards based at least in part on one or more of a channel identification, a team identification, or a group identification, wherein individual shards of the plurality of shards store message data related to a plurality of existing electronic messages associated with the group-based communication platform and at least one index file associated with the message data;
• associate, by the server circuitry, a collection manager with the new collection, the collection manager having a read alias and a write alias pointing to the computed collection and the one or more live collections;
• retrieve, by the server circuitry, a plurality of electronic messages from the computed collection and the one or more live collections, each electronic message having a message generation timestamp indicating a message generation time point before the snapshot time point;
• write, by the server circuitry, the plurality of electronic messages to the new collection, the writing being completed at a cut-over time point;
• synchronize, by the server circuitry, the new collection with the one or more live collections based on the plurality of electronic messages by:
• retrieving one or more modified electronic messages, each modified electronic message having a message modification timestamp indicating a message modification time point between the snapshot time point and the cut-over time point;
• writing the one or more modified electronic messages to the new collection;
• identifying an electronic message of the plurality of electronic messages and the one or more modified electronic messages with the message generation timestamp that exceeds a time period associated with a data retention policy of the group-based communication platform;
• and
• removing the electronic message from the new collection;
• and
• replace the computed collection and at least one live collection of the one or more live collections with the new collection by redirecting the read alias and the write alias from the computed collection and the at least one live collection to the new collection and remove the computed collection and the at least one live collection from the group-based communication platform.

A computer program product for improving data indexing in a group-based communication platform, the group-based communication platform having a computed collection and one or more live collections, the computer program product comprising at least one non-transitory computer-readable storage medium having computer-readable program code portions stored therein, the computer-readable program code portions comprising an executable portion configured to:

• generate, by a server circuitry, a new collection at a snapshot time point, wherein the new collection comprises a plurality of shards based at least in part on one or more of a channel identification, a team identification, or a group identification, wherein individual shards of the plurality of shards store message data related to a plurality of existing electronic messages associated with the group-based communication platform and at least one index file associated with the message data;
• associate, by the server circuitry, a collection manager with the new collection, the collection manager having a read alias and a write alias pointing to the computed collection and the one or more live collections;
• retrieve, by the server circuitry, a plurality of electronic messages from the computed collection and the one or more live collections, each electronic message having a message generation timestamp indicating a message generation time point before the snapshot time point;
• write, by the server circuitry, the plurality of electronic messages to the new collection, the writing being completed at a cut-over time point;
• synchronize, by the server circuitry, the new collection with the one or more live collections based on the plurality of electronic messages by:
• retrieving one or more modified electronic messages, each modified electronic message having a message modification timestamp indicating a message modification time point between the snapshot time point and the cut-over time point;
• writing the one or more modified electronic messages to the new collection;
• identifying an electronic message of the plurality of electronic messages and the one or more modified electronic messages with the message generation timestamp that exceeds a time period associated with a data retention policy of the group-based communication platform;
• and
• removing the electronic message from the new collection;
• and
• replace the computed collection and at least one live collection of the one or more live collections with the new collection by redirecting the read alias and the write alias from the computed collection and the at least one live collection to the new collection and remove the computed collection and the at least one live collection from the group-based communication platform.