Containerization and serverless thread implementation for processing objects

A non-transitory machine readable medium comprising instructions for performing a method of processing a snapshot, snapshot data of the snapshot stored into objects within one or more storage structures of an object store, wherein the snapshot is represented by an object format of the objects where the snapshot data is structured according to a snapshot file system tree structure, the method, when executed by a machine, causes the machine to:

• in response to receiving a request targeting the snapshot, break down the request into a number of separate operations that can be processed in parallel;
• determine a number of serverless threads to create on-demand for processing based upon the number of separate operations that can be processed in parallel;
• create the number of serverless threads on-demand for execution through a serverless thread architecture, wherein each serverless thread is assigned a different operation of the number of separate operations that can be processed in parallel;
• and
• independently process different portions of the snapshot file system tree structure using different serverless threads for parallel execution of the request by the serverless threads upon the objects.

A computing device for processing a snapshot, snapshot data of the snapshot stored into objects within one or more storage structures of an object store, wherein the snapshot is represented by an object format of the objects where the snapshot data is structured according to a snapshot file system tree structure, the computing device comprising:

• a memory comprising machine executable code for performing a method;
• and
• a processor coupled to the memory, the processor configured to execute the machine executable code to cause the processor to:
• in response to receiving an operation targeting the snapshot, implement a wrapper controller to preprocess the operation for determining an amount of work to be performed by functionality being requested by the operation;
• determine, by the wrapper controller, a number of data connector components to instantiate based upon the amount of work to be performed;
• instantiate the number of data connector components as a plurality of data connector components instantiated as object store provider agnostic plugins on-demand for processing the operation;
• and
• independently process different portions of the snapshot file system tree structure using different data connector components of the plurality of data connector components for parallel execution of the operation by the plurality of data connector components upon the objects.