Scalable object storage

A method comprising:

• receiving from a client device a data object for storage within an object storage system, the data object comprising data and metadata associated with the data;
• determining a placement group comprising a plurality of object storage devices to store the data object by a first hash on the data of the data object, the plurality of object storage devices comprising a subset of total available object storage devices within the object storage system;
• performing a plurality of subsequent hashes on tenant profile data of the metadata associated with the data;
• determining, based on the plurality of subsequent hashes, a first object storage device of the plurality of object storage devices in the placement group to store the data object;
• storing the data object on the first object storage device;
• in response to storing the data object on the first object storage device, updating the tenant profile data to indicate a number of active compute jobs operating on the first object storage device;
• and
• autoscaling an amount of a computing resource allocated to the first object storage device based on the number of active compute jobs operating on a plurality of data objects stored on the first object storage device.

A system comprising:

• a processor;
• and
• a memory comprising machine readable instructions that, when executed by the processor, cause the system to:
• receive from a client device, a data object for storage within an object storage system, wherein the data object comprises data and metadata associated with the data;
• perform a first hash on data of the data object;
• determine, based on the first hash, a placement group for the data object, the placement group being associated with a plurality of object storage devices comprising a subset of total available object storage devices within the object storage system;
• perform at least one subsequent hash on tenant profile data of the metadata associated with the data;
• select, based on the at least one subsequent hash, between two or more object storage devices of the plurality of object storage devices to determine a first object storage device to store the data object, the first object storage device being one of the plurality of object storage devices in the placement group;
• store the data object on the first object storage device;
• in response to storing the data object on the first object storage device, updating the tenant profile data to indicate a number of active compute jobs operating on the first object storage device;
• and
• autoscaling an amount of a computing resource allocated to the first object storage device based on the number of active compute jobs operating on a plurality of data objects stored on the first object storage device.