Rebalancing Caching Layer for Distributed Database System

A non-transitory computer-readable medium having program instructions stored thereon that are capable of causing a distributed computing system that includes a plurality of physical nodes implementing a hosting service to perform operations comprising:

• storing, by a first container deployed to one of the physical nodes, first data in a first cache for a distributed database system, wherein the cache is maintained in a memory internal to the physical node;
• receiving, by the first container, a storage utilization associated with a second container maintaining a second cache for the distributed database system;
• and
• redistributing, based on the received storage utilization, second data from the second cache of the second container to the first cache of the first container.

A computer-implemented method, comprising:

• receiving, via a metadata server, storage utilizations associated with a plurality of containers deployed to a plurality of physical nodes implementing a hosting service that hosts a distributed database system, wherein the plurality of containers implement a cache for the distributed database system;
• determining an average storage utilization for the plurality of containers, wherein the average storage utilization is based on the storage utilizations for the plurality of containers;
• and
• providing a report to the metadata server, wherein the report includes the average storage utilization and wherein the report is accessible to the plurality of containers to redistribute data among the plurality of containers.