Load distribution across superclusters

A method for distributing loads across a plurality of machines of a supercluster, comprising:

• publishing, by each of the plurality of machines of the supercluster, availability status and resource allocation information to a publish-subscribe (Pub-Sub) channel, wherein each of the plurality of machines is subscribed to the Pub-Sub channel;
• receiving availability status and resource allocation information of at least another one of the plurality of machines via the Pub-Sub channel;
• and
• forwarding a request received from a client for content data to the another one of the plurality of machines based on the availability status and the resource allocation information on the Pub-Sub channel.

A non-transitory computer-readable medium having computer-readable instructions such that, when executed, cause a processor of each of a plurality of machines of a supercluster to:

• publish availability status and resource allocation information to a publish-subscribe (Pub-Sub) channel, wherein each of the plurality of machines is subscribed to the Pub-Sub channel;
• receive availability status and resource allocation information of at least another one of the plurality of machines via the Pub-Sub channel;
• and
• forward a request received from a client for content data to the another one of the plurality of machines based on the availability status and the resource allocation information on the Pub-Sub channel.

A method for distributing loads across superclusters, comprising:

• determining, by a first machine of a first supercluster, that a number of unavailable machines in the first supercluster exceeds a threshold;
• establishing, by the first machine, a bridge with a second machine in a second supercluster, wherein the second supercluster is adjacent to the first supercluster;
• receiving, by the first machine via the bridge, availability status and resource allocation information of each of a plurality of machines of the second supercluster;
• and
• publishing, by the first machine on a publish-subscribe (Pub-Sub) channel of the first supercluster, the availability status and the resource allocation information of each of the plurality of machines of the second supercluster.

A non-transitory computer-readable medium having computer-readable instructions such that, when executed, cause a processor of a first machine of a first supercluster to:

• determine that a number of unavailable machines in the first supercluster exceeds a threshold;
• establish a bridge with a second machine in a second supercluster, wherein the second supercluster is adjacent to the first supercluster;
• receive, via the bridge, availability status and resource allocation information of each of a plurality of machines of the second supercluster;
• and
• publish, on a publish-subscribe (Pub-Sub) channel of the first supercluster, the availability status and the resource allocation information of each of the plurality of machines of the second supercluster.

A system, comprising:

• a first supercluster, wherein the first supercluster comprises:
• a plurality of first machines;
• and
• a publish-subscribe (Pub-Sub) channel to which each of the plurality of first machines is subscribed;
• a second supercluster, wherein the second supercluster comprises:
• a plurality of second machines;
• and
• a bridge between the first supercluster and the second supercluster,
• wherein one of the plurality of first machines is configured to:
• receive, from one of the plurality of second machines via the bridge, an availability status and resource allocation information of each of the plurality of second machines;
• and
• publish, on the Pub-Sub channel of the first supercluster, the availability status and the resource allocation information of each of the plurality of second machines.