US 11,082,347 B2 · Techniques for reducing congestion in a computer network

Abstract

Multiple processors are often used in computing systems to solve very large, complex problems, such as those encountered in artificial intelligence. Such processors typically exchange data among each other via an interconnect fabric (such as, e.g., a group of network connections and switches) in solving such complex problems. The amount of data injected into the interconnect fabric by the processors can at times overwhelm the interconnect fabric preventing some of the processors from communicating with each other. To address this problem, techniques are disclosed to enable, for example, processors that are connected to an interconnect fabric to coordinate and control the amount of data injected so that the interconnect fabric does not get overwhelmed.

Claims37

Dependent claims

A method for managing throughput in an interconnect fabric that connects endpoints of a system, comprising:

monitoring data requests between said endpoints over said interconnect fabric;
and
controlling an injection rate at which new data is injected into said interconnect fabric by limiting an ability of at least one of said endpoints to make a new data request over said interconnect fabric,
wherein said limiting includes changing a refill rate, at which a credit counter for said at least one of said endpoints is refilled, based on a comparison between a randomly generated number and an injection threshold, wherein said comparison does not involve a count of said credit counter, said changing includes adjusting said credit counter when said randomly generated number is within said injection threshold, and said injection threshold is adaptive to a congestion level of said interconnect fabric.

1 more element

Dependencies are inferred from the claim text.

Techniques for reducing congestion in a computer network

Life of this patent

Techniques for reducing congestion in a computer network

Life of this patent

Abstract

Claims37