# US 8,276,397 B1 · Cooling and power paths for data center

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 8,276,397 B1
- Document ID: US8276397B1
- Status: Granted
- Kind: B1
- Application number: 12/146,196
- Filed: 2008-06-25
- Granted: 2012-10-02
- Earliest claimed: 2007-06-27
- Assignees: Exaflop LLC
- Inventors: Andrew B. Carlson; William Hamburgen; Jimmy Clidaras; Donald L. Beaty
- Web page: https://patentgrep.com/patent/US8276397B1

## CPC

- G06F 1/189: {Power distribution}
- G06F 1/20: Cooling means
- H05K 7/20745: {within rooms for removing heat from cabinets, e.g. by air conditioning device}
- G06F 2200/201: Cooling arrangements using cooling fluid
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H05K: PRINTED CIRCUITS; CASINGS OR CONSTRUCTIONAL DETAILS OF ELECTRIC APPARATUS; MANUFACTURE OF ASSEMBLAGES OF ELECTRICAL COMPONENTS

## Abstract

A facility is described that includes one or more enclosures defining an interior space, a plurality of power taps, a plurality of coolant supply taps, and a plurality of coolant return taps. A flow capacity of the supply taps and a flow capacity of the return taps can be approximately equal over a local area of the interior space. The plurality of power taps, the plurality of supply taps, and the plurality of return taps can be divided into a plurality of zones, with taps of each zone are configured to be controllably coupled to a power source or a coolant source independently of the taps of other zones. The taps can be positioned along paths, and paths of the power taps can be spaced from associated proximate paths of supply and return taps by a substantially uniform distance along a substantial length of the first path.

## Claims

### Claim 1

A facility, comprising:
one or more enclosures defining an interior space;
a plurality of power taps positioned along a plurality of first paths in the interior space that are electrically coupled to a common electrical supply;
a plurality of coolant supply taps positioned along a plurality of second paths in the interior space that are fluidly coupled to a common supply header; and
a plurality of coolant return taps positioned along a plurality of third paths in the interior space that are fluidly coupled to a common return header and fluidly coupled to the second paths through heat exchange modules;
wherein each first path of the plurality of first paths has an associated proximate second path of the plurality of second paths and an associated proximate third path from the plurality of third paths, and wherein each first path is spaced from the associated proximate second path by a substantially uniform first distance along a substantial length of the first path that extends from the common electrical supply to an end of the first path, and wherein each first path is spaced from the associated proximate third path by a substantially uniform second distance along the substantial length of the first path.

### Claim 2 (depends on 1)

The facility of claim 1, wherein the power taps are distributed with a substantially regular spacing, the supply taps are distributed with a substantially regular spacing, and the return taps are distributed with a substantially regular spacing.

### Claim 3 (depends on 2)

The facility of claim 2, wherein the supply taps and return taps have the same spacing.

### Claim 4 (depends on 2)

The facility of claim 2, further comprising a plurality of data taps distributed with a substantially regular spacing in the interior space.

### Claim 5 (depends on 1)

The facility of claim 1, further comprising a plurality of data taps positioned along a plurality of fourth paths in the interior space, wherein each first path of the plurality of first paths has an associated proximate fourth path of the plurality of second paths, and wherein each first path is spaced from the associated proximate fourth path by a substantially uniform fourth distance along a substantial length of the first path.

### Claim 6 (depends on 1)

The facility of claim 1, wherein the power taps are disposed with substantially uniform first spacing along the first paths, the supply taps are disposed with substantially uniform second spacing along the second paths, and the return taps are disposed with substantially uniform third spacing along the third paths.

### Claim 7 (depends on 6)

The facility of claim 6, wherein the first spacing is a ratio N/M of the second spacing, where N and M are both whole numbers less than 5.

### Claim 8 (depends on 7)

The facility of claim 7, wherein the second spacing is approximately equal to the third spacing.

### Claim 9 (depends on 1)

The facility of claim 1, wherein a spacing of the power taps along the first paths is less than a spacing between adjacent first paths, a spacing of the supply taps along the second paths is less than a spacing between adjacent second paths, and a spacing of the return taps along the third paths is less than spacing between adjacent third paths.

### Claim 10 (depends on 1)

The facility of claim 1, wherein the first paths, second paths and third paths are substantially linear.

### Claim 11 (depends on 10)

The facility of claim 10, wherein the second paths are substantially parallel to the third paths.

### Claim 12 (depends on 11)

The facility of claim 11, wherein the second paths and the third paths are uniformly spaced with a first pitch.

### Claim 13 (depends on 11)

The facility of claim 11, wherein the second paths are immediately adjacent to the third paths.

### Claim 14 (depends on 11)

The facility of claim 11, wherein adjacent second paths and third paths are separated by one-half of the first pitch.

### Claim 15 (depends on 11)

The facility of claim 11, wherein the first paths are uniformly spaced with a second pitch.

### Claim 16 (depends on 15)

The facility of claim 15, wherein the first paths are substantially parallel to the second paths.

### Claim 17 (depends on 16)

The facility of claim 16, wherein the second pitch is an integer N multiple (N) or fraction (1/N) of the first pitch, where N is less than five.

### Claim 18 (depends on 17)

The facility of claim 17, wherein the second pitch is equal to the first pitch.

### Claim 19 (depends on 1)

The facility of claim 1, further comprising a plurality of power delivery busbars to provide power to the plurality of power taps, the busbars defining the first paths, a plurality of coolant supply manifolds to provide coolant to the plurality of supply taps, the coolant supply manifolds defining the second paths, and a plurality of coolant return manifolds to return coolant from the return taps, the coolant return manifolds defining the third paths.

### Claim 20 (depends on 1)

The facility of claim 1, wherein each supply tap comprises a spigot.

### Claim 21 (depends on 20)

The facility of claim 20, wherein each spigot comprises a valve and a faucet.

### Claim 22 (depends on 20)

The facility of claim 20, wherein each power tap comprises a plurality of power outlets.

### Claim 23 (depends on 20)

The facility of claim 20, wherein a flow capacity of the supply taps and a flow capacity of the return taps are approximately equal over a local area of the interior space.

### Claim 24 (depends on 20)

The facility of claim 20, wherein there is no local storage or buffering of the coolant.

### Claim 25 (depends on 20)

The facility of claim 20, wherein the plurality of supply taps and the plurality of return taps are connected to a cooling plant.

### Claim 26 (depends on 20)

The facility of claim 20, further comprising a plurality of rack-mounted computers, the rack-mounted computers connected to the power taps by power cords.

### Claim 27 (depends on 26)

The facility of claim 26, further comprising a plurality of cooling coils to remove heat from air near the rack-mounted computers, the cooling coil fluidly connected between the supply taps and the return taps.

### Claim 28 (depends on 1)

The facility of claim 1, wherein the coolant supply header is adapted to transmit a liquid coolant to the plurality of second paths, and the coolant return header is adapted to receive the liquid coolant from the plurality of third paths.

### Claim 29

A method of constructing a facility, comprising:
building one or more enclosures defining an interior space;
placing a plurality of power taps along a plurality of first paths in the interior space that are electrically coupled to a common electrical supply;
placing a plurality of coolant supply taps along a plurality of second paths in the interior space that are fluidly coupled to a common supply header; and
placing a plurality of coolant return taps along a plurality of third paths in the interior space that are fluidly coupled to a common return header and fluidly coupled to the second paths through heat exchangers;
wherein each first path of the plurality of first paths has an associated proximate second path of the plurality of second paths and an associated proximate third path from the plurality of third paths, and wherein each first path is spaced from the associated proximate second path by a substantially uniform first distance along a substantial length of the first path that extends from the common electrical supply to an end of the first path, and wherein each first path is spaced from the associated proximate third path by a substantially uniform second distance along the substantial length of the first path.

### Claim 30

A data center, comprising:
one or more enclosures defining an interior space;
a plurality of power taps positioned along a plurality of first paths in the interior space that are electrically coupled to a common electrical supply;
a plurality of coolant supply taps positioned along a plurality of second paths in the interior space that are fluidly coupled to a common supply header; and
a plurality of coolant return taps positioned along a plurality of third paths in the interior space that are fluidly coupled to a common return header and fluidly coupled to the second paths through corresponding cooling coils; and
a plurality of modules positioned along a plurality of fourth paths in the interior space, each module including a plurality of rack-mounted computers connected to a power tap adjacent the module and a particular cooling coil of the corresponding cooling coils to remove heat from air near the rack-mounted computers, the particular cooling coil fluidly connected between a supply tap and a return tap adjacent the module;
wherein each first path of the plurality of first paths has an associated proximate second path of the plurality of second paths, an associated proximate third path from the plurality of third paths, and an associated proximate fourth path from the plurality of fourth paths, and wherein each first path is spaced from the associated proximate second path by a substantially uniform first distance along a substantial length of the first path that extends from the common electrical supply to an end of the first path, each first path is spaced from the associated proximate third path by a substantially uniform second distance along the substantial length of the first path, and each first path is spaced from the associated proximate fourth path by a substantially uniform third distance along the substantial length of the first path.

### Claim 31 (depends on 30)

The data center of claim 30, wherein the first path, second path, third path and fourth path lines are substantially linear.

### Claim 32 (depends on 30)

The data center of claim 30, wherein the modules are arranged in substantially linear rows.

### Claim 33 (depends on 30)

The data center of claim 30, wherein there is a particular second path of the plurality of second paths and a particular third path of the plurality of third paths for each row of modules.

### Claim 34 (depends on 30)

The data center of claim 30, wherein there is a particular second path of the plurality of second paths and a particular third path of the plurality of third paths for every two rows of the modules.

### Claim 35 (depends on 30)

The data center of claim 30, wherein each module is connected to a coolant supply tap on one side of the module and to a coolant return tap on an opposite side of the module.

### Claim 36 (depends on 30)

The data center of claim 30, wherein each module is connected to a coolant supply tap and to a coolant return tap on the same side of the module.

### Claim 37 (depends on 30)

The data center of claim 30, wherein a flow capacity of the supply taps and a flow capacity of the return taps are approximately equal over a local area of the interior space.

### Claim 38

A method of operating a data center, comprising:
supplying power to rack-mounted computers in a row of racks from a plurality of power taps that extend along the row and are arranged in the data center along a plurality of first paths that are electrically coupled to a common electrical supply;
supplying coolant to coolant coils in a space adjacent the racks from a plurality of supply taps of a coolant supply manifold extending along the row along a second path; and
directing warmed coolant from the coolant coils through a plurality of return taps of a coolant return manifold extending along the row along a third path,
wherein each first path of the plurality of first path has an associated proximate second path of the plurality of second paths and an associated proximate third path from the plurality of third paths, and
wherein each first path of the plurality of first paths is spaced from the associated proximate second path by a substantially uniform first distance along a substantial length of the first path that extends from the common electrical supply to an end of the first path, and is spaced from the associated proximate third path by a substantially uniform second distance along the substantial length of the first path.

### Claim 39 (depends on 38)

The method of claim 38, further comprising removing heat from the warmed coolant and returning the coolant to the coolant supply manifold.

### Claim 40 (depends on 38)

The method of claim 38, wherein the rack-mounted computers are located in an interior space of the data center, the power taps are spaced at a substantially uniform first density across the interior space, the supply taps spaced at a substantially uniform second density across the interior space, and the return taps are spaced at spaced at a substantially uniform third density across the interior space.

### Claim 41 (depends on 38)

The method of claim 38, wherein the power taps are distributed with a substantially regular spacing along the plurality of first paths, the supply taps are distributed with a substantially regular spacing along the second path, and the return taps are distributed with a substantially regular spacing along the third path.

### Claim 42

A facility, comprising:
one or more enclosures defining an interior space;
a plurality of power taps positioned along a plurality of first paths in the interior space, particular ones of the power taps comprising a plurality of power outlets;
a plurality of coolant supply taps positioned along a plurality of second paths in the interior space, particular ones of the supply taps comprising a spigot; and
a plurality of coolant return taps positioned along a plurality of third paths in the interior space;
wherein each first path of the plurality of first paths has an associated proximate second path of the plurality of second paths and an associated proximate third path from the plurality of third paths, and
wherein each first path of the plurality of first paths is spaced from the associated proximate second path by a substantially uniform first distance along a substantial length of the first path, and
wherein each first path of the plurality of first paths is spaced from the associated proximate third path by a substantially uniform second distance along a substantial length of the first path.

### Claim 43

A physical facility, comprising:
one or more enclosures defining an interior space;
a plurality of power taps positioned along a plurality of first paths in the interior space that are electrically coupled to a common electrical supply;
a plurality of coolant supply taps positioned along a plurality of second paths in the interior space that are fluidly coupled to a common supply header; and
a plurality of coolant return taps positioned along a plurality of third paths in the interior space that are fluidly coupled to a common return header and fluidly coupled to the second paths through heat exchange modules;
wherein each first path of the plurality of first paths has an associated proximate second path of the plurality of second paths and an associated proximate third path from the plurality of third paths, and wherein each first path is spaced from the associated proximate second path by a substantially uniform first distance along a substantial length of the first path that extends from the common electrical supply to an end of the first path, and wherein each first path is spaced from the associated proximate third path by a substantially uniform second distance along the substantial length of the first path, and
the power taps are disposed with substantially uniform first spacing along the first paths, the supply taps are disposed with substantially uniform second spacing along the second paths, and the return taps are disposed with substantially uniform third spacing along the third paths, and the first spacing is a ratio N/M of the second spacing, where N and M are both whole numbers less than 5.

### Claim 44 (depends on 43)

The facility of claim 43, wherein the plurality of power taps are distributed with a substantially regular first spacing in a first direction and with a substantially regular second spacing in a second direction perpendicular to the first direction, the plurality of coolant supply taps are distributed with a substantially regular third spacing in the first direction and with a substantially regular fourth spacing in the second direction, and the plurality of coolant return taps are distributed with a substantially regular fifth spacing in the first direction and with a substantially regular sixth spacing in the second direction.

### Claim 45 (depends on 44)

The facility of claim 44, wherein the third spacing is approximately equal to the fifth spacing and the fourth spacing is approximately equal to the sixth spacing.

### Claim 46 (depends on 45)

The facility of claim 45, wherein the first spacing is a ratio N/M of the third spacing, where N and M are both whole numbers less than 5.

### Claim 47 (depends on 45)

The facility of claim 45, wherein the second spacing is an integer N multiple (N) or fraction (1/N) of the fourth spacing, where N is less than five.

### Claim 48 (depends on 45)

The facility of claim 45, wherein the first spacing is approximately equal to the third spacing and the second spacing is approximately equal to the fourth spacing.

### Claim 49 (depends on 43)

The facility of claim 43, further comprising a plurality of modules of rack-mounted computers, wherein the modules of rack-mounted computers are arranged perpendicular to the plurality of first paths.

### Claim 50 (depends on 49)

The facility of claim 49, wherein the modules of rack-mounted computers are arranged perpendicular to the plurality of second paths and the plurality of third paths.

### Claim 51 (depends on 49)

The facility of claim 49, wherein there is a second path and a third path for every two rows of the modules of rack-mounted computers.
