The attached image shows 3 zwicky racks, each populated with 24 nodes. The orange and yellow cables are fibre InfiniBand connections, routed under the floor back to the cabinet holding the InfiniBand switches. The two rows of switches at the bottom of the racks are power distribution units. The black blanking panels, above the nodes and in the top half of the racks, are where additional zwicky nodes will live!

The back side - hot aisle - of all 6 zwicky cabinets.

The "back side" of zwicky nodes. Each enclosure holds 4 zwicky nodes. The bundle of yellow and orange fibre is InfiniBand cabling, routed under the floor and into the InfinBand switch cabinet.

A close up of a rack of zwicky compute nodes. Orange cables are fibre InfiniBand, black are GigE local management networking.

The InfiniBand/head node zwicky cabinet. Yellow and orange cables are fibre, black are copper. These cables connect the each zwicky node into the Voltaire QDR InfiniBand switch fabric, and connect the leaf switches in the fabric to one another. The Panasas file system also has two InfiniBand connections into this fabric.