Caltech Center for Advanced Computing Research » Page 'System Guides: SHC '

System Guides: SHC

How to Get An Account

CACR Accounts

How to Access the Machine

Connect to the front end, shc.cacr.caltech.edu:

ssh -l username shc.cacr.caltech.edu

Edits, compiles, builds, and job submissions are done on the front end.

NOTE: password entry into the head node is not allowed, but rather access is permitted via ssh public keys. If you do not have a public key, please see SSH key generation instructions.

System Configuration Information / Technical Summary

The Shared Heterogenous Cluster provides computing capabilities specifically configured to meet the needs of applications from Caltech’s Predictive Science Academic Alliance Program, Turbulent Mixing, Applied and Computational Mathematics, and Numerical Relativity communities.

The configuration, integrated by Hewlett-Packard and CACR’s technical support team, consists of 203 AMD dual processor nodes, connected via Voltaire’s Infiniband and an Extreme Networks BlackDiamond 8810 GigEswitch.

The typical programming model used for SHC jobs is MPI, with flexible queue policies allowing for development and production runs.

Cluster Configuration Overview Diagram (coming soon)

Technical Summary:

Architecture
  • Opteron RHEL Linux Cluster
Head Nodes
  • 8 processors, single core
  • 16 GB ECC SDRAM memory
  • 2 nodes
Compute Nodes
  • dual-processor, dual & quad core
  • 2 GB ECC SDRAM memory per core
  • 229 nodes (1180 cores)
Processor
  • Dual-processor, dual-core
    • 86 AMD Opteron [275, 2214 HE], 2.2 GHz
    • 77 AMD Opteron [280, 2216 HE], 2.4 GHz
  • Dual-processor, quad-core
    • 66 AMD Opteron 2380, 2.5 GHz
Network Interconnect
  • PCI-x InfiniBand
  • Copper Gigabit Ethernet
Disk
  • ~84 TB raw, RAID6 nfs project work area/nfs/ds[01,02,03,04]/project-id
  • 180 GB local scratch/node
Operating System
  • Linux 2.6.18 (RHEL 5.3)
Compilers
  • GNU 4.3.3
  • PGI 8,9
  • Intel [_v11.1]
  • Open64 v4.2.3.1
Batch System
  • Torque with Maui
MPI
  • Open MPI