The configuration of the Itanium2 cluster is shown below. It consists of 32 compute nodes connected by a Myrinet and a fast ethernet network. All nodes run Rocks 4.2.1/CentOS 4.3. All compute nodes are accessed from the front end machine (cpd.arc.wm.edu). An Apple Xserve-RAID array is directly attached to the fron end and contains the home directories and 2 globally accessible scratch spaces of about 1 TB each.
The following table lists the details of each machine in the cluster:
| # | Node name | architecture | processor | memory | disk | Note |
|---|---|---|---|---|---|---|
| 1 | cpd.arc.wm.edu | HP Itanium rx2600 | Itanium2 / 1.3 GHz | 4 GB | (see below) | No Myrinet |
| 2 | it01,it02 | HP Itanium rx2600 | dual Itanium2 / 1.3 GHz | 4 GB | 20 GB | No Myrinet | 30 | it03 - it32 | HP Itanium rx2620 | dual Itanium2 / 1.3 GHz | 6 GB | 20 GB |
Table 2 shows the various filesystems that users may access within the cluster. The /home, /scr1 and /scr2 filespaces are all mounted via NFS over the fast ethernet network. Currently a 10GB quota is set for all users /home directory space. /scr1 and /scr2 are to be used as global scratch space. The global scratch space is to be used for temporarily storing large files. Neither /scr1 or /scr2 is backed up and purging is not done automatically. Users with large amounts of data (>100 GB) will be made to reduce their usage when the scratch space starts to get too full (> ~70%).
NO JOBS SHOULD WRITE TO /home,/scr1 or /scr2 DURING EXECUTION You must always use the /lscr filesystem for writing for ALL jobs on this cluster. There are NO exceptions
| name | size | notes |
|---|---|---|
| /home/$USER | 480 GB | users get a 10 GB quota |
| /scr1/$USER | 900 GB | Global NFS scratch 1 |
| /scr2/$USER | 900 GB | Global NFS scratch 2 | /lscr | 23 GB | Local scratch on compute node |
The following lists the compilers, libraries, mpi environments and computational packages that are currently installed on the cluster. Most packages have an environment module in place for users to load. Please send email to Eric J. Walter if you need additional software installed.
| Command | |||||
|---|---|---|---|---|---|
| Description | Version(s) | Module | C | C++ | Fortran |
| Intel | 11.0.081 | intel/11.0.081 | icc | icpc | ifort |
| Name | Version | Module |
|---|---|---|
| fftw v3 | 3.2.1 | fftw/3.2.1 |
| cmkl - Intels Cluster Math Kernel Library | 10.1.1.019 | intel/mkl10.1.1.019 |
| Name | Version | Module |
|---|---|---|
| openmpi | 1.2.8 | openmpi/1.2.8 |
| mpich-gm | 1.2.7 | mpich/1.2.7 |
| Name | Version | Module | Notes |
|---|---|---|---|
| ABINIT | 5.4.4p, 5.6.5, 5.7.3 | abinit/abinit-5.4.4p, abinit/abinit-5.6.5, abinit/abinit-5.7.3 |