Main Navigation

Secondary Navigation

Page Contents

Contents

Resources of the High Performance Computer 'Elwetritsch'

Hardware Complexes

During time different hardware entered the High Performance Computer. To guarantee reproducibility and for parallel job a homogeneous environment, these different hardware components are clustered in complexes. Special among the complexes are head and dedicated which are reserved and not usable for longer jobs. The head nodes are intended for interactive work and dedicated nodes are owned by others and only available for their owners.

Login Nodes Login Server Properties Summary
Host Type CPUs Cores Memory Interconnect # Servers ∑ Cores ∑ Memory
TUK elwe1: Intel XEON SP 6126 2 24 384 GB 10 GE + IB QDR 1 24 384 GB
elwe2: Intel XEON SP 6126 2 24 384 GB 10 GE + IB QDR 1 24 384 GB
elwe3: Intel XEON SP 6126 2 24 384 GB 10 GE + IB QDR 1 24 384 GB
elwe4: Intel XEON SP 6126 2 24 384 GB 10 GE + IB QDR 1 24 384 GB
RARP elwe1: Intel E5-2670 2 16 128 GB 10 GE + IB QDR 1 16 128 GB
elwe2: Intel E5-2670 2 16 128 GB 10 GE + IB QDR 1 16 128 GB
6 128 1792 GB
Complex Server Properties Summary
Host Type CPUs Cores Memory Interconnect # Servers ∑ Cores ∑ Memory
mpi32 Intel E5-2670 2 16 32 GB IB QDR 154 2464 4928 GB
mpi64 Intel E5-2670 2 16 64 GB IB QDR 114 1824 7296 GB
mpi128 Intel E5-2670 2 16 128 GB IB QDR 18 288 2304 GB
mpi64v3 Intel E5-2640v3 2 16 64 GB IB QDR 96 1536 6144 GB
mpi256v3 Intel E5-2640v3 2 16 256 GB IB QDR 24 384 6144 GB
single64v3 Intel E5-2637v3 2 8 64 GB IB QDR 24 192 1536 GB
mpi96 Intel XEON SP 6126 2 24 96 GB OPA 300 7200 28800 GB
mpi384 Intel XEON SP 6126 2 24 96 GB OPA 24 576 2304 GB
accelerator Intel E5-2670 + 2x NVIDIA Tesla M2090 2 16 32 GB IB QDR 3 48 96 GB
Intel E5-2670 + 2x NVIDIA Tesla M2090 2 16 64 GB IB QDR 3 48 192 GB
Intel E5-2670 + 2x NVIDIA Tesla K20x 2 16 64 GB IB QDR 2 32 128 GB
Intel E5-2670 + 4x NVIDIA Tesla K20x 2 16 64 GB IB QDR 1 16 64 GB
Intel E5-2640v3 + 1x NVIDIA Tesla K80 2 16 256 GB IB QDR 1 16 256 GB
Intel XEON SP 6126 + 1x NVIDIA Tesla V100 2 24 192 GB OPA 2 48 384 GB
Intel XEON SP 6126 + 4x NVIDIA Tesla V100 2 24 192 GB OPA 1 24 192 GB
Intel E5-2670 + 2x Intel XEON Phi 5110P 2 16 32 GB IB QDR 1 16 32 GB
Intel E5-2670 + 2x Intel XEON Phi 5110P 2 16 64 GB IB QDR 2 32 128 GB
Intel Xeon Phi Processor 7290 (KNL) 1 72 192 GB OPA 2 144 384 GB
bigmem Intel XEON E5-4650 4 32 1024 GB IB QDR 1 32 1024 GB
vgl Intel E3-1270 + NVIDIA Quadro 4000 1 4 16 GB IB QDR 9 36 144 GB
Intel E6-1620v4 + NVIDIA Quadro P2000 1 4 64 GB OPA 7 28 448 GB
Intel E6-1620v4 + NVIDIA Quadro P2000 1 4 256 GB OPA 2 8 512 GB
misc 40 800 4328 GB
831 15792 67864 GB

Queues

Jobs are organized in queues or partitions according to their resource requirements. Best practice is not to use queues or partitions for job submission but resource requirements and leave the selection of a queue to the batch system. A very important resource is the job run time. It should be specified approximately, see guide. Other important resources are the requested memory of a job or the hardware of a CPU, all described in the guide.

Name Tier Priority State Nodes Job Slots Max Walltime Running Suspended Pending
idle 1 1 UP 831 16736 10 d 1320 0 725
short 2 10 UP 831 16736 01:30 h 0 0 0
skylake 2 20 UP 322 7728 2 d 0 0 0
extralong 2 30 UP 148 2160 30 d 94 0 0
long 2 31 UP 232 3504 10 d 1275 0 174
normal 2 32 UP 374 5776 2 d 2637 0 499
bypass-extralong 2 40 UP 413 6416 30 d 0 0 0
bypass-long 2 41 UP 413 6416 10 d 0 0 0
bypass-normal 2 42 UP 428 6656 2 d 0 0 0
mem 2 50 UP 42 688 30 d 576 0 368
mic 2 50 UP 5 672 10 d 576 0 0
gpu 2 50 UP 13 232 10 d 0 0 0
physik-fleischhauer 2 70 UP 2 108 UNLIMITED 0 0 0
physik-theophys 2 70 UP 3 40 UNLIMITED 0 0 0
biologie-stoeck 2 70 UP 1 24 UNLIMITED 0 0 0
physik-schneider 2 70 UP 1 32 UNLIMITED 0 0 0
physik-urbassek 2 70 UP 22 744 UNLIMITED 464 0 0
mv-mvt 2 70 UP 3 44 UNLIMITED 16 0 8
ivw 2 70 UP 2 64 UNLIMITED 16 0 0
rhrk-test 2 80 UP 831 16736 UNLIMITED 0 0 0
oldscratch 2 81 DOWN 15 240 10 d 1 0 0
interactive 2 81 UP 37 448 7 d 8 0 0
reservation 2 82 UP 831 16736 UNLIMITED 0 0 0
6983 0 1774

File Systems

The High Performance Computer comes up with different file systems for different purposes and policies. Please be aware that all files are deleted after your RHRK account has expired or your project has ended.

PathTypeSizeFreeCluster-wideQuotaBackupPurpose
$HOMENFS9 TB5 TByes40 GBvia NetApp snapshots
in /home/.snapshot
personal files, self-compiled programs
(will be deleted when your RHRK account expires)
$SCRATCHFhGFS1284 TB797 TByesnonenolarge files that can be read and written in parallel
(oldest files will be deleted when file system is 85% full)
$WORKNFS25 TB1 TByesnonenosmall files for simulations - on request only
(will be deleted when your RHRK account expires)
$TMPDIRext4varyingn/anononenoshort-time storage of local files
(will be deleted after job ends)