The information here is of a detailed, technical nature and is not required knowledge to use Artemis. If you are an advanced user, the information here may prove useful if you wish to compile specifically for Artemis.

Artemis is made up of a number of components, including the login nodes, compute nodes, storage system, and management nodes. The compute nodes, Lustre storage and management nodes are all connected by a high performance, low-latency InfiniBand (IB) interconnect. There is also a 10 Gbps Ethernet management network interconnecting the compute, login and management nodes for compute node and batch job management.

Artemis has a mix of Haswell, Broadwell and Skylake compute nodes based on dual socket servers.

The key features of the Haswell nodes are:

The key features of the Broadwell nodes are:

The key features of the Skylake nodes are:

High Memory Nodes

Artemis has three very high memory compute nodes based on a quad socket server with 6 TB of RAM:

There are also two high memory nodes based on a dual socket server with 512 GB of RAM:

GPU Nodes

There are seven Dell C4140 GPU nodes with four Nvidia V100 SXM2 16 GB GPGPUs and two x 16 core CPUs available to all Artemis users. The four GPUs in each compute node are connected using 300 Gbit/s NVLINK2. Technical details about these nodes are shown below:

High Performance File System

Artemis has globally accessible, high-performance Lustre file system with 56 Gbps FDR InfiniBand interconnect to the rest of the cluster.

The /home, /scratch and /project directories are all stored on Lustre.

Management and Control Nodes

The management nodes are accessible to the vendor’s system administrators only and are used to manage workflow within the cluster.

These nodes consist of two Dell R630 servers with dual 16 core CPUs and 512 GB of memory with a Compellant storage subsystem running virtualised VMware ESXI 6.

Node Interconnect

All nodes and the Lustre filesystem are connected using 56 Gbps FDR InfiniBand interconnect in a 2:1 blocking fat tree configuration. The InfiniBand interconnect provides low latency communications between compute nodes for maximum MPI bandwidth.

Ethernet Networking

10 Gbps redundant switched connections are available between the MPLS switches provided by the University and the Ethernet fabric. The 10 Gbps Ethernet provides access to the login nodes from AARnet and the management network. The 1 Gbps Ethernet provides out-of-band connectivity to the compute nodes.