...
Artemis has a queue, called dtq, that has nodes with access to /rds (which is the /wiki/spaces/RC/pages/229113857 version of the Research Data Storethe research data store (mounted under /rds) and the internet. This queue is dedicated to running data moving jobs and other input/output (I/O) intensive work, such as compressing and archiving files, copying data from Artemis to the Research Data Store, or copying data to and from remote locations. These nodes have dedicated ethernet and infiniband bandwidth to maximise file transfer speeds, so they deliver significantly better data transfer and I/O performance than the login nodes. No other compute nodes on Artemis have access to /rds or the internet. The login nodes can still be used for small I/O work, but heavy copy or I/O work should be submitted to dtq instead.
An example dtq job, which moves the mydata directory from Artemis to /wiki/spaces/RC/pages/229113857RDS, using an example project called PANDORA, is shown below:
...