Attention: Confluence is not suitable for the storage of highly confidential data. Please ensure that any data classified as Highly Protected is stored using a more secure platform.
If you have any questions, please refer to the University's data classification guide or contact ict.askcyber@sydney.edu.au. When using in-built AI tools ensure you are in compliance with the University's responsible AI guardrails
Sydney HPC Scheme
What is the Sydney HPC Allocation Scheme?
The Sydney Scheme provides University-subsidised access to national HPC facilities: NCI’s Gadi and Pawsey’s Setonix HPCs. USyd purchases and distributes Service Units from NCI and Pawsey on a quarterly basis to both of these systems. Access to these systems will be an ongoing feature of the Sydney Research Cloud ecosystem and will be provided in-kind with no direct cost to researchers within the quarterly allocation caps.
Conditions of use
Allocations are not merit-assessed but are subject to the following conditions of use to ensure fairness, efficient utilisation, and sustainability of this service.
What are service units?
NCI and Pawsey use a Service Unit (SU) model to track and manage compute usage. Think of SUs as currency that reflects the computational cost of your jobs. SUs help you to manage your compute budget and allow the University to distribute resources fairly across research projects.
Each job you run will consume SUs based on:
Number of CPU cores or GPUs (which are typically more expensive)
Memory requested
Storage
Job duration (wall time)
Partition or queue type
A Service Unit (SU) is the currency of Tier-1 HPCs. Different computational requirements (large memory, gpu, cpu, faster queue times etc) charge different amounts. SU are often reported as KSU (1,000 SU) and MSU (1,000,000 SU).
e.g. at NCI, 2SU ~ 1 Gadi cpu-core-hour, although this can vary based on the requested resources and queue.
Note that Service Units at NCI and Pawsey are not equal: 1 Pawsey SU is approximately equivalent to 2 NCI SU at the moment, in both cost and compute.
Accessing Pawsey
All University of Sydney requests are submitted to Pawsey on the first and third Wednesdays of each month by the Scheme Managers at the Sydney Informatics Hub.
Complete our Pawsey onboarding form to be invited to create a Pawsey account and project:
Pawsey projects must be led by research staff at the University. Students should therefore get their supervisor to set up an Pawsey account and nominate themselves as lead CI on new projects.
How do I request additional service units and storage?
Complete the SIH request form for SU and Acacia storage requests.
Accessing NCI
To access any of NCI’s computing platforms including Gadi HPC, you first need to create an NCI account. You will also need to either create a new project or request to join an existing one. You can be a member of multiple projects. Resources at NCI are allocated to projects and not to individual users.
NCI projects must be led by research staff at the University. Students should therefore get their supervisor to set up an NCI account and nominate themselves as lead CI on new projects.
How do I request additional service units and storage?
If you exhaust your allocation or anticipate requiring more computing time, you may request additional Service Units in the management portal:
Complete the SIH request form for gdata allocations
Contact the NCI Helpdesk to manage your /scratch allocations
Massdata allocations are not supported as The University of Sydney provides the Research Data Store for this service.
Resources and support
For enquiries relating to: | Contact point |
NCI project administration, service unit allocations, gdata storage increases | Sydney Informatics Hub request form: |
Pawsey project administration and service unit allocations | Sydney Informatics Hub request form: |
General questions regarding Sydney Research Cloud project, planned new infrastructure and services, as well as specialised compute requirements | Sydney Informatics Hub request form: |
Optimising and troubleshooting your code | Sydney Informatics Hub request form: |
NCI technical help, software installs, scratch storage increases, scratch and gdata inode increases | NCI helpdesk: help@nci.org.au
|
Pawsey technical help, software installs, Acacia storage increases | Pawsey helpdesk: help@pawsey.org.au |
NCI Gadi quickstart onboarding guide for USyd researchers | |
Pawsey Setonix quickstart onboarding guide for USyd researchers |
Depending on your requirement for Service Units, you may wish to consider alternate methods of access at: https://nci.org.au/users/how-access-nci