In a typical HPC environment, there are generally four types of storage.
It's a cluster file system accessible from all nodes, enabling multiple clients to read and write to it, often equipped with file locking mechanisms.
The M3 cluster utilizes Lustre a parallel/distributed file system for this functionality, housing your Home folder along with Group and Project folders.
Local disks are present on each compute node, with data on a node's local disk inaccessible from other nodes.
In the M3 cluster, all local disks are high-speed NVMe. Accessible under '/tmp', data on local NVMe drives will be erased after your job finishes or is terminated for any reason.
All data older than 30 days will be periodically removed from /tmp and /scratch_local on the login nodes.
Note: /scratch_local may be deprecated and consolidated with /tmp in the future.
Optional encryption of both folders and files is available. Please visit the Encryption page.
There are currently no backup facilities available in the M3 Cluster. Please ensure to regularly backup your data.
Archival storage is intended for preserving data over extended periods. It requires clear regulation and defined procedures for determining the eligibility of data to be stored there.
Currently, there are no archival storage and policies implemented in the M3 cluster.