HPC Filesystems
There are five file systems within the WAVE HPC that can hold user data:
/WAVE/users Filesystem
Each HPC user is allocated a home directory with in the /WAVE/users filesystem. This is your personal space for configuring your environment, developing code and working with small data sets. The home directories are limited to 50GB in total disk space and are backed up on a daily basis.
/WAVE/projects Filesystem
For projects involving multiple people working collaboratively, there is the /WAVE/projects filesystem. A project team would be allocated a shared directory, with access restricted to a group consisting of the individual members of the project. A project directory is limited by default to 100GB of disk space, though that limit can be increased based on the needs of the project. The projects directories are backed up on a daily basis.
To request a projects directory, or to request an increase in the size limit of an existing directory, contact the support team at wavesupport@scu.edu.
Individuals whose research requires more than the 50GB allocated within a home directory can also request a folder under the project's filesystem with larger space limits.
/WAVE/datasets Filesystem
The /WAVE/datasets filesystem is appropriate for large external datasets which can be recovered by downloading a fresh copy from the external source. As such the datasets filesystem is NOT backed up and data stored in the datasets filesystem will be lost in the event of a failure. A datasets directory is limited by default to 100GB of disk space, though that limit can be increased based on the needs of the project.
To request a dataset directory, or to request an increase in the size limit of an existing directory, contact the support team at wavesupport@scu.edu.
/WAVE/workarea/users Filesystem
In addition to a home directory, each user is also allocated space in the /WAVE/workarea/users/ file system. These directories are available to hold user data. There is no quota at this time on the workarea file system. The workarea file system is an ideal location to store large executables and objects that have been downloaded from the internet. Note that the workarea filesystem is not backed up and data stored here could be lost in the unlikely event of failure.
/WAVE/scratch Filesystem
The /WAVE/scratch filesystem is meant to be true scratch file system with a capacity of upto 1TB of data. This is appropriate for large temporary data sets. The scratch filesystem is not backed up and files stored in scratch filesystem are not guaranteed to survive beyond the active session which created the file. You can think of the scratch filesystem as a larger /tmp directory.
To request a scratch directory contact the support team at wavesupport@scu.edu.
Tutorials Available:
Managing Home Directory Disk Quotas
Working with External Datasets
Transferring Files From the HPC To Google Drive