/project file system provides users with a collaborative space for data storage and sharing. Members in the same group have access to a shared directory created by the team lead or PI. Group membership can be defined and managed through ITS MyGroups system.
/project storage is mounted on the Rivanna HPC cluster and runs on a new scale-out NAS file system.
How to request space in
/project storage is available by request (via CADRE User Support page) for $90/TB/YR. When filling out the form, the PI can specify the size of the
/project directory and the name of an existing or new MyGroup that can access this space. We recommend choosing a MyGroup name specific to your group or collaboration for the
/project directory. This will reduce confusion in the future if you manage multiple MyGroups and directories on other storage systems.
Once the request has been submitted, the PI will receive a notification that the /project space has been provisioned within 24 hours. Once the space becomes available, the PI can grant access to lab members by adding them to the MyGroup. Users in the MyGroup will see the directory (~/project/MyGroup_name) after logging into Rivanna. Addition and removal of users is managed by the PI of the group.
Data transfer to & from
scp uses secure shell (SSH) protocol to transfer files between your local machine and a remote host.
scp can be used with the following syntax:
scp SourceFile firstname.lastname@example.org:/project/MyGroup_name
Detailed instructions and examples for using
scp are listed here.
sftp is a network protocol for secure file management. Instructions and examples for using
sftp are located here.
Globus provides access to data on local machines and Rivanna file systems, as well as external institutions and facilities. Globus is well suited for transferring both small files and large amounts of data. More information on Globus data transfer can be found here).
File manipulation and navigation with /project
/project storage is based on a Linux file system just like other storage spaces on the Rivanna cluster, including
/scratch. Users can invoke generic Linux commands to manage files and directories (
mkdir), manage permissions (
chown) and navigate the file system (
pwd). If you or your collaborators are unfamiliar with some of these commands, we encourage you to take time to review some of the material below:
- A Gentle Introduction
- 10 Essential Linux Commands
- How To Manage Files From The Linux Terminal
- Navigating the Linux Filesystem
- Shell Novice
For more help, please feel free to contact RC to set up a consultation or visit us during office hours. We also provide in-person training opportunities around basic command line skills and more through the CADRE Academy portal.