Efficient and reliable data transfer is a critical component of research computing. A variety of useful tools is available for rapid data transfer, whether you are transferring data from an external site or within different computing environments at UVA. Selecting a Transfer Method The data transfer method you choose heavily relies on the data sensitivity classification, where the data are currently located and to where you want to transfer the data. Click on a row in the table below to learn more about the data transfer methods available for a specific scenario.
System 1 System 2 Example Scenario Lab Workstation Storage for Public and Moderatively Sensitive Data Copy data from a lab workstation to a /project storage share.
Globus is a simple, reliable, and fast way to access and move your research data between systems. Globus allows you to transfer data to and from systems such as:
Laptops HPC clusters (Rivanna) Lab / departmental storage Tape archives Cloud storage Off-campus resources (XSEDE, National Labs) Globus can help you share research data with colleagues and co-investigators, or to move data back and forth between a lab workstation and Rivanna or your personal computer.
Are your data stored at a different institution? At a supercomputing facility? All you need is your campus login.
Getting Started A Globus “collection” (also called an “endpoint”) is any computer running the Globus Connect software.
Standard Linux tools can efficiently transfer a small to moderate quantity of data to or from Rivanna.
scp scp uses the secure shell (SSH) protocol to transfer files between your local machine and a remote host, or between two remote hosts.
The following syntax enables copying from local to remote or vice versa. In both cases we are starting from the local system.
By default, scp works from the level of the directory in which it is invoked.
Copying from local to remote: scp source_file mst3k@hostaddress:target_file Copying from remote to local: scp mst3k@hostaddress:source_file target_file The following examples detail how to transfer data between your local computer and /project storage on Rivanna.
Cyberduck is a transfer tool for Windows and Mac. It supports a large number of transfer targets and protocols. Only SFTP can be used with Rivanna. The free version will pop up donation requests.
Download Download Cyberduck
Connecting to Rivanna and File Transfer Launch Cyberduck. After launching Cyberduck, the user interface will open. To initiate a connection to Rivanna, click the Open Connection button. Enter Your Credentials. From the drop-down menu, select SFTP (SSH File Transfer Protocol. Then enter the appropriate information in the following fields:
Host: rivanna.hpc.virginia.edu Username: your computing ID Password: your Rivanna password Port: 22 When completed, click Connect.
Filezilla is a cross-platform data transfer tool. The free version supports FTP, FTPS, and SFTP. Only SFTP can be used with Rivanna.
Download Download Filezilla
Connecting to Rivanna and File Transfer Launch FileZilla. After launching FileZilla, the user interface will open. In the left panel, you should see your local file system and files listed in the left side panels. You will enter your login credentials in the fields highlighted in the figure below. Enter Your Credentials. Fill in the Host, Username, Password, and Port fields.
Host: rivanna.hpc.virginia.edu Username: your computing ID Password: your Eservices password Port: 22 When completed, click Quickconnect.