File Transfers

Important

Globus is highly recommended for File Transfers on Tufts HPC Cluster

Important

VPN - Off-campus access from non-Tufts Network please connect to Tufts VPN

Prerequisites

• Active Cluster Account

• VPN

• 2FA

There are several methods available to copy your data to and from the HPC cluster. These include SCP/SFTP, OnDemand and Globus.

Important

File Transfer Hostname xfer.pax.tufts.edu (formerly xfer.cluster.tufts.edu)

• File Transfer Protocol

  • SCP(Secure Copy Protocol)

  • SFTP(SSH File Transfer Protocol)

  • rsync over SSH

• Recommended software

  • Cross-Platform: SecureCRT

  • Windows Only: WinSCP

  • Cross-Platform: FileZilla

  • Cross-Platform: Cyberduck

  • Native: Windows 11, Mac and Linux all include a command line SSH clients in the OS. This scp command can be used for quick connections without installing additional software.

  • Web Interface:OnDemand (Only for transfering files size less than 976MB per file.)

OnDemand

• Go to OnDemand:

  https://ondemand.pax.tufts.edu/

• Under Files, using the Upload or Download buttons to transfer. Make sure you navigate to the destination/source directory on cluster using the Go To button before transfering files.

  

  You may not see your lab folder listed under /cluster/tufts, DO use Go To buttom and TYPE out the FULL path.

Command Line - scp & rsync

Hostname** for file transfer: xfer.cluster.tufts.edu

NOTE:

• Local_Path : Path to your files or directory on your local computer

• Cluster_Path :Path to your files or directory on the cluster

  • Home Directory: /cluster/home/your_utln/your_folder

  • Research Project Storage Space Directory: /cluster/tufts/yourlabname/your_utln/your_folder

**Execute from your local machine terminal. **

General Format:

$ scp From_Path To_Path

$ rsync From_Path To_Pat

NOTE: If you are transfering very large files that could take hours to finish, we would suggest using rsync as it has ability to restart from where it left if interrupted.

Example:

File Transfer with scpor rsync:

• Download from cluster

$ scp your_utln@xfer.cluster.tufts.edu:Cluster_Path Local_Path 

$ rsync your_utln@xfer.cluster.tufts.edu:Cluster_Path Local_Path

• Upload to cluster

$ scp Local_Path your_utln@xfer.cluster.tufts.edu:Cluster_Path

$ rsync Local_Path your_utln@xfer.cluster.tufts.edu:Cluster_Path

Directory Transfer with scp or rsync:

• Download from cluster

$ scp -r your_utln@xfer.cluster.tufts.edu:Cluster_Path Local_Path 

$ rsync -azP your_utln@xfer.cluster.tufts.edu:Cluster_Path Local_Path

• Upload to cluster

$ scp -r Local_Path your_utln@xfer.cluster.tufts.edu:Cluster_Path

$ rsync -azP Local_Path your_utln@xfer.cluster.tufts.edu:Cluster_Path