How do I transfer data to/from the cluster?

• If you are on your workstation or laptop and you would like to transfer data to/from the cluster, you can do so using one of the various command line or GUI SCP/SFTP clients. We have found that some 3rd party GUI clients do not work well (or at all) with DUO two-factor authentication. There are some clients that work fine with DUO. 
• If you are transferring large datasets to/from an external source you may want to consider using the Data Transfer Node  (DTN ) Data Transfer Node (DTN) 

Below is a sample GUI setup: 

• FileZilla, a popular SFTP GUI, is available for Windows, Mac OS X, and Linux. It also works well with DUO two-factor auth, however, you must choose some non-default options (outlined below) in order to have the best experience with your file transfers.
• The following are instructions for setting up FileZilla for transferring data to/from the cluster:
• Visit the link https://filezilla-project.org/download.php?show_all=1 Below example is for Windows OS FileZilla FTP client setup. So select the windows only option to download the file. For other OS, please select relevant options. Click on the Download FileZilla server button. After successful download, please run the .exe file. 

Please follow the setup process and install the application.

After successful installation, please click on File -> site Manager . Set up a site (click the "New Site" button). Do not use the Quick Connect option. Give your "New site" a name, like "URC" or "HPC"

• Fill in below details : 

Protocol: SFTP

Host: hpc.uncc.edu

Logon Type: Interactive

• User/Password: Optional. You can save your username (NinerNET ID) in the "User" field, to save from having to enter with each connection, but I do not recommend that you save your password. If you leave either or both blank, you will be prompted upon connection.

• On the Transfer Settings tab of your site, make sure "Limit number of simultaneous connections" is checked, and "Maximum number of connections" is set to 1

Click connect. You will be prompted to enter your username and password. If Duo enabled, you will be given a second authentication option to enter the Duo Mobile passcode. Please refer link to setup Duo Mobile : https://services.help.charlotte.edu/TDClient/33/Portal/KB/ArticleDet?ID=770

After successful connection you will see your directory displayed on the right panel

Now that your account is accessible for file transfer, below is an example for file transfer from local laptop to your account in hpc.uncc.edu . Please make the source file selection and the target path selection from the GUI. 

Source path : the panel on the left

Target Path: The panel on the right 

Successful transfer logs 

Similarly, WinSCP is also a popular SCP/SFTP GUI for Windows. It works well with DUO two-factor auth, using the default settings.

Cyberduck is a popular SFTP GUI for Windows and Mac OS X. For a smooth experience using DUO two-factor auth, make sure to set File Transfer settings to "Use browser connection" to avoid having to authenticate each time you want to transfer a file.

 If you are having trouble trying to get your 3rd party SCP/SFTP GUI client to authenticate to our clusters, please contact us