GridFTP is useful for transferring large files or large amounts of files.  


Users will need to install the GlobusToolkit on their desktop or laptop.  CCR does not support Globus, their website has installation instructions.  However, we do have a CentOS Linux installation and configuration example.


NOTE: At this time, we can't support encryption with this method.  If this is important to you, please encrypt your files before transferring them and then un-encrypt them once they are on CCR's server.


Use the globus-url-copy with the sshftp:// protocol to move files from your machine to CCR's data transfer server: transfer.ccr.buffalo.edu


Please be aware: The data transfer server is not to be used for compiling code or submitting jobs to the cluster.  If you have modules sourced in your login files, you will get an error message when you login as modules are not supported on the data transfer server.



gloubus-url-copy file transfrer examples, initiated from transfer.ccr.buffalo.edu


Transfer a file from CCR storage in 32 parallel streams to a remove Globus GridFTP Server


transfer$ source /usr/etc/ccr-globus-user-env-external.sh
transfer$ globus-url-copy -verbose-perf -parallel 32 \
 -tcp-buffer-size 16777216 -block-size 16777216 \
 file:///gpfs/scratch/largefile.bz2 \
 sshftp://user@host.domain.edu//home/_username_/
[...]
transfer$



Transfer a file to CCR storage in 32 parallel streams from a remove Globus GridFTP Server


transfer$ source /usr/etc/ccr-globus-user-env-external.sh
transfer$ globus-url-copy -verbose-perf -parallel 32 \
 -tcp-buffer-size 16777216 -block-size 16777216 \
 sshftp://user@host.domain.edu//home/_username_/largefile.bz2 \
 file:///gpfs/scratch/_username_/largefile.bz2
[...]
transfer$