GridFTP is useful for transferring large files or large amounts of files.  


Users will need to install the GlobusToolkit on their desktop or laptop.  CCR does not support Globus, their website has installation instructions.  However, we do have a CentOS Linux installation and configuration example.


Use the globus-url-copy with the sshftp:// protocol to move files from your machine to CCR's data transfer server: transfer.ccr.buffalo.edu


To achieve the best file transfer speeds, unencrypted file transfers must be used - encrypt you files before transfer the, and unencrypt them once they are on CCRs servers.  Encrypted file transfers have a limit of about 400MB/sec, whereas unencrypted transfers max out about 1GB/sec


Please be aware: The data transfer server is not to be used for compiling code or submitting jobs to the cluster.  If you have modules sourced in your login files, you will get an error message when you login as modules are not supported on the data transfer server.



gloubus-url-copy file transfrer UNENCRYPTED examples, initiated from transfer.ccr.buffalo.edu


Transfer a file from CCR storage in 32 parallel unencrypted streams to a remove Globus GridFTP Server


transfer$ source /usr/etc/ccr-globus-user-env-external.sh
transfer$ globus-url-copy -verbose-perf -parallel 32 \
-tcp-buffer-size 16777216 -block-size 16777216 \
file:///gpfs/scratch/_username_/largefile.bz2 \
sshftp://user@host.domain.edu//home/_username_/
[...]
transfer$



Transfer a file to CCR storage in 32 parallel unencrypted streams from a remove Globus GridFTP Server


transfer$ source /usr/etc/ccr-globus-user-env-external.sh
transfer$ globus-url-copy -verbose-perf -parallel 32 \
-tcp-buffer-size 16777216 -block-size 16777216 \
sshftp://user@host.domain.edu//home/_username_/largefile.bz2 \
file:///gpfs/scratch/_username_/largefile.bz2
[...]
transfer$




gloubus-url-copy file transfrer ENCRYPTED examples, initiated from transfer.ccr.buffalo.edu


Transfer a file from CCR storage in 32 parallel encrypted streams to a remove Globus GridFTP Server


transfer$ source /usr/etc/ccr-globus-user-env-external.sh
transfer$ globus-url-copy -verbose-perf -parallel 32 \
 -tcp-buffer-size 16777216 -block-size 16777216 \

 -data-channel-private -data-cred auto \
file:///gpfs/scratch/_username_/largefile.bz2 \
sshftp://user@host.domain.edu//home/_username_/
[...]
transfer$



Transfer a file to CCR storage in 32 parallel encrypted streams from a remove Globus GridFTP Server


transfer$ source /usr/etc/ccr-globus-user-env-external.sh
transfer$ globus-url-copy -verbose-perf -parallel 32 \
 -tcp-buffer-size 16777216 -block-size 16777216 \

 -data-channel-private -data-cred auto \
sshftp://user@host.domain.edu//home/_username_/largefile.bz2 \
file:///gpfs/scratch/_username_/largefile.bz2
[...]
transfer$