Transfer Exercises

Preparations

1. Log into your account at ui.lcg.cscs.ch
2. Get these two command reference files: srm-gridftp-reference.txt and fts-reference.txt and take a look at them.
3. Fetch and source the SEenv.sh file. It contains useful settings for working with our and FZK's SEs.
4. Create some test files, e.g. by using the pseudo random numbers from /dev/urandom:

   dd if=/dev/urandom of=mytestfile.dat count=100
   

WAN Transfers tools

GridFTP

1. Try to list the contents of our dCache's /pnfs/lcg.cscs.ch/cms/local_tests/ directory
2. Identify a smaller and a really big file (> 2GB).
3. Copy the small file to your work area with globus-url-copy. Do it a second time and use the -dbg flag
4. Copy the large file using globus-url-copy. Try to monitor the transfer and analyze the connectivity schema by using
   • dCache GUI
   • strace: strace -fe trace=network globus-url-copy -p 10 srcfile tgtfile
   • netstat: on a second console do a netstat -ap and try to identify your connections, globus port range ports (usually 20000-25000) and the ephemeral ports (usually ports > 30000).
   • our ganglia pages for se02-lcg and se03-lcg and ui-lcg
5. Copy the large file back to the SE using globus-url-copy. Again, try to use the above tools to monitor the transfers.
6. Erase the file with glite-gridftp-rm

SRM

1. Use srmcp to get the same files to your local area. Use the -debug flag to get an idea of the monitoring possibilities.
2. Use srmcp to write a file to the SE. Notice that it will create any missing directories
3. Use srmcp to get a file from FZK to our SE. A list of FZK files is here:FZKfiles.lst. The SRM directory at FZK is srm://gridka-dCache.fzk.de:8443/srm/managerv1?SFN=/pnfs/gridka.de/cms/disk-only/phedex_monarctest/FZK-DISK2
4. Erase the file on our SE using srm-advisory-delete

FTS

1. Place a myproxy certificate at the myproxy-fts.cern.ch myproxy server and certify that it exists.
2. Try to get a delegated certificate from the server
3. Copy one of the FZK files to our SE using the FTS service. Try to monitor the transfer using glite-transfer-list and glite-transfer-status
4. Try to copy several files in one job from FZK to SE using a copyjob file. You may use the generateTransferList.sh script to produce a copyjob file.

LAN Transfers

dcap through dccp command

dcap through ROOT

-- DerekFeichtinger - 10 Jun 2007