Transfer Exercises
Preparations
- Log into your account at
ui-lcg.projects.cscs.ch
- Get these two command reference files: srm-gridftp-reference.txt and fts-reference.txt and take a look at them.
- Fetch and source the SEenv.sh file. It contains useful settings for working with our and FZK's SEs.
- Create some test files, e.g. by using the pseudo random numbers from
/dev/urandom
:
dd if=/dev/urandom of=mytestfile.dat count=100
WAN Transfers tools
GridFTP
- Try to list the contents of our dCache's
/pnfs/projects.cscs.ch/cms/local_tests/
directory
- Identify a smaller and a really big file (> 2GB).
- Copy the small file to your work area with
globus-url-copy
. Do it a second time and use the -dbg
flag
- Copy the large file using
globus-url-copy
. Try to monitor the transfer and analyze the connectivity schema by using
- dCache GUI
- strace:
strace -fe trace=network globus-url-copy -p 10 srcfile tgtfile
- netstat: on a second console do a
netstat -ap
and try to identify your connections, globus port range ports (usually 20000-25000) and the ephemeral ports (usually ports > 30000).
- our ganglia pages for se02-lcg and se03-lcg and ui-lcg
- Copy the large file back to the SE using
globus-url-copy
. Again, try to use the above tools to monitor the transfers.
- Erase the file with
glite-gridftp-rm
SRM
- Use
srmcp
to get the same files to your local area. Use the -debug
flag to get an idea of the monitoring possibilities.
- Use
srmcp
to write a file to the SE. Notice that it will create any missing directories
- Use
srmcp
to get a file from FZK to our SE. A list of FZK files is here:FZKfiles.lst. The SRM directory at FZK is srm://gridka-dCache.fzk.de:8443/srm/managerv1?SFN=/pnfs/gridka.de/cms/disk-only/phedex_monarctest/FZK-DISK2
- Erase the file on our SE using
srm-advisory-delete
FTS
- Place a
myproxy
certificate at the myproxy-fts.cern.ch myproxy server and certify that it exists.
- Try to get a delegated certificate from the server
- Copy one of the FZK files to our SE using the FTS service. Try to monitor the transfer using
glite-transfer-list
and glite-transfer-status
- Try to copy several files in one job from FZK to SE using a copyjob file. You may use the generateTransferList.sh script to produce a copyjob file.
LAN Transfers
dcap through dccp command
Refer to
DcacheTestDescriptions
dcap through ROOT
Refer to
DcacheTestDescriptions to find out how to access a file through the ROOT environment.
--
DerekFeichtinger - 10 Jun 2007