Tags:
view all tags
<!-- keep this as a security measure: #uncomment if the subject should only be modifiable by the listed groups * Set ALLOWTOPICCHANGE = Main.TWikiAdminGroup,Main.CMSAdminGroup * Set ALLOWTOPICRENAME = Main.TWikiAdminGroup,Main.CMSAdminGroup #uncomment this if you want the page only be viewable by the listed groups # * Set ALLOWTOPICVIEW = Main.TWikiAdminGroup,Main.CMSAdminGroup --> %TOC% %ICON{arrowleft}% Go to [[CMSTier3Log37][previous page]] / [[CMSTier3Log39][next page]] of Tier3 site log %M% ---+ 03. 01. 2013 dCache file deletion ---++ File Deletion Test ---+++ with old file (i.e. short PNFSID) <pre> 0002000000000000069DE5B0 => /pnfs/psi.ch/cms/trivcat/store/user/dmeister/tmp/testfile.root </pre> In the Chimera database <pre> chimera=> SELECT * FROM t_locationinfo WHERE ipnfsid = '0002000000000000069DE5B0'; ipnfsid | itype | ilocation | ipriority | ictime | iatime | istate --------------------------+-------+--------------+-----------+-------------------------------+-------------------------------+-------- 0002000000000000069DE5B0 | 1 | t3fs14_cms_3 | 10 | 2012-11-30 08:55:27.410752+01 | 2012-11-30 08:55:27.410752+01 | 1 (1 row) </pre> And on disk <pre> [root@t3fs14 data]# ls -lah /mnt/data3/t3fs14_cms/pool/data/0002000000000000069DE5B0 -rw-r--r-- 1 root root 302M Nov 30 12:11 /mnt/data3/t3fs14_cms/pool/data/0002000000000000069DE5B0 </pre> User interaction with the file <pre> lcg-ls -l 'srm://t3se01.psi.ch:8443/srm/managerv2?SFN=/pnfs/psi.ch/cms/trivcat/store/user/dmeister/tmp/testfile.root' -rw-r--r-- 1 2 2 315977413 ONLINE /pnfs/psi.ch/cms/trivcat/store/user/dmeister/tmp/testfile.root * Checksum: d8fe3550 (adler32) * Space tokens: 5438474 lcg-del -l 'srm://t3se01.psi.ch:8443/srm/managerv2?SFN=/pnfs/psi.ch/cms/trivcat/store/user/dmeister/tmp/testfile.root' lcg-ls -l 'srm://t3se01.psi.ch:8443/srm/managerv2?SFN=/pnfs/psi.ch/cms/trivcat/store/user/dmeister/tmp/testfile.root' /pnfs/psi.ch/cms/trivcat/store/user/dmeister/tmp/testfile.root: [SE][Ls][SRM_INVALID_PATH] could not get storage info by path: No such file or directory ///pnfs/psi.ch/cms/trivcat/store/user/dmeister/tmp/testfile.root </pre> New database query <pre> chimera=> SELECT * FROM t_locationinfo WHERE ipnfsid = '0002000000000000069DE5B0'; ipnfsid | itype | ilocation | ipriority | ictime | iatime | istate ---------+-------+-----------+-----------+--------+--------+-------- (0 rows) </pre> But on the file server <pre> [root@t3fs14 data]# ls -lah /mnt/data3/t3fs14_cms/pool/data/0002000000000000069DE5B0 -rw-r--r-- 1 root root 302M Nov 30 12:11 /mnt/data3/t3fs14_cms/pool/data/0002000000000000069DE5B0 </pre> ---+++ with new file (i.e. long PNFSID) <pre> 0000EE8D339201A34DBD9E1A8DDD45FE1BD0 => /pnfs/psi.ch/cms/trivcat/store/user/dmeister/tmp/testfile3.root </pre> the same steps as above <pre> chimera=> SELECT * FROM t_locationinfo WHERE ipnfsid = '0000EE8D339201A34DBD9E1A8DDD45FE1BD0'; ipnfsid | itype | ilocation | ipriority | ictime | iatime | istate --------------------------------------+-------+--------------+-----------+----------------------------+----------------------------+-------- 0000EE8D339201A34DBD9E1A8DDD45FE1BD0 | 1 | t3fs11_cms_1 | 10 | 2012-11-30 12:12:45.008+01 | 2012-11-30 12:12:45.008+01 | 1 (1 row) </pre> on =t3fs11= <pre> # ls -lah /data1/t3fs11_cms_1/data/0000EE8D339201A34DBD9E1A8DDD45FE1BD0 -rw-r--r-- 1 root root 301M Nov 30 12:12 /data1/t3fs11_cms_1/data/0000EE8D339201A34DBD9E1A8DDD45FE1BD0 </pre> <pre> lcg-ls -l 'srm://t3se01.psi.ch:8443/srm/managerv2?SFN=/pnfs/psi.ch/cms/trivcat/store/user/dmeister/tmp/testfile3.root' -rw-r--r-- 1 2 2 315977413 ONLINE /pnfs/psi.ch/cms/trivcat/store/user/dmeister/tmp/testfile3.root * Checksum: d8fe3550 (adler32) * Space tokens: 5980084 lcg-del -l 'srm://t3se01.psi.ch:8443/srm/managerv2?SFN=/pnfs/psi.ch/cms/trivcat/store/user/dmeister/tmp/testfile3.root' lcg-ls -l 'srm://t3se01.psi.ch:8443/srm/managerv2?SFN=/pnfs/psi.ch/cms/trivcat/store/user/dmeister/tmp/testfile3.root' /pnfs/psi.ch/cms/trivcat/store/user/dmeister/tmp/testfile3.root: [SE][Ls][SRM_INVALID_PATH] could not get storage info by path: No such file or directory ///pnfs/psi.ch/cms/trivcat/store/user/dmeister/tmp/testfile3.root </pre> <pre> chimera=> SELECT * FROM t_locationinfo WHERE ipnfsid = '0000EE8D339201A34DBD9E1A8DDD45FE1BD0'; ipnfsid | itype | ilocation | ipriority | ictime | iatime | istate ---------+-------+-----------+-----------+--------+--------+-------- (0 rows) </pre> <pre> # ls -lah /data1/t3fs11_cms_1/data/0000EE8D339201A34DBD9E1A8DDD45FE1BD0 -rw-r--r-- 1 root root 301M Nov 30 12:12 /data1/t3fs11_cms_1/data/0000EE8D339201A34DBD9E1A8DDD45FE1BD0 </pre> ---++ Conclusion The files are 'deleted' correctly from the database but the actual file on the file server is not removed. To clean this up we can run =pnfs register= on the corresponding storage pool <pre> [t3dcachedb04.psi.ch] (local) admin > cd t3fs14_cms_3 [t3dcachedb04.psi.ch] (t3fs14_cms_3) admin > pnfs register </pre> which has the desired effect <pre> [root@t3fs14 data]# ls -lah /mnt/data3/t3fs14_cms/pool/data/0002000000000000069DE5B0 ls: cannot access /mnt/data3/t3fs14_cms/pool/data/0002000000000000069DE5B0: No such file or directory </pre> The dCache logfiles do not show anything useful... -- Main.DanielMeister - 2013-01-03 ---------------- %ICON{arrowleft}% Go to [[CMSTier3Log37][previous page]] / [[CMSTier3Log39][next page]] of Tier3 site log %M%
Edit
|
Attach
|
Watch
|
P
rint version
|
H
istory
:
r2
<
r1
|
B
acklinks
|
V
iew topic
|
Raw edit
|
More topic actions...
Topic revision: r1 - 2013-01-03
-
DanielMeister
CmsTier3
Log In
CmsTier3 Web
Create New Topic
Index
Search
Changes
Notifications
Statistics
Preferences
User Pages
Main Page
Policies
Monitoring Storage Space
Monitoring Slurm Usage
Physics Groups
Steering Board Meetings
Admin Pages
AdminArea
Cluster Specs
Home
Site map
CmsTier3 web
LCGTier2 web
PhaseC web
Main web
Sandbox web
TWiki web
CmsTier3 Web
Create New Topic
Index
Search
Changes
Notifications
RSS Feed
Statistics
Preferences
P
View
Raw View
Print version
Find backlinks
History
More topic actions
Edit
Raw edit
Attach file or image
Edit topic preference settings
Set new parent
More topic actions
Account
Log In
Edit
Attach
Copyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki?
Send feedback