Procedure to recreate the scratch filesystem
There are two steps to recreate the scratch filesystem.
- Recreate the filesystem structure: Make sure that the following directories exist in the scratch filesystem:
# Create Nordugrid skeleton. After this, you need to restart ARC services.
cd /gpfs2
mkdir -p gridhome/nordugrid-atlas-slurm
mkdir -p gridhome/wlcg
mkdir -p scratch/tmpdir_slurm
chmod 1777 scratch/tmpdir_slurm
mkdir -p scratch/tmpdir_slurm/arc_cache
mkdir -p scratch/tmpdir_slurm/arc_sessiondir
mkdir -p scratch/tmpdir_slurm/{cream01.lcg.cscs.ch,cream02.lcg.cscs.ch,cream03.lcg.cscs.ch,cream04.lcg.cscs.ch}
chmod 1777 scratch/tmpdir_slurm/cream*
# chown nordugrid-atlas.atlas home/nordugrid-atlas -R
# chmod 1777 home/nordugrid-atlas/sessiondir
- Destroy user accounts and all data related to the old grid users existing in the system.
/opt/cscs/sbin/clean_grid_accounts.bash
- Run YAIM
- Set the sticky bit and correct permissions in tmpdir_slurm
chmod 1777 /gpfs2/scratch/tmpdir_slurm/
- Make it visible for our local scripts
echo OK > /gpfs/chk_mount
On all WNs, the following structure needs to exist:
-
/home/nordugrid-atlas --> /gpfs2/gridhome/nordugrid-atlas-slurm/
-
/home/nordugrid-atlas-slurm --> /gpfs2/gridhome/nordugrid-atlas-slurm/
-
/home/wlcg --> /gpfs2/gridhome/wlcg
-
/tmpdir_slurm --> /gpfs2/scratch/tmpdir_slurm
--
MiguelGila - 2011-10-21