Tags:
tag this topic
create new tag
view all tags
<!-- keep this as a security measure: * Set ALLOWTOPICCHANGE = Main.TWikiAdminGroup,Main.LCGAdminGroup * Set ALLOWTOPICRENAME = Main.TWikiAdminGroup,Main.LCGAdminGroup #uncomment this if you want the page only be viewable by the internal people #* Set ALLOWTOPICVIEW = Main.TWikiAdminGroup,Main.LCGAdminGroup --> %TOC% ---+ Service Card for NFS * ha nfs setup: <br /> <img width="555" alt="hanfs.png" src="%ATTACHURLPATH%/hanfs.png" height="465" /> If something goes wrong on one, go to the other machine and type */usr/lib64/heartbeat/hb_takeover foreign* once you think everything is in good order again, go to the original server and take back the resources: */usr/lib64/heartbeat/hb_takeover local* <blockquote> <verbatim> May 30 14:59 [root@nfs02:~]# cat /etc/ha.d/haresources nfs01.lcg.cscs.ch IPaddr::148.187.67.100 \ drbddisk::srv_nfs \ Filesystem::/dev/drbd0::/srv/nfs::ext3 \ drbddisk::export \ Filesystem::/dev/drbd2::/export::ext3 \ drbddisk::home \ Filesystem::/dev/drbd3::/home::ext3 \ drbddisk::atlas \ Filesystem::/dev/drbd4::/experiment_software/atlas::ext3 \ drbddisk::cms \ Filesystem::/dev/drbd5::/experiment_software/cms::ext3 \ drbddisk::lhcb \ Filesystem::/dev/drbd6::/experiment_software/lhcb::ext3 \ drbddisk::other \ Filesystem::/dev/drbd7::/experiment_software/others::ext3 \ drbddisk::shared \ Filesystem::/dev/drbd8::/shared::ext3 nfslock nfs httpd nfs02.lcg.cscs.ch IPaddr::148.187.67.109 \ drbddisk::srv_cfengine \ Filesystem::/dev/drbd1::/srv/cfengine::ext3 cfservd </verbatim> </blockquote> <blockquote> <verbatim> May 30 15:00 [root@nfs02:~]# cat /etc/ha.d/ha.cf logfacility local0 debugfile /var/log/ha-debug logfile /var/log/ha-log keepalive 2 deadtime 30 initdead 120 udpport 694 # bcast eth0 bcast eth3 auto_failback off # Tell what machines are in the cluster # node nodename ... -- must match uname -n node nfs01.lcg.cscs.ch nfs02.lcg.cscs.ch crm no </verbatim> </blockquote> <blockquote> <verbatim> mdadm --create /dev/md0 -v --raid-devices=4 --chunk=32 --level=raid10 /dev/sdc /dev/sdd /dev/sde /dev/sdf pvcreate /dev/md0 vgcreate vgnfs /dev/md0 lvcreate --size 1G --name lv_srv_nfs vgnfs lvcreate --size 1G --name lv_srv_cfengine vgnfs lvcreate --size 5G --name lv_export vgnfs lvcreate --size 100G --name lv_home vgnfs lvcreate --size 500G --name lv_atlas vgnfs lvcreate --size 300G --name lv_cms vgnfs lvcreate --size 5G --name drbd_meta_disk vgnfs lvcreate --size 200G --name lv_lhcb vgnfs lvcreate --size 1G --name lv_other_vo vgnfs lvcreate --size 20G --name lv_shared vgnfs rpm -Uvh http://download.fedora.redhat.com/pub/epel/5/x86_64/epel-release-5-4.noarch.rpm yum --enablerepo=epel -y install heartbeat.x86_64 modprobe drbd chkconfig nfs off drbdadm create-md srv_nfs echo yes | drbdadm create-md srv_cfengine echo yes | drbdadm create-md export echo yes | drbdadm create-md home echo yes | drbdadm create-md atlas echo yes | drbdadm create-md cms echo yes | drbdadm create-md lhcb echo yes | drbdadm create-md other echo yes | drbdadm create-md shared #drbdadm up all #service drbd status mkdir /export mkdir -p /srv/cfengine mkdir -p /srv/nfs mkdir -p /experiment_software/{atlas,cms,lhcb,others} mkdir -p /shared </verbatim> </blockquote> ---+ NAS appliance Phoenix has access to part to an EMC NAS appliance installed at CSCS. Currently the quota available for all mount points is ~100TB and consists of 6 heads with several 10GbE links towards the cluster. The following filesystems are exported from this appliance: * =/ifs/LCG/backup= is intended to replace the old backup system on the shared fs of =/project= * =/ifs/LCG/cm= holds the RPM repositories and all the configuration management software required to make Phoenix run * =/ifs/LCG/experiment_software= is intended to be used as a central point where VOs will put their software. Currently only ATLAS requires minimal space here. * =/ifs/LCG/home= this is the home of all users that have access to Phoenix. * =/ifs/LCG/shared= Some important subdirectories are stored here (such as =apelaccounting=, =exp_soft_arc=, =slurm=, =gridmapdir=, etc.) * =/ifs/LCG/syslog= Where all logs are stored. * =/ifs/LCG/vm= This space holds the VMs that form the preproduction cluster. -- Main.JasonTemple - 2011-05-30
ServiceCardForm
Service name
nfs
Machines this service is installed in
nfs[01-02],nas
Is Grid service
No
Depends on the following services
Expert
Miguel Gila
CM
CfEngine
Provisioning
none
Attachments
Attachments
Topic attachments
I
Attachment
History
Action
Size
Date
Who
Comment
png
hanfs.png
r1
manage
36.5 K
2013-02-22 - 09:55
PabloFernandez
E
dit
|
A
ttach
|
Watch
|
P
rint version
|
H
istory
: r4
<
r3
<
r2
<
r1
|
B
acklinks
|
V
iew topic
|
Ra
w
edit
|
M
ore topic actions
Topic revision: r4 - 2014-11-25
-
MiguelGila
LCGTier2
Log In
(Topic)
LCGTier2 Web
Create New Topic
Index
Search
Changes
Notifications
Statistics
Preferences
Users
Entry point / Contact
RoadMap
ATLAS Pages
CMS Pages
CMS User Howto
CHIPP CB
Outreach
Technical
Cluster details
Services
Hardware and OS
Tools & Tips
Monitoring
Logs
Maintenances
Meetings
Tests
Issues
Blog
Home
Site map
CmsTier3 web
LCGTier2 web
PhaseC web
Main web
Sandbox web
TWiki web
LCGTier2 Web
Users
Groups
Index
Search
Changes
Notifications
RSS Feed
Statistics
Preferences
P
P
View
Raw View
Print version
Find backlinks
History
More topic actions
Edit
Raw edit
Attach file or image
Edit topic preference settings
Set new parent
More topic actions
Warning: Can't find topic "".""
Account
Log In
E
dit
A
ttach
Copyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki?
Send feedback