NodeTypeMon < CmsTier3

Tags: view all tags

<!-- keep this as a security measure:
   #uncomment if the subject should only be modifiable by the listed groups 
   * Set ALLOWTOPICCHANGE = Main.TWikiAdminGroup,Main.CMSAdminGroup
   * Set ALLOWTOPICRENAME = Main.TWikiAdminGroup,Main.CMSAdminGroup
   #uncomment this if you want the page only be viewable by the listed groups
   # * Set ALLOWTOPICVIEW = Main.TWikiAdminGroup,Main.CMSAdminGroup
-->

---+!! Node Type: %CALC{"$SUBSTITUTE(%TOPIC%,NodeType,)"}%

---++!! Firewall requirements

| *local port* | *open to* | *reason* |
| 8649/udp | %T3NET% | ganglia collector |
| 8670/udp | %T3NET% | ganglia collector |
| 8671/udp | %T3NET% | ganglia collector |
| 80/tcp | * | ganglia web server |
<!-- Example line
 #| 22/tcp      | * |  Example entry for ssh |
-->

----------------

%TOC{title="Table of contents"}%

---+ Regular Maintenance work
<!--
 #List any regular activities which do not run automatically and need an administrator's action.
-->

---+ Emergency Measures
<!--
 #List any measures that must be taken in case of some major incident, e.g. whether a mailing
 #list must be contacted or whether other services need to be shut down, etc. 
-->


---+ Installation
<!--
 #Comment here on any peculiarities of the installation, e.g. on special packages needed, special setup
 #procedures which are not obvious
-->
Fabio uses these aliases, Puppet recipes are in =puppetdirnodes=:
<pre>
alias kscustom57='cd /afs/psi.ch/software/linux/dist/scientific/57/custom'
alias kscustom64='cd /afs/psi.ch/software/linux/dist/scientific/64/custom'
alias ksdir='cd /afs/psi.ch/software/linux/kickstart/configs'
alias puppetdir='cd /afs/psi.ch/service/linux/puppet/var/puppet/environments/DerekDevelopment/'
alias puppetdirnodes='cd /afs/psi.ch/service/linux/puppet/var/puppet/environments/DerekDevelopment/manifests/'
alias puppetdirredhat='cd /afs/psi.ch/service/linux/puppet/var/puppet/environments/DerekDevelopment/modules/Tier3/files/RedHat'
alias puppetdirsolaris='cd /afs/psi.ch/service/linux/puppet/var/puppet/environments/DerekDevelopment/modules/Tier3/files/Solaris/5.10'
alias yumdir5='cd /afs/psi.ch/software/linux/dist/scientific/57/scripts'
alias yumdir6='cd /afs/psi.ch/software/linux/dist/scientific/6/scripts'
</pre>
   1 =SL5_mon.pp=
   1 =tier3-baseclasses.pp=
---+ Services
<!--
 #List all the important services, their installation, configuration and how to start and stop them
-->
---++ Ganglia
Installation details can be found [[GangliaInstallation][here]].

%INCLUDE{"ToDoItem" what="gmetad fails to start after reboot" who="DerekFeichtinger" priority="2"}%

Starting up =gmetad= can sometimes fail with this log entry:
<pre %FILESTYLE%>
May 11 10:49:56 t3ce01 /usr/sbin/gmetad[5651]: Please make sure that /var/lib/ganglia/rrds is owned by nobody
</pre>

I am not yet sure what causes =/var/lib/ganglia/rrds= to be owned by root after reboots.

---++ Additional monitoring

Look on AdditionalMonitoring page

---+ Backups
OS snapshots are nightly taken by PSI VMWare Team ( like Peter Huesser ) + we have LinuxBackupsByLegato to recover a single file.

NodeTypeForm
Hostnames	t3mon01, DNS alias t3mon = t3mon01
Services	ganglia collector, ganglia web front end
Hardware	PSI DMZ VMWare cluster
Install Profile	mon
Guarantee/maintenance until	VM

Topic revision: r13 - 2015-06-10 - FabioMartinelli

CmsTier3

User Pages
Main Page
Policies

Physics Groups
Steering Board Meetings

Admin Pages
AdminArea
Cluster Specs