UpgradePlanning200905141314 < CmsTier3

Tags: view all tags
<!-- keep this as a security measure:
   #uncomment if the subject should only be modifiable by the listed groups 
   * Set ALLOWTOPICCHANGE = Main.TWikiAdminGroup,Main.CMSAdminGroup
   * Set ALLOWTOPICRENAME = Main.TWikiAdminGroup,Main.CMSAdminGroup
   #uncomment this if you want the page only be viewable by the listed groups
   # * Set ALLOWTOPICVIEW = Main.TWikiAdminGroup,Main.CMSAdminGroup
-->

*CMS Tier-3 Upgrade Planning Page*

<!--
  # Use the attached form to define title and summary of this news item. The details you can fill in directly on this wiki page.
-->

---+!! %FORMFIELD{"Title"}%


---++!! Summary
%FORMFIELD{"Summary"}%

-----------------

%TOC%

---++ All user account management via LDAP

Major reconfiguration of the cluter's user and authentication management (see LdapNameServices).

---++ ILOM upgrades for X4150 servers (some problems)

Refer to IlomUpgradeProblem for the details.

|*Host*|*upgraded?*|*Comments*|
|t3ce01| %Y% | |
|t3se01| %Y% | CLI missed all  /SYS entries! [[IlomUpgradeProblem#t3se01_CLI_misses_all_SYS_entrie][see here]] |
|t3ui01| %Y% | unrelated DIMM problem|
|t3dcachedb01| %Y% | |
|t3nfs01| %Y% | temp. boot problem |
|t3wn01| %Y% | temp. boot problem |
|t3wn02| %Y% | [[CmsTier3/IlomUpgradeProblem#ILOM_CLI_passwd_DB_corrupted_on][ILOM passwd corruption problem]], temp. boot problem (4*) |
|t3wn03| %Y% | temp. boot problem |
|t3wn04| %Y% | |
|t3wn05| %Y% | temp. boot problem (2*) |
|t3wn06| %Y% | |
|t3wn07| %Y% | [[CmsTier3/IlomUpgradeProblem#ILOM_CLI_passwd_DB_corrupted_on][ILOM passwd corruption problem]] |
|t3wn08| %Y% | |

---+++ Configuration of t3fs06 as new NFS server for home directories

Creation of an initial zpool. Raidz2 can survive two disks failing at the same time. Additionally, two spare disks are configured to replace failing disks in the pool.

<pre>
zpool create -f shome raidz2 c5t0d0 c5t4d0 c8t0d0 c8t4d0 c7t0d0 c7t4d0 c1t0d0 c1t4d0 c0t0d0
zpool add -f shome spare c0t3d0 c0t7d0
</pre>

At the moment I will not configure per user quotas, because in ZFS this implies making an own sub zfs filesystem for each user in /shome. This would need managing of many mountpoints. Could be done with automount, but not first priority right now. Can be introduced later on.

The shome are of t3nfs01 was copied via rsync to the new server


---++ Fileservers

---+++ Solaris patches

Patch updates for
   * 121119-15 SunOS 5.10_x86: Sun Update Connection System Client 1.0.10
   * 119255-59 SunOS 5.10_x86: Install and Patch Utilities Patch
   * 119255-67SunOS 5.10_x86: Install and Patch Utilities Patch
   * 140791-01 SunOS 5.10_x86: ldap patch
   * 138875-03 SunOS 5.10_x86: pam and ldap patch  (needs reboot)

| t3fs01 ||
| t3fs02 ||
| t3fs03 ||
| t3fs04 ||
| t3fs05 ||
| t3fs06 | ok |

There were some difficult problems involving wrong disk labels / partition types on t3fs06. This had occurred after the machine had been used for some Linux testing. The solution to the problems is described in CMSTier3Log6.

---++ OS and MW updates

---+++ WN OS updates
Example from t3wn01:


<verbatim>
yum update

...
...

Dependencies Resolved

=============================================================================
 Package                 Arch       Version          Repository        Size
=============================================================================
Installing:
 kernel                  x86_64     2.6.9-89.0.3.EL  sl46kernel         14 M
 kernel-devel            x86_64     2.6.9-89.0.3.EL  sl46kernel        4.0 M
 kernel-module-ipw3945-2.6.9-89.0.3.EL  x86_64     1.1.0-1.SL4      sl46kernel        640 k
 kernel-module-ipw3945-2.6.9-89.0.3.ELsmp  x86_64     1.1.0-1.SL4      sl46kernel        632 k
 kernel-smp              x86_64     2.6.9-89.0.3.EL  sl46kernel         13 M
 kernel-smp-devel        x86_64     2.6.9-89.0.3.EL  sl46kernel        4.0 M
 pam-krb5                i386       2:3.13-10.slp4   sl46psi            86 k
     replacing  pam_krb5.x86_64 2:3.5-8.slp4

 pam-krb5                x86_64     2:3.13-10.slp4   sl46psi            90 k
     replacing  pam_krb5.x86_64 2:3.5-8.slp4

 sos                     noarch     1.7-6.1          sl46base          101 k
     replacing  sysreport.noarch 1.3.15-8

Updating:
 acpid                   x86_64     1.0.3-2.el4_7.1  sl46update         21 k
 cups                    x86_64     1:1.1.22-0.rc1.9.32.el4_8.3  sl46update        1.5 M
 cups-libs               x86_64     1:1.1.22-0.rc1.9.32.el4_8.3  sl46update        117 k
 dhclient                x86_64     7:3.0.1-65.el4_8.1  sl46update        246 k
 freetype                i386       2.1.9-10.el4.7   sl46update        765 k
 freetype                x86_64     2.1.9-10.el4.7   sl46update        790 k
 freetype-devel          x86_64     2.1.9-10.el4.7   sl46update        570 k
 libtiff                 i386       3.6.1-12.el4_8.4  sl46update        255 k
 libtiff                 x86_64     3.6.1-12.el4_8.4  sl46update        277 k
 libtiff-devel           i386       3.6.1-12.el4_8.4  sl46update        802 k
 ntp                     x86_64     4.2.0.a.20040617-8.el4_7.2  sl46update        1.3 M
 openafs                 x86_64     2:1.4.11-101.slp4  sl46psi           3.4 M
 openafs-client          x86_64     2:1.4.11-101.slp4  sl46psi           261 k
 openafs-krb5            x86_64     2:1.4.11-101.slp4  sl46psi           234 k
 pango                   x86_64     1.6.0-14.4_7     sl46update        295 k
 pango-devel             x86_64     1.6.0-14.4_7     sl46update        174 k
 sl-release              noarch     4.6-2            sl46update        824 k
 tzdata                  noarch     2009i-2.el4      sl46update        464 k

Transaction Summary
=============================================================================
Install      9 Package(s)
Update      18 Package(s)
Remove       0 Package(s)
Total download size: 48 M
</verbatim>


---+++ WN grid middleware  updates

Needs a reinstallation of the tar-WN as described in NodeTypeOLDNFSServer.

---+++ User Interface OS and MW updates

<verbatim>
yum update
...
...
Dependencies Resolved

=============================================================================
 Package                 Arch       Version          Repository        Size
=============================================================================
Installing:
 kernel                  x86_64     2.6.9-89.0.3.EL  sl46kernel         14 M
 kernel-devel            x86_64     2.6.9-89.0.3.EL  sl46kernel        4.0 M
 kernel-module-ipw3945-2.6.9-89.0.3.EL  x86_64     1.1.0-1.SL4      sl46kernel        640 k
 kernel-module-ipw3945-2.6.9-89.0.3.ELsmp  x86_64     1.1.0-1.SL4      sl46kernel        632 k
 kernel-module-openafs-2.6.9-89.0.3.EL  x86_64     2:1.4.11-101.slp4  sl46psi           280 k
 kernel-module-openafs-2.6.9-89.0.3.ELsmp  x86_64     2:1.4.11-101.slp4  sl46psi           275 k
 kernel-smp              x86_64     2.6.9-89.0.3.EL  sl46kernel         13 M
 kernel-smp-devel        x86_64     2.6.9-89.0.3.EL  sl46kernel        4.0 M
 perl-IO-Compress        noarch     2.020-2.el4.rf   dag               235 k
     replacing  perl-Compress-Zlib.x86_64 1.42-1.el4.rf

Updating:
 CGSI_gSOAP_2.7          i386       1.3.3-1.slc4     glite-UI           70 k
 DPM-client              i386       1.7.2-4sec.slc4  glite-UI          5.1 M
 DPM-interfaces          i386       1.7.2-4sec.slc4  glite-UI          655 k
 GFAL-client             i386       1.11.6-2.slc4    glite-UI          2.3 M
 LFC-client              i386       1.7.2-4sec.slc4  glite-UI          1.9 M
 LFC-interfaces          i386       1.7.2-4sec.slc4  glite-UI          705 k
 acpid                   x86_64     1.0.3-2.el4_7.1  sl46update         21 k
 bouncycastle            noarch     1.43-1.jpp5      jpackage5-generic  3.1 M
 cups                    x86_64     1:1.1.22-0.rc1.9.32.el4_8.3  sl46update        1.5 M
 cups-libs               x86_64     1:1.1.22-0.rc1.9.32.el4_8.3  sl46update        117 k
 dcache-srmclient        noarch     1.9.0-9          glite-UI          7.5 M
 dhclient                x86_64     7:3.0.1-65.el4_8.1  sl46update        246 k
 fetch-crl               noarch     2.7.0-1          glite-UI           20 k
 freetype                i386       2.1.9-10.el4.7   sl46update        765 k
 freetype                x86_64     2.1.9-10.el4.7   sl46update        790 k
 freetype-devel          x86_64     2.1.9-10.el4.7   sl46update        570 k
 glite-UI                i386       3.1.36-0         glite-UI          6.2 k
 glite-jdl-api-cpp       i386       3.1.16-3.slc4    glite-UI          2.6 M
 glite-security-voms-api  i386       1.8.12-1.slc4    glite-UI           12 k
 glite-security-voms-api-c  i386       1.8.12-1.slc4    glite-UI          4.0 M
 glite-security-voms-api-cpp  i386       1.8.12-1.slc4    glite-UI          4.0 M
 glite-security-voms-clients  i386       1.8.12-1.slc4    glite-UI          706 k
 glite-yaim-clients      noarch     4.0.8-7          glite-UI           22 k
 kernel-module-openafs-2.6.9-78.0.17.EL  x86_64     2:1.4.10-94.slp4  sl46psi           280 k
 kernel-module-openafs-2.6.9-78.0.17.ELsmp  x86_64     2:1.4.10-94.slp4  sl46psi           274 k
 lcg-dm-common           i386       1.7.2-4sec.slc4  glite-UI           76 k
 lcg-vomscerts           noarch     5.5.0-1          glite-UI           19 k
 lcg_util                i386       1.7.4-1.slc4     glite-UI          273 k
 libtiff                 i386       3.6.1-12.el4_8.4  sl46update        255 k
 libtiff                 x86_64     3.6.1-12.el4_8.4  sl46update        277 k
 libtiff-devel           i386       3.6.1-12.el4_8.4  sl46update        802 k
 ntp                     x86_64     4.2.0.a.20040617-8.el4_7.2  sl46update        1.3 M
 openafs                 x86_64     2:1.4.11-101.slp4  sl46psi           3.4 M
 openafs-client          x86_64     2:1.4.11-101.slp4  sl46psi           261 k
 openafs-krb5            x86_64     2:1.4.11-101.slp4  sl46psi           234 k
 pango                   x86_64     1.6.0-14.4_7     sl46update        295 k
 pango-devel             x86_64     1.6.0-14.4_7     sl46update        174 k
 perl-MIME-Lite          noarch     3.024-1.el4.rf   dag                95 k
 perl-XML-Encoding       noarch     2.07-1.el4.rf    dag                20 k
 perl-XML-NamespaceSupport  noarch     1.10-1.el4.rf    dag                16 k
 perl-XML-SAX            noarch     0.96-1.el4.rf    dag                78 k
 sl-release              noarch     4.6-2            sl46update        824 k
 tzdata                  noarch     2009i-2.el4      sl46update        464 k
Installing for dependencies:
 DPM-httpd-client        noarch     1.2.1-2sec.slc4  glite-UI          4.4 k
 DPM-interfaces2         i386       1.7.2-4sec.slc4  glite-UI          227 k
 LFC-interfaces2         i386       1.7.2-4sec.slc4  glite-UI          394 k
 perl-Compress-Raw-Bzip2  i386       2.020-1.el4.rf   dag               105 k
 perl-Compress-Raw-Zlib  i386       2.020-1.el4.rf   dag               163 k

Transaction Summary
=============================================================================
Install     14 Package(s)
Update      43 Package(s)
Remove       0 Package(s)
Total download size: 83 M
Is this ok [y/N]:
</verbatim>

---+++ OS and MW updates for remaining Service nodes

Standard =yum update= on all nodes.  Also tried a reboot.

*t3se01:*

<pre>
...
 glite-SE_dcache_info    x86_64     3.1.14-0         glite SE_dcache_info  2.9 k
...
</pre>

I think glite-SE_dcache_info is even no longer used for the new dcache info system... need to check later


*t3dcachedb01*

*t3ce01*

*t3nfs01*


---++ %ICON{"choice-no"}% dCache reconfiguration of dedicated user areas?

No time....

Just made sure that dCache could be correctly restarted

---++ %ICON{"choice-no"}% Build in missing RAM DIMM modules
UpgradePlanningForm
Title	NFS server and MW upgrades
Summary	introduce new NFS for shome. LDAPS based auth. UI and WN upgrade. dCache user areas writable only to user. ILOM upgrades for X4150
Target Date	30. 7. 2009
Topic revision: r21 - 2016-11-04 - FabioMartinelli
CmsTier3
User Pages
Main Page
Policies
Physics Groups
Steering Board Meetings
Admin Pages
AdminArea
Cluster Specs