Tags:
create new tag
view all tags

CMS Tier-3 Upgrade Planning Page

NFS server and MW upgrades

Summary

introduce new NFS for shome. LDAPS based auth. UI and WN upgrade. dCache user areas writable only to user. ILOM upgrades for X4150


All user account management via LDAP

Major reconfiguration of the cluter's user and authentication management (see LdapNameServices).

ILOM upgrades for X4150 servers (some problems)

Refer to IlomUpgradeProblem for the details.

Host upgraded? Comments
t3ce01 DONE  
t3se01 DONE CLI missed all /SYS entries! see here
t3ui01 DONE unrelated DIMM problem
t3dcachedb01 DONE  
t3nfs01 DONE temp. boot problem
t3wn01 DONE temp. boot problem
t3wn02 DONE ILOM passwd corruption problem, temp. boot problem (4*)
t3wn03 DONE temp. boot problem
t3wn04 DONE  
t3wn05 DONE temp. boot problem (2*)
t3wn06 DONE  
t3wn07 DONE ILOM passwd corruption problem
t3wn08 DONE  

Configuration of t3fs06 as new NFS server for home directories

Creation of an initial zpool. Raidz2 can survive two disks failing at the same time. Additionally, two spare disks are configured to replace failing disks in the pool.

zpool create -f shome raidz2 c5t0d0 c5t4d0 c8t0d0 c8t4d0 c7t0d0 c7t4d0 c1t0d0 c1t4d0 c0t0d0
zpool add -f shome spare c0t3d0 c0t7d0

At the moment I will not configure per user quotas, because in ZFS this implies making an own sub zfs filesystem for each user in /shome. This would need managing of many mountpoints. Could be done with automount, but not first priority right now. Can be introduced later on.

The shome are of t3nfs01 was copied via rsync to the new server

Fileservers

Solaris patches

Patch updates for

  • 121119-15 SunOS 5.10_x86: Sun Update Connection System Client 1.0.10
  • 119255-59 SunOS 5.10_x86: Install and Patch Utilities Patch
  • 119255-67SunOS 5.10_x86: Install and Patch Utilities Patch
  • 140791-01 SunOS 5.10_x86: ldap patch
  • 138875-03 SunOS 5.10_x86: pam and ldap patch (needs reboot)

t3fs01
t3fs02
t3fs03
t3fs04
t3fs05
t3fs06 ok

There were some difficult problems involving wrong disk labels / partition types on t3fs06. This had occurred after the machine had been used for some Linux testing. The solution to the problems is described in CMSTier3Log6.

OS and MW updates

WN OS updates

Example from t3wn01:

yum update

...
...

Dependencies Resolved

=============================================================================
 Package                 Arch       Version          Repository        Size
=============================================================================
Installing:
 kernel                  x86_64     2.6.9-89.0.3.EL  sl46kernel         14 M
 kernel-devel            x86_64     2.6.9-89.0.3.EL  sl46kernel        4.0 M
 kernel-module-ipw3945-2.6.9-89.0.3.EL  x86_64     1.1.0-1.SL4      sl46kernel        640 k
 kernel-module-ipw3945-2.6.9-89.0.3.ELsmp  x86_64     1.1.0-1.SL4      sl46kernel        632 k
 kernel-smp              x86_64     2.6.9-89.0.3.EL  sl46kernel         13 M
 kernel-smp-devel        x86_64     2.6.9-89.0.3.EL  sl46kernel        4.0 M
 pam-krb5                i386       2:3.13-10.slp4   sl46psi            86 k
     replacing  pam_krb5.x86_64 2:3.5-8.slp4

 pam-krb5                x86_64     2:3.13-10.slp4   sl46psi            90 k
     replacing  pam_krb5.x86_64 2:3.5-8.slp4

 sos                     noarch     1.7-6.1          sl46base          101 k
     replacing  sysreport.noarch 1.3.15-8

Updating:
 acpid                   x86_64     1.0.3-2.el4_7.1  sl46update         21 k
 cups                    x86_64     1:1.1.22-0.rc1.9.32.el4_8.3  sl46update        1.5 M
 cups-libs               x86_64     1:1.1.22-0.rc1.9.32.el4_8.3  sl46update        117 k
 dhclient                x86_64     7:3.0.1-65.el4_8.1  sl46update        246 k
 freetype                i386       2.1.9-10.el4.7   sl46update        765 k
 freetype                x86_64     2.1.9-10.el4.7   sl46update        790 k
 freetype-devel          x86_64     2.1.9-10.el4.7   sl46update        570 k
 libtiff                 i386       3.6.1-12.el4_8.4  sl46update        255 k
 libtiff                 x86_64     3.6.1-12.el4_8.4  sl46update        277 k
 libtiff-devel           i386       3.6.1-12.el4_8.4  sl46update        802 k
 ntp                     x86_64     4.2.0.a.20040617-8.el4_7.2  sl46update        1.3 M
 openafs                 x86_64     2:1.4.11-101.slp4  sl46psi           3.4 M
 openafs-client          x86_64     2:1.4.11-101.slp4  sl46psi           261 k
 openafs-krb5            x86_64     2:1.4.11-101.slp4  sl46psi           234 k
 pango                   x86_64     1.6.0-14.4_7     sl46update        295 k
 pango-devel             x86_64     1.6.0-14.4_7     sl46update        174 k
 sl-release              noarch     4.6-2            sl46update        824 k
 tzdata                  noarch     2009i-2.el4      sl46update        464 k

Transaction Summary
=============================================================================
Install      9 Package(s)
Update      18 Package(s)
Remove       0 Package(s)
Total download size: 48 M

WN grid middleware updates

Needs a reinstallation of the tar-WN as described in NodeTypeOLDNFSServer.

User Interface OS and MW updates

yum update
...
...
Dependencies Resolved

=============================================================================
 Package                 Arch       Version          Repository        Size
=============================================================================
Installing:
 kernel                  x86_64     2.6.9-89.0.3.EL  sl46kernel         14 M
 kernel-devel            x86_64     2.6.9-89.0.3.EL  sl46kernel        4.0 M
 kernel-module-ipw3945-2.6.9-89.0.3.EL  x86_64     1.1.0-1.SL4      sl46kernel        640 k
 kernel-module-ipw3945-2.6.9-89.0.3.ELsmp  x86_64     1.1.0-1.SL4      sl46kernel        632 k
 kernel-module-openafs-2.6.9-89.0.3.EL  x86_64     2:1.4.11-101.slp4  sl46psi           280 k
 kernel-module-openafs-2.6.9-89.0.3.ELsmp  x86_64     2:1.4.11-101.slp4  sl46psi           275 k
 kernel-smp              x86_64     2.6.9-89.0.3.EL  sl46kernel         13 M
 kernel-smp-devel        x86_64     2.6.9-89.0.3.EL  sl46kernel        4.0 M
 perl-IO-Compress        noarch     2.020-2.el4.rf   dag               235 k
     replacing  perl-Compress-Zlib.x86_64 1.42-1.el4.rf

Updating:
 CGSI_gSOAP_2.7          i386       1.3.3-1.slc4     glite-UI           70 k
 DPM-client              i386       1.7.2-4sec.slc4  glite-UI          5.1 M
 DPM-interfaces          i386       1.7.2-4sec.slc4  glite-UI          655 k
 GFAL-client             i386       1.11.6-2.slc4    glite-UI          2.3 M
 LFC-client              i386       1.7.2-4sec.slc4  glite-UI          1.9 M
 LFC-interfaces          i386       1.7.2-4sec.slc4  glite-UI          705 k
 acpid                   x86_64     1.0.3-2.el4_7.1  sl46update         21 k
 bouncycastle            noarch     1.43-1.jpp5      jpackage5-generic  3.1 M
 cups                    x86_64     1:1.1.22-0.rc1.9.32.el4_8.3  sl46update        1.5 M
 cups-libs               x86_64     1:1.1.22-0.rc1.9.32.el4_8.3  sl46update        117 k
 dcache-srmclient        noarch     1.9.0-9          glite-UI          7.5 M
 dhclient                x86_64     7:3.0.1-65.el4_8.1  sl46update        246 k
 fetch-crl               noarch     2.7.0-1          glite-UI           20 k
 freetype                i386       2.1.9-10.el4.7   sl46update        765 k
 freetype                x86_64     2.1.9-10.el4.7   sl46update        790 k
 freetype-devel          x86_64     2.1.9-10.el4.7   sl46update        570 k
 glite-UI                i386       3.1.36-0         glite-UI          6.2 k
 glite-jdl-api-cpp       i386       3.1.16-3.slc4    glite-UI          2.6 M
 glite-security-voms-api  i386       1.8.12-1.slc4    glite-UI           12 k
 glite-security-voms-api-c  i386       1.8.12-1.slc4    glite-UI          4.0 M
 glite-security-voms-api-cpp  i386       1.8.12-1.slc4    glite-UI          4.0 M
 glite-security-voms-clients  i386       1.8.12-1.slc4    glite-UI          706 k
 glite-yaim-clients      noarch     4.0.8-7          glite-UI           22 k
 kernel-module-openafs-2.6.9-78.0.17.EL  x86_64     2:1.4.10-94.slp4  sl46psi           280 k
 kernel-module-openafs-2.6.9-78.0.17.ELsmp  x86_64     2:1.4.10-94.slp4  sl46psi           274 k
 lcg-dm-common           i386       1.7.2-4sec.slc4  glite-UI           76 k
 lcg-vomscerts           noarch     5.5.0-1          glite-UI           19 k
 lcg_util                i386       1.7.4-1.slc4     glite-UI          273 k
 libtiff                 i386       3.6.1-12.el4_8.4  sl46update        255 k
 libtiff                 x86_64     3.6.1-12.el4_8.4  sl46update        277 k
 libtiff-devel           i386       3.6.1-12.el4_8.4  sl46update        802 k
 ntp                     x86_64     4.2.0.a.20040617-8.el4_7.2  sl46update        1.3 M
 openafs                 x86_64     2:1.4.11-101.slp4  sl46psi           3.4 M
 openafs-client          x86_64     2:1.4.11-101.slp4  sl46psi           261 k
 openafs-krb5            x86_64     2:1.4.11-101.slp4  sl46psi           234 k
 pango                   x86_64     1.6.0-14.4_7     sl46update        295 k
 pango-devel             x86_64     1.6.0-14.4_7     sl46update        174 k
 perl-MIME-Lite          noarch     3.024-1.el4.rf   dag                95 k
 perl-XML-Encoding       noarch     2.07-1.el4.rf    dag                20 k
 perl-XML-NamespaceSupport  noarch     1.10-1.el4.rf    dag                16 k
 perl-XML-SAX            noarch     0.96-1.el4.rf    dag                78 k
 sl-release              noarch     4.6-2            sl46update        824 k
 tzdata                  noarch     2009i-2.el4      sl46update        464 k
Installing for dependencies:
 DPM-httpd-client        noarch     1.2.1-2sec.slc4  glite-UI          4.4 k
 DPM-interfaces2         i386       1.7.2-4sec.slc4  glite-UI          227 k
 LFC-interfaces2         i386       1.7.2-4sec.slc4  glite-UI          394 k
 perl-Compress-Raw-Bzip2  i386       2.020-1.el4.rf   dag               105 k
 perl-Compress-Raw-Zlib  i386       2.020-1.el4.rf   dag               163 k

Transaction Summary
=============================================================================
Install     14 Package(s)
Update      43 Package(s)
Remove       0 Package(s)
Total download size: 83 M
Is this ok [y/N]:

OS and MW updates for remaining Service nodes

Standard yum update on all nodes. Also tried a reboot.

t3se01:

...
 glite-SE_dcache_info    x86_64     3.1.14-0         glite SE_dcache_info  2.9 k
...

I think glite-SE_dcache_info is even no longer used for the new dcache info system... need to check later

t3dcachedb01

t3ce01

t3nfs01

No dCache reconfiguration of dedicated user areas?

No time....

Just made sure that dCache could be correctly restarted

No Build in missing RAM DIMM modules

UpgradePlanningForm
Title NFS server and MW upgrades
Summary introduce new NFS for shome. LDAPS based auth. UI and WN upgrade. dCache user areas writable only to user. ILOM upgrades for X4150
Target Date 30. 7. 2009
Edit | Attach | Watch | Print version | History: r21 < r20 < r19 < r18 < r17 | Backlinks | Raw View | Raw edit | More topic actions
Topic revision: r21 - 2016-11-04 - FabioMartinelli
 
This site is powered by the TWiki collaboration platform Powered by Perl This site is powered by the TWiki collaboration platformCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback