mysql> select username, RAM_RANGE, count(*) as JOBs from ( SELECT username, CASE WHEN maxvmem > 0 and maxvmem <= 1000000000 THEN '0GB-1GB' WHEN maxvmem > 1000000000 and maxvmem <= 2000000000 THEN '1GB-2GB' WHEN maxvmem > 2000000000 and maxvmem <= 3000000000 THEN '2GB-3GB' ELSE '>3GB' END as RAM_RANGE from view_accounting where exit_status=0 and submission_time > (current_timestamp - interval 6 month) ) as job_summaries GROUP BY username,RAM_RANGE ;
/pnfs
HW contributing to the total /pnfs
capacity and their warranties
- Usage (
/pnfs
) = ~340TB
- Capacity (
/pnfs
) = ~200TB + ~270TB + ~270TB ; the ~340TB are hosted on ~270TB + ~270TB and partially replicated on ~200TB to speedup the reads
- The unreliable ~200TB are still available as a read-only cache just because of a lucky coincidence, we could recycle both >100 1TB disks and several file servers from CSCS
- 2 HP files servers are connected to both ~270TB and ~270TB and they're running out of warranty on 2018-06-30
- ~270TB are running out of warranty on 2017-01-31 ; warranty can be prolonged till 2018-06-30 for ~15k CHF ( price to be confirmed ) ; Fabio highly recommends this purchase .
- ~270TB are running out of warranty on 2018-07-30
- ~270TB + ~270TB Bandwidth as it's cabled now : 10Gbit/s + 10Gbit/s ~= 2.5GB/s
- ~270TB + ~270TB Bandwidth if re-cabled to its best : 2 * 10Gbit/s + 2 * 10Gbit/s ~= 5GB/s ; we still didn't make this re-cabling because of the Bandwidth provided by ~200TB, that's ~2GB/s
Usage ( /pnfs
) = ~340TB
~340TB by access time in %
More... Close
period |
% |
2010 |
0.08 |
2011 |
1.17 |
2012 |
2.37 |
2013 |
22.04 |
2014 |
40.40 |
2015 |
33.86 |
~340TB by access time and T3 groups - stacked histogram
More... Close
~340TB by access time and T3 groups - table
More... Close
period |
PhEDEx |
ethz_bphys |
ethz_ecal |
ethz_ewk |
ethz_higgs |
ethz_susy |
psi_bphys |
psi_pixel |
uniz_bphys |
uniz_higgs |
uniz_pixel |
without_a_T3_group |
2010-04 |
1 |
|
|
|
|
|
|
|
|
|
|
|
2010-05 |
80 |
|
|
|
|
|
|
|
|
|
|
|
2010-06 |
|
|
|
|
|
|
46 |
|
|
|
|
|
2010-07 |
|
|
|
|
|
|
|
|
|
|
|
|
2010-08 |
|
9 |
|
|
|
|
25 |
|
|
|
|
|
2010-09 |
|
|
|
|
|
|
|
|
|
|
|
|
2010-10 |
|
|
|
|
|
|
5 |
|
|
|
|
21 |
2010-11 |
|
|
|
|
|
|
|
|
|
|
|
25 |
2010-12 |
|
|
|
|
|
|
|
|
|
|
|
57 |
2011-01 |
|
|
|
|
|
|
5 |
|
|
|
|
20 |
2011-02 |
21 |
|
|
|
|
|
|
|
|
|
|
162 |
2011-03 |
|
|
|
|
|
|
|
|
|
|
|
19 |
2011-04 |
|
|
|
|
|
|
|
|
|
|
|
6 |
2011-05 |
|
|
|
|
64 |
|
|
|
|
|
|
38 |
2011-06 |
39 |
74 |
|
|
|
|
13 |
|
|
|
|
|
2011-07 |
|
177 |
|
|
|
|
56 |
|
|
|
|
|
2011-08 |
|
|
|
|
|
|
|
|
|
|
|
|
2011-09 |
406 |
|
|
|
2 |
|
|
|
|
|
|
|
2011-10 |
|
|
|
|
10 |
|
1638 |
|
|
|
|
|
2011-11 |
104 |
|
|
|
|
|
1065 |
|
|
|
|
|
2011-12 |
|
|
|
|
|
|
84 |
|
|
|
|
|
2012-01 |
|
|
|
|
|
13 |
18 |
2 |
|
|
|
|
2012-02 |
|
43 |
|
|
|
3 |
176 |
|
|
|
|
|
2012-03 |
|
|
|
|
|
47 |
1873 |
118 |
|
|
|
|
2012-04 |
|
|
|
|
|
8 |
1086 |
|
|
|
|
|
2012-05 |
|
|
|
|
|
53 |
5 |
|
|
|
|
|
2012-06 |
376 |
|
114 |
|
26 |
17 |
|
|
|
|
|
|
2012-07 |
|
|
197 |
|
|
5 |
9 |
|
|
|
|
|
2012-08 |
|
|
156 |
|
|
18 |
|
|
|
|
|
|
2012-09 |
15 |
|
6 |
1 |
|
59 |
700 |
|
|
|
|
|
2012-10 |
|
|
44 |
146 |
|
59 |
79 |
|
|
|
|
|
2012-11 |
1551 |
|
269 |
45 |
72 |
142 |
52 |
|
|
|
|
|
2012-12 |
|
|
50 |
|
|
412 |
32 |
|
|
|
|
|
2013-01 |
|
|
26 |
1 |
9 |
426 |
92 |
|
|
|
|
|
2013-02 |
1333 |
|
34 |
|
178 |
3143 |
8953 |
|
|
|
|
|
2013-03 |
938 |
|
|
|
225 |
3327 |
340 |
|
|
|
|
|
2013-04 |
4 |
|
|
|
13 |
1136 |
100 |
|
|
|
|
|
2013-05 |
|
|
|
50 |
32 |
2281 |
3951 |
|
|
|
|
|
2013-06 |
|
|
8 |
576 |
|
2026 |
868 |
|
|
3 |
|
|
2013-07 |
|
|
436 |
352 |
|
2165 |
201 |
|
|
|
|
|
2013-08 |
|
|
493 |
17 |
16 |
429 |
31 |
|
|
|
|
|
2013-09 |
149 |
|
132 |
886 |
12 |
2935 |
2366 |
2 |
|
|
|
36 |
2013-10 |
1198 |
62 |
423 |
477 |
109 |
5243 |
3724 |
92 |
|
|
3 |
165 |
2013-11 |
2679 |
350 |
1127 |
308 |
1452 |
8424 |
6895 |
6 |
|
|
|
172 |
2013-12 |
3 |
|
1588 |
3 |
|
36 |
5 |
|
|
|
|
|
2014-01 |
19 |
|
854 |
56 |
13 |
2837 |
|
|
|
5 |
|
|
2014-02 |
5 |
|
4853 |
62 |
304 |
172 |
|
|
|
19 |
6890 |
|
2014-03 |
|
|
2289 |
162 |
616 |
11314 |
|
|
|
3383 |
1606 |
|
2014-04 |
4 |
|
230 |
2 |
427 |
4111 |
33 |
|
|
6323 |
8754 |
|
2014-05 |
|
|
166 |
|
480 |
738 |
|
1 |
|
2058 |
981 |
|
2014-06 |
8 |
|
1308 |
10 |
205 |
3043 |
9 |
3 |
|
7514 |
4162 |
|
2014-07 |
30 |
|
2535 |
245 |
417 |
6493 |
|
|
|
1241 |
17 |
|
2014-08 |
360 |
|
16 |
171 |
65 |
226 |
62 |
|
|
14896 |
1547 |
|
2014-09 |
109 |
|
195 |
660 |
75 |
281 |
|
|
|
135 |
202 |
|
2014-10 |
597 |
|
5316 |
294 |
48 |
886 |
|
|
|
1694 |
183 |
|
2014-11 |
109 |
|
2358 |
4 |
109 |
237 |
17 |
|
|
16564 |
|
|
2014-12 |
23 |
|
1379 |
264 |
199 |
1254 |
|
|
|
494 |
|
|
2015-01 |
|
|
1017 |
87 |
136 |
1088 |
|
|
|
327 |
1744 |
|
2015-02 |
24 |
|
2762 |
|
1 |
1079 |
|
7 |
|
8294 |
173 |
|
2015-03 |
36 |
|
1540 |
|
88 |
2648 |
8263 |
|
|
5720 |
|
|
2015-04 |
808 |
|
|
|
|
1430 |
36 |
|
|
1481 |
|
|
2015-05 |
|
|
|
|
101 |
163 |
|
|
|
356 |
2 |
|
2015-06 |
|
|
|
|
2065 |
3135 |
13 |
2 |
|
598 |
|
|
2015-07 |
208 |
|
162 |
|
696 |
6163 |
30 |
2 |
|
594 |
|
|
2015-08 |
|
|
29 |
|
1306 |
6294 |
123 |
20 |
|
765 |
47 |
|
2015-09 |
643 |
|
35 |
|
343 |
4940 |
628 |
21 |
|
24109 |
2 |
|
2015-10 |
5747 |
|
246 |
|
2923 |
6440 |
5901 |
|
|
1855 |
172 |
|
TOTs in GB |
17627 |
715 |
32393 |
4879 |
12837 |
97379 |
49608 |
276 |
0 |
98428 |
26485 |
721 |
~340TB by creation time and T3 groups - stacked histogram
More... Close
~340TB by creation time and T3 groups - table
More... Close
period |
PhEDEx |
ethz_bphys |
ethz_ecal |
ethz_ewk |
ethz_higgs |
ethz_susy |
psi_bphys |
psi_pixel |
uniz_bphys |
uniz_higgs |
uniz_pixel |
without_a_T3_group |
2010-04 |
1 |
|
|
|
|
|
|
|
|
|
|
|
2010-05 |
101 |
|
|
|
|
|
|
|
|
|
|
|
2010-06 |
|
|
|
|
|
|
52 |
|
|
|
|
|
2010-07 |
|
|
|
|
|
|
|
|
|
|
|
|
2010-08 |
|
240 |
|
|
|
|
29 |
|
|
|
|
|
2010-09 |
|
|
|
|
|
|
|
|
|
|
|
|
2010-10 |
|
|
|
|
|
|
9 |
|
|
|
|
21 |
2010-11 |
|
|
|
|
|
|
|
|
|
|
|
38 |
2010-12 |
|
|
|
|
|
|
|
|
|
|
|
63 |
2011-01 |
|
|
|
|
|
|
11 |
|
|
|
|
54 |
2011-02 |
27 |
|
|
|
|
|
|
|
|
|
|
290 |
2011-03 |
|
|
|
|
|
|
|
|
|
|
|
31 |
2011-04 |
|
|
|
|
|
|
|
|
|
|
|
14 |
2011-05 |
|
|
|
|
67 |
|
|
|
|
|
|
50 |
2011-06 |
62 |
78 |
|
|
|
|
16 |
|
|
|
|
|
2011-07 |
|
319 |
|
|
5 |
|
103 |
|
|
|
|
|
2011-08 |
|
|
|
|
|
|
|
|
|
|
|
|
2011-09 |
843 |
|
|
|
5 |
|
|
|
|
|
|
|
2011-10 |
|
|
|
|
19 |
|
2746 |
|
|
|
|
|
2011-11 |
169 |
|
|
|
|
|
1843 |
|
|
|
|
|
2011-12 |
|
|
|
|
|
|
168 |
|
|
|
|
|
2012-01 |
|
|
|
|
|
18 |
44 |
2 |
|
|
|
|
2012-02 |
|
79 |
|
|
|
4 |
316 |
|
|
|
|
|
2012-03 |
|
|
|
|
|
76 |
2869 |
151 |
|
|
|
|
2012-04 |
|
|
|
|
|
11 |
1512 |
|
|
|
|
|
2012-05 |
|
|
|
|
|
80 |
6 |
|
|
|
|
|
2012-06 |
1448 |
|
123 |
|
28 |
23 |
|
|
|
|
|
|
2012-07 |
|
|
339 |
|
|
7 |
10 |
|
|
|
|
|
2012-08 |
|
|
293 |
|
|
23 |
|
|
|
|
|
|
2012-09 |
19 |
|
13 |
2 |
|
67 |
977 |
|
|
|
|
|
2012-10 |
|
|
63 |
250 |
|
106 |
155 |
|
|
|
|
|
2012-11 |
2051 |
|
379 |
163 |
101 |
165 |
67 |
|
|
|
|
|
2012-12 |
8 |
|
68 |
|
1 |
628 |
63 |
68 |
|
|
|
|
2013-01 |
571 |
|
6595 |
5 |
21 |
618 |
123 |
|
|
|
|
|
2013-02 |
2020 |
|
104 |
|
2211 |
16798 |
12842 |
|
|
|
|
|
2013-03 |
1363 |
|
|
|
389 |
13154 |
524 |
|
|
|
|
|
2013-04 |
4 |
|
|
|
13 |
2857 |
139 |
|
|
|
|
|
2013-05 |
|
|
|
139 |
47 |
5096 |
8167 |
|
|
|
|
|
2013-06 |
|
|
15 |
1021 |
|
4078 |
1268 |
|
|
3 |
|
|
2013-07 |
|
|
644 |
537 |
1 |
4021 |
341 |
|
|
|
|
|
2013-08 |
|
|
963 |
98 |
18 |
1343 |
191 |
|
|
|
6051 |
|
2013-09 |
2 |
|
|
2020 |
6 |
551 |
|
|
|
|
4958 |
90 |
2013-10 |
329 |
|
25 |
110 |
|
1039 |
|
|
|
|
420 |
71 |
2013-11 |
1075 |
|
3514 |
97 |
201 |
3039 |
|
|
|
|
2338 |
|
2013-12 |
|
|
3316 |
2 |
2 |
53 |
|
|
|
|
2511 |
|
2014-01 |
|
|
102 |
|
30 |
1698 |
|
|
|
9305 |
|
|
2014-02 |
|
|
593 |
62 |
13 |
34 |
|
|
|
95 |
1325 |
|
2014-03 |
|
|
71 |
13 |
897 |
117 |
|
|
|
8481 |
2328 |
|
2014-04 |
|
|
22 |
|
330 |
750 |
|
1 |
|
13269 |
2047 |
|
2014-05 |
3 |
|
202 |
|
24 |
4988 |
|
2 |
|
8575 |
1655 |
|
2014-06 |
|
|
190 |
62 |
62 |
510 |
|
1 |
|
5961 |
717 |
|
2014-07 |
|
|
4454 |
|
325 |
122 |
|
|
|
7563 |
8 |
|
2014-08 |
|
|
15 |
|
193 |
178 |
|
|
|
4548 |
146 |
|
2014-09 |
|
|
2 |
3 |
72 |
212 |
|
|
|
278 |
|
|
2014-10 |
|
|
3353 |
|
52 |
672 |
|
|
|
1368 |
|
|
2014-11 |
|
|
1158 |
4 |
27 |
1306 |
325 |
|
|
643 |
|
|
2014-12 |
4 |
|
365 |
293 |
107 |
1017 |
|
|
|
54 |
|
|
2015-01 |
|
|
1920 |
|
135 |
148 |
|
4 |
|
783 |
1752 |
|
2015-02 |
50 |
|
1486 |
|
1 |
816 |
|
4 |
|
4737 |
7 |
|
2015-03 |
|
|
1535 |
|
|
2391 |
7955 |
|
|
12107 |
|
|
2015-04 |
810 |
|
|
|
|
1675 |
36 |
|
|
5563 |
|
|
2015-05 |
|
|
|
|
101 |
163 |
|
|
|
2750 |
2 |
|
2015-06 |
|
|
|
|
2071 |
3138 |
170 |
2 |
|
5812 |
|
|
2015-07 |
3676 |
|
162 |
|
879 |
6175 |
78 |
2 |
|
818 |
|
|
2015-08 |
272 |
|
36 |
|
1567 |
6517 |
129 |
20 |
|
4376 |
210 |
|
2015-09 |
772 |
|
28 |
|
221 |
6806 |
730 |
21 |
|
423 |
12 |
|
2015-10 |
1861 |
|
246 |
|
2587 |
5729 |
5419 |
|
|
871 |
|
|
TOTs in GB |
17541 |
716 |
32394 |
4881 |
12829 |
99017 |
49433 |
278 |
0 |
98383 |
26487 |
722 |
/shome /swshare
shared filesystems
- Both the critical
/shome /swshare
shared filesystems are running on respectively 2 out of warranty file servers with mutual backups.
- In order to migrate these shared filesystems onto new HW in Oct 2015 we've bought for ~40k CHF :