HPSS Phase Out Progress

Date Files Megabytes
2009-11-15 51,712 245,936,807.78
2009-12-08 38,552 234,649,472.38
2009-12-17 33,288 221,150,882.63
2009-12-29 30,540 206,373,809.57
2010-01-14 30,585 193,878,648.81
2010-02-11 23,150 192,746,658.29
2010-02-26 16,584 182,763,406.43
2010-03-15 13,406 174,872,196.48
2010-03-24 12,367 170,046,068.21
2010-03-28 11,863 165,378,383.32
2010-04-04 11,195 153,560,083.14
2010-04-11 10,032 146,070,846.51
2010-04-18 7,464 122,987,129.43
2010-04-25 6,041 102,728,827.79
2010-05-02 5,185 89,329,932.08
2010-05-09 4,854 81,408,409.46
2010-05-16 3,809 65,922,374.70
2010-05-23 3,781 53,402,182.94
2010-05-30 2,905 41,775,984.15
2010-06-06 2,208 33,243,482.10
2010-06-13 133 17,456,434.87
2010-06-20 96 8,451,261.46
2010-06-27 19 379,441.93
2010-07-04 5 242,354.44
2010-07-11 5 242,354.44
2010-07-18 5 242,354.44
2010-07-25 4 242,351.96
2010-07-26 4 242,351.96
2010-07-27 5 243,245.36
2010-07-28 4 242,351.96
2010-07-29 5 245,458.02
2010-07-30 4 242,351.96
2010-07-31 4 242,351.96
2010-08-01 10 248,759.87
2010-08-02 4 242,351.96

This table represents the count of files and their total size waiting to be copied to Huntay on the indicated date. Files may not be copied if they get deleted prior to the copy process catching up to them. An increase would indicate additional dumps being directed to the Ninevehs while we're trying to empty them.

The table below gives an estimate on how long it will take to complete based on the average progress made over the specified time range for both file count and the amount of space left. Note that a completion date in the past suggests the date we would have to have started had the negative progress been consistent.

From Thru Files/day Complete GB/day Complete
2010-08-01 2010-08-02 6.00 2010-08-03 6.26 2010-09-09
2010-07-31 2010-08-02 0.00 1942-07-15 0.00 1942-07-15
2010-07-30 2010-08-02 0.00 1942-07-15 0.00 1942-07-15
2010-07-29 2010-08-02 0.25 2010-08-18 0.76 2011-06-10
2010-07-28 2010-08-02 0.00 1942-07-15 0.00 1942-07-15
2010-07-27 2010-08-02 0.17 2010-08-26 0.15 2015-01-16
2010-07-26 2010-08-02 0.00 1942-07-15 0.00 1942-07-15
2010-07-25 2010-08-02 0.00 1942-07-15 0.00 1942-07-15
2010-07-18 2010-08-02 0.07 2010-10-01 0.00 1942-07-15
2010-07-11 2010-08-02 0.05 2010-10-29 0.00 1942-07-15
2010-07-04 2010-08-02 0.03 2010-11-26 0.00 1942-07-15
2010-06-27 2010-08-02 0.42 2010-08-12 3.72 2010-10-05
2010-06-20 2010-08-02 2.14 2010-08-04 186.43 2010-08-03
2010-06-13 2010-08-02 2.58 2010-08-04 336.21 2010-08-03
2010-06-06 2010-08-02 38.67 2010-08-02 565.40 2010-08-02
2010-05-30 2010-08-02 45.33 2010-08-02 633.75 2010-08-02
2010-05-23 2010-08-02 53.20 2010-08-02 731.18 2010-08-02
2010-05-16 2010-08-02 48.78 2010-08-02 822.32 2010-08-02
2010-05-09 2010-08-02 57.06 2010-08-02 932.51 2010-08-02
2010-05-02 2010-08-02 56.32 2010-08-02 945.65 2010-08-02
2010-04-25 2010-08-02 60.98 2010-08-02 1,010.95 2010-08-02
2010-04-18 2010-08-02 70.38 2010-08-02 1,130.83 2010-08-02
2010-04-11 2010-08-02 88.74 2010-08-02 1,260.27 2010-08-02
2010-04-04 2010-08-02 93.26 2010-08-02 1,247.70 2010-08-02
2010-03-28 2010-08-02 93.38 2010-08-02 1,269.81 2010-08-02
2010-03-24 2010-08-02 94.37 2010-08-02 1,265.83 2010-08-02
2010-03-15 2010-08-02 95.73 2010-08-02 1,218.12 2010-08-02
2010-02-26 2010-08-02 105.63 2010-08-02 1,135.61 2010-08-02
2010-02-11 2010-08-02 134.60 2010-08-02 1,093.24 2010-08-02
2010-01-14 2010-08-02 152.94 2010-08-02 945.69 2010-08-02
2009-12-29 2010-08-02 141.40 2010-08-02 932.13 2010-08-02
2009-12-17 2010-08-02 146.01 2010-08-02 946.36 2010-08-02
2009-12-08 2010-08-02 162.68 2010-08-02 966.05 2010-08-02
2009-11-15 2010-08-02 198.91 2010-08-02 922.98 2010-08-02
2010-08-01 2010-08-02 6.00 2010-08-03 6.26 2010-09-09
2010-07-31 2010-08-01 -6.00 2010-07-30 -6.26 2010-06-23
2010-07-30 2010-07-31 0.00 1942-07-13 0.00 1942-07-13
2010-07-29 2010-07-30 1.00 2010-08-03 3.03 2010-10-16
2010-07-28 2010-07-29 -1.00 2010-07-24 -3.03 2010-05-11
2010-07-27 2010-07-28 1.00 2010-08-01 0.87 2011-04-25
2010-07-26 2010-07-27 -1.00 2010-07-22 -0.87 2009-10-28
2010-07-25 2010-07-26 0.00 1942-07-08 0.00 1942-07-08
2010-07-18 2010-07-25 0.14 2010-08-22 0.00 1942-07-07
2010-07-11 2010-07-18 0.00 1942-06-30 0.00 1942-06-30
2010-07-04 2010-07-11 0.00 1942-06-23 0.00 1942-06-23
2010-06-27 2010-07-04 2.00 2010-07-07 19.12 2010-07-16
2010-06-20 2010-06-27 11.00 2010-06-29 1,126.09 2010-06-27
2010-06-13 2010-06-20 5.29 2010-07-08 1,256.30 2010-06-27
2010-06-06 2010-06-13 296.43 2010-06-13 2,202.43 2010-06-21
2010-05-30 2010-06-06 99.57 2010-06-28 1,190.36 2010-07-03
2010-05-23 2010-05-30 125.14 2010-06-22 1,621.96 2010-06-24
2010-05-16 2010-05-23 4.00 2012-12-23 1,746.68 2010-06-22
2010-05-09 2010-05-16 149.29 2010-06-11 2,160.44 2010-06-15
2010-05-02 2010-05-09 47.29 2010-08-20 1,105.12 2010-07-20
2010-04-25 2010-05-02 122.29 2010-06-13 1,869.27 2010-06-18
2010-04-18 2010-04-25 203.29 2010-05-25 2,826.21 2010-05-30
2010-04-11 2010-04-18 366.86 2010-05-08 3,220.38 2010-05-25
2010-04-04 2010-04-11 166.14 2010-06-10 1,044.82 2010-08-26
2010-03-28 2010-04-04 95.43 2010-07-30 1,648.76 2010-07-04
2010-03-24 2010-03-28 126.00 2010-06-30 1,139.57 2010-08-17
2010-03-15 2010-03-24 115.44 2010-07-09 523.67 2011-02-04
2010-02-26 2010-03-15 187.40 2010-05-26 454.42 2011-03-26
2010-02-11 2010-02-26 437.73 2010-04-05 649.95 2010-11-28
2010-01-14 2010-02-11 265.54 2010-05-09 39.48 2023-03-03
2009-12-29 2010-01-14 -2.81 1980-04-06 762.64 2010-09-19
2009-12-17 2009-12-29 229.00 2010-05-11 1,202.56 2010-06-15
2009-12-08 2009-12-17 584.89 2010-02-12 1,464.69 2010-05-13
2009-11-15 2009-12-08 572.17 2010-02-13 479.25 2011-03-31

The first section of this table estimates completion times based on the progress between each of the data points above thru today.

The progress since March 24th has been fairly consistent and probably provides the best completion prediction.

The second section gives the historical completion times based on the progress between each adjacent pair of data points above.

Ken Lowe
Email -- ken@u.washington.edu
Web -- http://staff.washington.edu/krl/