[OpenAFS] Max partition and Volume size

Hartmut Reuter reuter@rzg.mpg.de
Tue, 01 Apr 2008 10:18:33 +0200


Rich Sudlow wrote:
> I wanted to double check - is the max partition and volume size
> both 2 TB?
> 
> Are there any plans on increasing the partition size
> in the near future?
> 
> Thanks,
> 
> Rich
> 

Partition size doesn't matter too much any more when you use "OpenAFS + 
object storage" (see best practice workshop in May). But maximum volume 
size right now is limited by the int32 to count the volume's blocks and 
also the disk quota. If you don't set a disk quota you may also today 
end up with bigger volumes. Our biggest has 6.3 TB, but the number of 
blocks you see with "vos examine" is modulo 4 TB, of course.

I admit: this is not what we wanted, but it happened.

Hartmut

~: vos ex aug-shotfiles.archive
aug-shotfiles.archive             536892900 RW -1728398890 K  On-line
     afs4.bc.rzg.mpg.de /vicepx                      23830 files
     RWrite  536892900 ROnly  536892901 Backup          0
     MaxQuota          0 K, osd flag    1
     Creation    Fri Oct 11 10:43:06 1996
     Copy        Wed Feb  6 11:32:01 2008
     Backup      Never
     Last Update Tue Apr  1 10:13:09 2008
     160693 accesses in the past day (i.e., vnode references)

     RWrite: 536892900     ROnly: 536892901
     number of sites -> 3
        server afs4.bc.rzg.mpg.de partition /vicepx RW Site
        server afs16.rzg.mpg.de partition /vicepx RO Site
        server afs4.bc.rzg.mpg.de partition /vicepx RO Site
~:vos traverse afs4 -id aug-shotfiles.archive

servers:
         afs4


File Size Range    Files      %  run %     Data         %  run %
----------------------------------------------------------------
   0  B -   4 KB      240   1.01   1.01  399.045 KB   0.00   0.00
   4 KB -   8 KB        9   0.04   1.04   50.339 KB   0.00   0.00
   8 KB -  16 KB       31   0.13   1.17  395.975 KB   0.00   0.00
  16 KB -  32 KB       79   0.33   1.51    1.851 MB   0.00   0.00
  32 KB -  64 KB       87   0.37   1.87    3.821 MB   0.00   0.00
  64 KB - 128 KB       92   0.39   2.26    8.427 MB   0.00   0.00
128 KB - 256 KB      105   0.44   2.70   17.480 MB   0.00   0.00
256 KB - 512 KB      137   0.57   3.27   53.902 MB   0.00   0.00
512 KB -   1 MB      189   0.79   4.07  143.429 MB   0.00   0.00
   1 MB -   2 MB     1281   5.38   9.44    1.816 GB   0.03   0.03
   2 MB -   4 MB     1154   4.84  14.28    3.210 GB   0.05   0.08
   4 MB -   8 MB     1567   6.58  20.86    8.989 GB   0.14   0.22
   8 MB -  16 MB     1647   6.91  27.77   18.796 GB   0.29   0.50
  16 MB -  32 MB     1869   7.84  35.61   42.181 GB   0.64   1.15
  32 MB -  64 MB     2161   9.07  44.68   96.362 GB   1.47   2.62
  64 MB - 128 MB     1997   8.38  53.06  181.517 GB   2.77   5.40
128 MB - 256 MB     3272  13.73  66.79  606.521 GB   9.27  14.66
256 MB - 512 MB     3754  15.75  82.55    1.319 TB  20.66  35.32
512 MB -   1 GB     2261   9.49  92.04    1.496 TB  23.42  58.74
   1 GB -   2 GB     1898   7.96 100.00    2.635 TB  41.26 100.00
----------------------------------------------------------------
Totals:            23830 Files            6.389 TB

Storage usage:
---------------------------------------------------------------
                 1 local_disk        965 files     226.115 MB
   arch. Osd     4 raid6            3898 objects    13.796 GB
   arch. Osd     5 tape            22858 objects     6.387 TB
         Osd     8 afs16-a            47 objects    32.475 GB
         Osd    10 afs4-a            260 objects   206.205 GB
   arch. Osd    13 hsmgpfs           510 objects   463.637 GB
         Osd    19 mpp-fs10-a          8 objects     7.143 GB
         Osd    32 afs8-a             31 objects    21.075 GB
---------------------------------------------------------------
Total                             28577 objects     7.115 TB

Data without a copy:
---------------------------------------------------------------
if !replicated: 1 local_disk        965 files     226.115 MB
   arch. Osd     4 raid6               4 objects     3.625 MB
   arch. Osd     5 tape            18413 objects     5.879 TB
         Osd    10 afs4-a              3 objects     1.682 GB
---------------------------------------------------------------
Total                             19385 objects     5.881 TB
~:



-- 
-----------------------------------------------------------------
Hartmut Reuter                  e-mail 		reuter@rzg.mpg.de
			   	phone 		 +49-89-3299-1328
			   	fax   		 +49-89-3299-1301
RZG (Rechenzentrum Garching)   	web    http://www.rzg.mpg.de/~hwr
Computing Center of the Max-Planck-Gesellschaft (MPG) and the
Institut fuer Plasmaphysik (IPP)
-----------------------------------------------------------------