[OpenAFS] File systems on Linux, again. Numbers

Martin Ginkel mginkel@mpi-magdeburg.mpg.de
Mon, 3 Dec 2007 21:24:44 +0100


On Friday 30 November 2007 02:52:06 pm Jerry Normandin wrote:
> AFS on EXT3?  No there are Metadata issues.  EXT3 was intended for this.
> I inherited a mess here that I am fixing.  My predecessor built is using
> Ext3 for the /vicepa filesystems.  It takes a hell of a long time to
> create,
> Delete, or rename files.  I tested with Bonnie++... here are my stats:
>
> Initial file performance baselines taken from ENG02 with 4096kbyte
> cache:
>
> > recommendation for which file system to use on Linux AFS file servers.
> > Ext3, XFS, JFS, something else?

Here are my numbers:
Boundary-conditions:
 Client: 5G disk cache (ext2) openafs 1.4.5 Core Duo 2.7GHz
    Bonnie++ with 4G files
 Server: openafs 1.4.5 on 2x Dual Xeon 3.2
Disk: Dell Perc 4 Raid 5 
Connection via switched 1Gbit Ethernet, 0.125ms Roundtrip

server partitions:
EXT3:
Version 1.01d       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
pc533            4G  7615  39  7362  36  4607  31 12005  14  8932   1  36.5  18
                    ------Sequential Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16   717  38  6705  80  1079  33   743  38  2735  55  1269  27

XFS:
Version 1.01d       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
pc533            4G  7575  43  7393  40  4650  33 11804  13  8949   1  37.9  21
                    ------Sequential Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16   659  35  6738  82  1000  30   695  36  2711  55  1172  24

REISER:
Version 1.01d       ------Sequential Output------ --Sequential Input- --Random-
                    -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
pc533            4G  7552  39  7599  36  4645  31 11817  13  8784   1  37.6  20
                    ------Sequential Create------ --------Random Create--------
                    -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
              files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP
                 16   679  34  6670  83  1048  33   721  38  2697  53  1072  22

	HTH
	Martin