[OpenAFS] File systems on Linux, again. Numbers
Martin Ginkel
mginkel@mpi-magdeburg.mpg.de
Mon, 3 Dec 2007 21:24:44 +0100
On Friday 30 November 2007 02:52:06 pm Jerry Normandin wrote:
> AFS on EXT3? No there are Metadata issues. EXT3 was intended for this.
> I inherited a mess here that I am fixing. My predecessor built is using
> Ext3 for the /vicepa filesystems. It takes a hell of a long time to
> create,
> Delete, or rename files. I tested with Bonnie++... here are my stats:
>
> Initial file performance baselines taken from ENG02 with 4096kbyte
> cache:
>
> > recommendation for which file system to use on Linux AFS file servers.
> > Ext3, XFS, JFS, something else?
Here are my numbers:
Boundary-conditions:
Client: 5G disk cache (ext2) openafs 1.4.5 Core Duo 2.7GHz
Bonnie++ with 4G files
Server: openafs 1.4.5 on 2x Dual Xeon 3.2
Disk: Dell Perc 4 Raid 5
Connection via switched 1Gbit Ethernet, 0.125ms Roundtrip
server partitions:
EXT3:
Version 1.01d ------Sequential Output------ --Sequential Input- --Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
pc533 4G 7615 39 7362 36 4607 31 12005 14 8932 1 36.5 18
------Sequential Create------ --------Random Create--------
-Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 717 38 6705 80 1079 33 743 38 2735 55 1269 27
XFS:
Version 1.01d ------Sequential Output------ --Sequential Input- --Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
pc533 4G 7575 43 7393 40 4650 33 11804 13 8949 1 37.9 21
------Sequential Create------ --------Random Create--------
-Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 659 35 6738 82 1000 30 695 36 2711 55 1172 24
REISER:
Version 1.01d ------Sequential Output------ --Sequential Input- --Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
pc533 4G 7552 39 7599 36 4645 31 11817 13 8784 1 37.6 20
------Sequential Create------ --------Random Create--------
-Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 679 34 6670 83 1048 33 721 38 2697 53 1072 22
HTH
Martin