[OpenAFS-devel] fileserver parameters

Sven Oehme oehmes@de.ibm.com
Mon, 20 Jun 2005 15:00:18 +0200


This is a multipart message in MIME format.
--=_alternative 00476CF5C1257026_=
Content-Type: text/plain; charset="US-ASCII"

Hi,

i am using the openafs Fileserver based on the 1.3.81 cvs + some fixes .. 
with SuSE SLES9 SP1 Kernel 2.6.5-7.145-smp

BosConfig :

cat /etc/openafs/BosConfig
restarttime 11 0 4 0 0
checkbintime 3 0 5 0 0
bnode fs fs 1
parm /usr/lib/openafs/fileserver -nojumbo -L -p 16 -rxpck 400 -udpsize 
1310720
parm /usr/lib/openafs/volserver -nojumbo  -log -udpsize 1310720
parm /usr/lib/openafs/salvager -parallel 4
end
bnode simple upclientetc 0
parm /usr/lib/openafs/upclient afsdb01 /etc/openafs/server
end

btw , this is a vmstat 1 on the system :

procs -----------memory---------- ---swap-- -----io---- --system-- 
----cpu----
 r  b   swpd   free   buff  cache   si   so    bi    bo   in    cs us sy 
id wa
 0  1      8   6164   6564 414636    0    0 23272     0 9483 23776  5 11 
71 14
 2  0      8   4692   6564 415416    0    0 24804  1952 9911 26802  7 11 
69 13
 1  0      8   6476   6564 414116    0    0 25268     1 10312 28565  8 12 
69 13
 0  1      8   6028   6564 414636    0    0 23448     0 9639 24870  6 10 
70 13
 0  1      8   4968   6564 415676    0    0 24580     0 9868 25899  6 12 
69 13
 2  0      8   5588   6564 415156    0    0 24724     0 9761 25192  7 10 
70 13
 1  0      8   4948   6564 415676    0    0 26396    34 10709 27361  7 12 
69 12
 0  1      8   5268   6564 415676    0    0 25016     0 10240 26749  7 10 
70 13
 0  1      8   6164   6564 414896    0    0 24068     0 9657 24614  7 10 
70 14
 0  1      8   5908   6564 415156    0    0 25456     0 10363 26938  7 11 
70 12
 1  0      8   5400   6564 415676    0    0 25712     0 10287 26979  7 11 
70 12
 1  0      8   6228   6564 414896    0    0 24548    64 10031 26401  7 11 
69 13
 0  1      8   4884   6564 416456    0    0 25136     0 9936 25848  7 10 
70 13
 0  1      8   6740   6564 414636    0    0 25488     0 10145 26395  7 11 
70 13
 2  0      8   4948   6564 416456    0    0 24976     0 10142 26404  7 11 
69 12
 0  1      8   6804   6564 414636    0    0 23296     0 9232 23836  6  9 
70 14
 0  1      8   6620   6564 414896    0    0 25316     0 10258 26549  6 11 
70 12

which shows a throughput between 20 - 25 MB/sec  (on the Server) while the 
system is 70% idle ...
for my feeling there are a lot of CS on the system ... but see peaks 
between 30 and 50 MB/sec on that system regularly ..
btw , this is a IBM x345 (2 Prozessor 3 GhZ XEON) with some IBM DS4000 
Storage ...

Sven




Roland Kuhn <rkuhn@e18.physik.tu-muenchen.de> 
Sent by: openafs-devel-admin@openafs.org
20/06/2005 14:37

To
Sven Oehme/Germany/IBM@IBMDE
cc
Niklas.Edmundsson@hpc2n.umu.se, openafs-devel@openafs.org, 
openafs-devel-admin@openafs.org
Subject
Re: [OpenAFS-devel] fileserver parameters






Hi Sven!

On Jun 20, 2005, at 12:46 PM, Sven Oehme wrote:

>
> Hi,
>
> we run XFS and we use Kernel 2.6 , SMP and we have AFS Performance 
> >40 MB/sec over Gigabit Ethernet.
>
Which fileserver do you use, and which parameters do you give?

Ciao,
                     Roland

--
TU Muenchen, Physik-Department E18, James-Franck-Str. 85747 Garching
Telefon 089/289-12592; Telefax 089/289-12570
--
A mouse is a device used to point at
the xterm you want to type in.
Kim Alm on a.s.r.
-----BEGIN GEEK CODE BLOCK-----
Version: 3.12
GS/CS/M/MU d-(++) s:+ a-> C+++ UL++++ P-(+) L+++ E(+) W+ !N K- w--- M 
+ !V Y+
PGP++ t+(++) 5 R+ tv-- b+ DI++ e+++>++++ h---- y+++
------END GEEK CODE BLOCK------


[attachment "PGP.sig" deleted by Sven Oehme/Germany/IBM] 

--=_alternative 00476CF5C1257026_=
Content-Type: text/html; charset="US-ASCII"


<br><font size=2 face="sans-serif">Hi,</font>
<br>
<br><font size=2 face="sans-serif">i am using the openafs Fileserver based
on the 1.3.81 cvs + some fixes .. with SuSE SLES9 SP1 Kernel 2.6.5-7.145-smp</font>
<br>
<br><font size=2 face="sans-serif">BosConfig :</font>
<br>
<br><font size=2 face="sans-serif">cat /etc/openafs/BosConfig</font>
<br><font size=2 face="sans-serif">restarttime 11 0 4 0 0</font>
<br><font size=2 face="sans-serif">checkbintime 3 0 5 0 0</font>
<br><font size=2 face="sans-serif">bnode fs fs 1</font>
<br><font size=2 face="sans-serif">parm /usr/lib/openafs/fileserver -nojumbo
-L -p 16 -rxpck 400 -udpsize 1310720</font>
<br><font size=2 face="sans-serif">parm /usr/lib/openafs/volserver -nojumbo
&nbsp;-log -udpsize 1310720</font>
<br><font size=2 face="sans-serif">parm /usr/lib/openafs/salvager -parallel
4</font>
<br><font size=2 face="sans-serif">end</font>
<br><font size=2 face="sans-serif">bnode simple upclientetc 0</font>
<br><font size=2 face="sans-serif">parm /usr/lib/openafs/upclient afsdb01
/etc/openafs/server</font>
<br><font size=2 face="sans-serif">end</font>
<br>
<br><font size=2 face="sans-serif">btw , this is a vmstat 1 on the system
:</font>
<br>
<br><font size=2 face="sans-serif">procs -----------memory---------- ---swap--
-----io---- --system-- ----cpu----</font>
<br><font size=2 face="sans-serif">&nbsp;r &nbsp;b &nbsp; swpd &nbsp; free
&nbsp; buff &nbsp;cache &nbsp; si &nbsp; so &nbsp; &nbsp;bi &nbsp; &nbsp;bo
&nbsp; in &nbsp; &nbsp;cs us sy id wa</font>
<br><font size=2 face="sans-serif">&nbsp;0 &nbsp;1 &nbsp; &nbsp; &nbsp;8
&nbsp; 6164 &nbsp; 6564 414636 &nbsp; &nbsp;0 &nbsp; &nbsp;0 23272 &nbsp;
&nbsp; 0 9483 23776 &nbsp;5 11 71 14</font>
<br><font size=2 face="sans-serif">&nbsp;2 &nbsp;0 &nbsp; &nbsp; &nbsp;8
&nbsp; 4692 &nbsp; 6564 415416 &nbsp; &nbsp;0 &nbsp; &nbsp;0 24804 &nbsp;1952
9911 26802 &nbsp;7 11 69 13</font>
<br><font size=2 face="sans-serif">&nbsp;1 &nbsp;0 &nbsp; &nbsp; &nbsp;8
&nbsp; 6476 &nbsp; 6564 414116 &nbsp; &nbsp;0 &nbsp; &nbsp;0 25268 &nbsp;
&nbsp; 1 10312 28565 &nbsp;8 12 69 13</font>
<br><font size=2 face="sans-serif">&nbsp;0 &nbsp;1 &nbsp; &nbsp; &nbsp;8
&nbsp; 6028 &nbsp; 6564 414636 &nbsp; &nbsp;0 &nbsp; &nbsp;0 23448 &nbsp;
&nbsp; 0 9639 24870 &nbsp;6 10 70 13</font>
<br><font size=2 face="sans-serif">&nbsp;0 &nbsp;1 &nbsp; &nbsp; &nbsp;8
&nbsp; 4968 &nbsp; 6564 415676 &nbsp; &nbsp;0 &nbsp; &nbsp;0 24580 &nbsp;
&nbsp; 0 9868 25899 &nbsp;6 12 69 13</font>
<br><font size=2 face="sans-serif">&nbsp;2 &nbsp;0 &nbsp; &nbsp; &nbsp;8
&nbsp; 5588 &nbsp; 6564 415156 &nbsp; &nbsp;0 &nbsp; &nbsp;0 24724 &nbsp;
&nbsp; 0 9761 25192 &nbsp;7 10 70 13</font>
<br><font size=2 face="sans-serif">&nbsp;1 &nbsp;0 &nbsp; &nbsp; &nbsp;8
&nbsp; 4948 &nbsp; 6564 415676 &nbsp; &nbsp;0 &nbsp; &nbsp;0 26396 &nbsp;
&nbsp;34 10709 27361 &nbsp;7 12 69 12</font>
<br><font size=2 face="sans-serif">&nbsp;0 &nbsp;1 &nbsp; &nbsp; &nbsp;8
&nbsp; 5268 &nbsp; 6564 415676 &nbsp; &nbsp;0 &nbsp; &nbsp;0 25016 &nbsp;
&nbsp; 0 10240 26749 &nbsp;7 10 70 13</font>
<br><font size=2 face="sans-serif">&nbsp;0 &nbsp;1 &nbsp; &nbsp; &nbsp;8
&nbsp; 6164 &nbsp; 6564 414896 &nbsp; &nbsp;0 &nbsp; &nbsp;0 24068 &nbsp;
&nbsp; 0 9657 24614 &nbsp;7 10 70 14</font>
<br><font size=2 face="sans-serif">&nbsp;0 &nbsp;1 &nbsp; &nbsp; &nbsp;8
&nbsp; 5908 &nbsp; 6564 415156 &nbsp; &nbsp;0 &nbsp; &nbsp;0 25456 &nbsp;
&nbsp; 0 10363 26938 &nbsp;7 11 70 12</font>
<br><font size=2 face="sans-serif">&nbsp;1 &nbsp;0 &nbsp; &nbsp; &nbsp;8
&nbsp; 5400 &nbsp; 6564 415676 &nbsp; &nbsp;0 &nbsp; &nbsp;0 25712 &nbsp;
&nbsp; 0 10287 26979 &nbsp;7 11 70 12</font>
<br><font size=2 face="sans-serif">&nbsp;1 &nbsp;0 &nbsp; &nbsp; &nbsp;8
&nbsp; 6228 &nbsp; 6564 414896 &nbsp; &nbsp;0 &nbsp; &nbsp;0 24548 &nbsp;
&nbsp;64 10031 26401 &nbsp;7 11 69 13</font>
<br><font size=2 face="sans-serif">&nbsp;0 &nbsp;1 &nbsp; &nbsp; &nbsp;8
&nbsp; 4884 &nbsp; 6564 416456 &nbsp; &nbsp;0 &nbsp; &nbsp;0 25136 &nbsp;
&nbsp; 0 9936 25848 &nbsp;7 10 70 13</font>
<br><font size=2 face="sans-serif">&nbsp;0 &nbsp;1 &nbsp; &nbsp; &nbsp;8
&nbsp; 6740 &nbsp; 6564 414636 &nbsp; &nbsp;0 &nbsp; &nbsp;0 25488 &nbsp;
&nbsp; 0 10145 26395 &nbsp;7 11 70 13</font>
<br><font size=2 face="sans-serif">&nbsp;2 &nbsp;0 &nbsp; &nbsp; &nbsp;8
&nbsp; 4948 &nbsp; 6564 416456 &nbsp; &nbsp;0 &nbsp; &nbsp;0 24976 &nbsp;
&nbsp; 0 10142 26404 &nbsp;7 11 69 12</font>
<br><font size=2 face="sans-serif">&nbsp;0 &nbsp;1 &nbsp; &nbsp; &nbsp;8
&nbsp; 6804 &nbsp; 6564 414636 &nbsp; &nbsp;0 &nbsp; &nbsp;0 23296 &nbsp;
&nbsp; 0 9232 23836 &nbsp;6 &nbsp;9 70 14</font>
<br><font size=2 face="sans-serif">&nbsp;0 &nbsp;1 &nbsp; &nbsp; &nbsp;8
&nbsp; 6620 &nbsp; 6564 414896 &nbsp; &nbsp;0 &nbsp; &nbsp;0 25316 &nbsp;
&nbsp; 0 10258 26549 &nbsp;6 11 70 12</font>
<br>
<br><font size=2 face="sans-serif">which shows a throughput between 20
- 25 MB/sec &nbsp;(on the Server) while the system is 70% idle ...</font>
<br><font size=2 face="sans-serif">for my feeling there are a lot of CS
on the system ... but see peaks between 30 and 50 MB/sec on that system
regularly ..</font>
<br><font size=2 face="sans-serif">btw , this is a IBM x345 (2 Prozessor
3 GhZ XEON) with some IBM DS4000 Storage ...</font>
<br>
<br><font size=2 face="sans-serif">Sven</font>
<br>
<br>
<br>
<br>
<table width=100%>
<tr valign=top>
<td width=40%><font size=1 face="sans-serif"><b>Roland Kuhn &lt;rkuhn@e18.physik.tu-muenchen.de&gt;</b>
</font>
<br><font size=1 face="sans-serif">Sent by: openafs-devel-admin@openafs.org</font>
<p><font size=1 face="sans-serif">20/06/2005 14:37</font>
<td width=59%>
<table width=100%>
<tr>
<td>
<div align=right><font size=1 face="sans-serif">To</font></div>
<td valign=top><font size=1 face="sans-serif">Sven Oehme/Germany/IBM@IBMDE</font>
<tr>
<td>
<div align=right><font size=1 face="sans-serif">cc</font></div>
<td valign=top><font size=1 face="sans-serif">Niklas.Edmundsson@hpc2n.umu.se,
openafs-devel@openafs.org, openafs-devel-admin@openafs.org</font>
<tr>
<td>
<div align=right><font size=1 face="sans-serif">Subject</font></div>
<td valign=top><font size=1 face="sans-serif">Re: [OpenAFS-devel] fileserver
parameters</font></table>
<br>
<table>
<tr valign=top>
<td>
<td></table>
<br></table>
<br>
<br>
<br><font size=2><tt>Hi Sven!<br>
<br>
On Jun 20, 2005, at 12:46 PM, Sven Oehme wrote:<br>
<br>
&gt;<br>
&gt; Hi,<br>
&gt;<br>
&gt; we run XFS and we use Kernel 2.6 , SMP and we have AFS Performance
&nbsp;<br>
&gt; &gt;40 MB/sec over Gigabit Ethernet.<br>
&gt;<br>
Which fileserver do you use, and which parameters do you give?<br>
<br>
Ciao,<br>
 &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;
Roland<br>
<br>
--<br>
TU Muenchen, Physik-Department E18, James-Franck-Str. 85747 Garching<br>
Telefon 089/289-12592; Telefax 089/289-12570<br>
--<br>
A mouse is a device used to point at<br>
the xterm you want to type in.<br>
Kim Alm on a.s.r.<br>
-----BEGIN GEEK CODE BLOCK-----<br>
Version: 3.12<br>
GS/CS/M/MU d-(++) s:+ a-&gt; C+++ UL++++ P-(+) L+++ E(+) W+ !N K- w---
M <br>
+ !V Y+<br>
PGP++ t+(++) 5 R+ tv-- b+ DI++ e+++&gt;++++ h---- y+++<br>
------END GEEK CODE BLOCK------<br>
<br>
<br>
[attachment &quot;PGP.sig&quot; deleted by Sven Oehme/Germany/IBM] </tt></font>
<br>
--=_alternative 00476CF5C1257026_=--