[OpenAFS] Transfer rates under OpenAFS client for Windows

Tue, 3 Jul 2012 16:27:02 -0400

This is a multi-part message in MIME format.

------=_NextPart_000_0003_01CD5938.AD9F20A0
Content-Type: text/plain;
	charset="us-ascii"
Content-Transfer-Encoding: 7bit

I have Windows OpenAFS client  1.7.1500 on a 32-bit machine with Windows XP
and a  100 mbit/s network interface. Line rate between the client's port and
the target AFS file server is ca. 96 mbit/s for UDP, in both directions
(measured with iperf).

When I copy a single large file (ca. 1 GB) from the server to the client
machine, I see a network utilization maxed at ca. 70 mbit/s, and timing the
file transfer yields a similar overall rate. When I copy the same file from
the client to the server, network utilization is 30 mbit/s at the maximum.
Copying is always preceded by "fs flushall".

My first question is why copying from the client to the file server is so
much slower (by a factor of  2 or 3) than the other way around. The other
question is why the network utilization, at least as reported under Windows,
never approaches the line rate, even at quiet times, but rather stays below
the caps of 70 and 30 percent.

The client configuration parameters are:

Cache size: 800 Mbytes

Chunk size: 8192 Kbytes

Daemons: 16

RxMaxMTU: 9000

Sec. level: 1

Server threads: 40

Stats: 20000 entries

The machine has 3.45 Gbytes of RAM, and the paging file size is set at 5.3
Gbytes. 

I have consulted this post:

http://blog.secure-endpoints.com/2008/03/i-want-my-openafs-windows-client-to
-be.html

but have not been able to improve the transfer rates by tweaking the
client's parameters.

Thank you for any help.

Danko Antolovic

Principal Scientist, Research Technologies,

Indiana University

------=_NextPart_000_0003_01CD5938.AD9F20A0
Content-Type: text/html;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<html xmlns:v=3D"urn:schemas-microsoft-com:vml" =
xmlns:o=3D"urn:schemas-microsoft-com:office:office" =
xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:st1=3D"urn:schemas-microsoft-com:office:smarttags" =
xmlns=3D"http://www.w3.org/TR/REC-html40">

<head>
<meta http-equiv=3DContent-Type content=3D"text/html; =
charset=3Dus-ascii">
<meta name=3DGenerator content=3D"Microsoft Word 11 (filtered medium)">
<o:SmartTagType =
namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"
 name=3D"PlaceType"/>
<o:SmartTagType =
namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"
 name=3D"PlaceName"/>
<o:SmartTagType =
namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"
 name=3D"place"/>
<!--[if !mso]>
<style>
st1\:*{behavior:url(#default#ieooui) }
</style>
<![endif]-->
<style>
<!--
 /* Style Definitions */
 p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0in;
	margin-bottom:.0001pt;
	font-size:12.0pt;
	font-family:"Times New Roman";}
a:link, span.MsoHyperlink
	{color:blue;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{color:purple;
	text-decoration:underline;}
span.EmailStyle17
	{mso-style-type:personal-compose;
	font-family:"Times New Roman";
	color:windowtext;
	font-weight:normal;
	font-style:normal;
	text-decoration:none none;}
@page Section1
	{size:8.5in 11.0in;
	margin:1.0in 1.25in 1.0in 1.25in;}
div.Section1
	{page:Section1;}
-->
</style>
<!--[if gte mso 9]><xml>
 <o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
 <o:shapelayout v:ext=3D"edit">
  <o:idmap v:ext=3D"edit" data=3D"1" />
 </o:shapelayout></xml><![endif]-->
</head>

<body lang=3DEN-US link=3Dblue vlink=3Dpurple>

<div class=3DSection1>

I have Windows OpenAFS client&nbsp; 1.7.1500 on a 32-bit machine =
with
Windows XP and a&nbsp; 100 mbit/s network interface. Line rate between =
the
client&#8217;s port and the target AFS file server is ca. 96 mbit/s for =
UDP, in
both directions (measured with iperf).<o:p></o:p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'><o:p>&nbsp;</o:p></span></font></p>

When I copy a single large file (ca. 1 GB) from the server to =
the
client machine, I see a network utilization maxed at ca. 70 mbit/s, and =
timing
the file transfer yields a similar overall rate. When I copy the same =
file from
the client to the server, network utilization is 30 mbit/s at the =
maximum.
Copying is always preceded by &#8220;fs =
flushall&#8221;.<o:p></o:p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'><o:p>&nbsp;</o:p></span></font></p>

My first question is why copying from the client to the file =
server is
so much slower (by a factor of&nbsp; 2 or 3) than the other way around. =
The
other question is why the network utilization, at least as reported =
under
Windows, never approaches the line rate, even at quiet times, but rather =
stays
below the caps of 70 and 30 percent.<o:p></o:p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>The client configuration parameters =
are:<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>Cache size: 800 Mbytes<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>Chunk size: 8192 Kbytes<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>Daemons: 16<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>RxMaxMTU: 9000<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>Sec. level: 1<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>Server threads: 40<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>Stats: 20000 entries<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'><o:p>&nbsp;</o:p></span></font></p>

The machine has 3.45 Gbytes of RAM, and the paging file size is =
set at
5.3 Gbytes. <o:p></o:p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>I have consulted this post:<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'><a
href=3D"http://blog.secure-endpoints.com/2008/03/i-want-my-openafs-window=
s-client-to-be.html">http://blog.secure-endpoints.com/2008/03/i-want-my-o=
penafs-windows-client-to-be.html</a><b><span
style=3D'font-weight:bold'><o:p></o:p></span></b></span></font></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>but have not been able to improve the transfer rates by tweaking =
the
client&#8217;s parameters.<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>Thank you for any help.<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>Danko Antolovic<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>Principal Scientist, Research =
Technologies,<o:p></o:p></span></font></p>

<p class=3DMsoNormal><st1:place w:st=3D"on"><st1:PlaceName =
w:st=3D"on"><font size=3D3
  face=3D"Times New Roman"><span =
style=3D'font-size:12.0pt'>Indiana</span></font></st1:PlaceName>
 <st1:PlaceType =
w:st=3D"on">University</st1:PlaceType></st1:place><o:p></o:p></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'><o:p>&nbsp;</o:p></span></font></p>

</div>

</body>

</html>

------=_NextPart_000_0003_01CD5938.AD9F20A0--