[OpenAFS] Re: WAN speed

Jeffrey Altman jaltman@your-file-system.com
Thu, 22 Mar 2012 16:16:38 -0400


This is an OpenPGP/MIME signed message (RFC 2440 and 3156)
--------------enigF2E1C246B333477DFADA22C1
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

On 3/22/2012 3:43 PM, jukka.tuominen@finndesign.fi wrote:
>=20
> Hi all,
>=20
> here are some ping results outside LAN:
>=20
> 1.62  1.80  1.62  2.33  1.69  1.64  1.75  2.35  5.77  3.85  4.69  2.73 =
=2E..
>=20
> The internet speed is the same 100/5.
>=20
> I just moved ~20M/~2000 files
>   AFS to SSH server ~220KB/s
>   SSH server to AFS ~80KB/s
>=20
> The client was in WAN this time, whereas both servers where in the same=

> LAN (not sure it they knew it :).
>=20
> br, jukka

On average your files are 10K.  10K is smaller than both the RPC
chunksize and the window size.  For each read or write of a file there
will be a single RPC.

The big difference is going to occur due to directory operations.  When
writing to AFS you are going to issue a CreateFile RPC for each file
entry.  When you read from AFS you are going to issue one
InlineBulkStatus RPC for each 50 entries in the directory.  In other
words, 2000 RPCs when writing and 400 RPCs when reading.

Ping times are not representative of baseline RPC latency nor will they
include client side file system overhead for the two different execution
paths.

You will see very different results if you read and write a single 20MB
file or even a 1GB file.  For maximum throughput with large files and
the OpenAFS master source code branch you can use a window size of 254
and a chunksize of 8MB.  Increasing the window size and the chunksize
have no impact when the file sizes are small as they are in your test.

Jeffrey Altman


--------------enigF2E1C246B333477DFADA22C1
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (MingW32)

iQEcBAEBAgAGBQJPa4irAAoJENxm1CNJffh4Y88H/AjL4/lWkWXtD0DJJZSmpNmn
gDfQTMVKl8qvHmyyCiuYCQfXCL3J2gNKXWXF+qKIva+zB6gEKfGa38Q/hfK5kRAH
fAe8/s6kMeL31nSdv0mk8LBIc7Da/W9RV9sqcXzkWg8pDM9OMjZS5eAtMTx0Zaro
wPExUsAvOzq2gExfn2+bkyz5HE0GoETb/8bjVICZHMAYoYQVRXdGenw+aJJbaaSt
d4rhGbx/6pCaEtuwxgUT9aRorX1Mt+GV8Qb/2WObj7c4xaENv1b3x1oGhuKZzb2w
nnBWFSrilUIAUD2BpC4yprPuBew6+qPynkurb2x1upqJKHuizUvExR8tP/b7FjE=
=Ucw1
-----END PGP SIGNATURE-----

--------------enigF2E1C246B333477DFADA22C1--