[OpenAFS] UDP slowness remedies?
Dan Pritts
danno@internet2.edu
Fri, 22 Oct 2010 13:29:58 -0400
so first, i think your problem doesn't have much to do with the rate at
which the machines can send packets and has everything to do with the
chatty back-and-forth nature of the protocol. I don't really know the
protocol myself, actually, but this seems very likely; i've certainly
run into it with other protocols/applications, e.g. TSM backups and
windows file sharing.
I'm guessing you are going between Bloomington and Indianapolis so
latency shouldn't be too high, but even 10ms surely will add up if the
conversation goes back and forth a million times.
I'm pretty sure you can run multiple vos move's in parallel, which would
help dramatically.
as far as your iperf results, my experience is that tuning UDP buffers
generally is not necessary; the defaults are usually sufficient to get
hundreds of megabits.
in UDP mode, iperf does not attempt to scale the bandwidth; it tries to
send at whatever bandwidth you specify on the acommand line. the
default is 1Mbit/sec...is it possible that's where your 1mbit result
came from?
Eric Chris Garrison wrote:
> So, I'm doing a mass migration of AFS volumes from one campus to
> another. Both machines have Gigabit interfaces, and we have a 20 Gig
> link between the campuses that I understand to be not at all saturated.
>
> However, I'm seeing a transfer rate of only about 30 Mbits/sec
> (according to iftop) between the two machines. I'm working on it with
> my local network people, but it seems to be a UDP issue... if I use
> iperf with defaults for UDP, I get about 1 Mbit/sec. If I increase the
> buffer size to 1024M, it screams along at 900+ Mbit/sec.
>
> So how's this work with AFS/rx? Is there something I can tweak to
> increase UDP transfer speed?
>
> Any advice would be appreciated.
>
> Thanks,
>
> Chris
> _______________________________________________
> OpenAFS-info mailing list
> OpenAFS-info@openafs.org
> https://lists.openafs.org/mailman/listinfo/openafs-info