[OpenAFS] Tips for increasing throughput

[Matt W. Benjamin]

Hi,

Well, others will have more to say about versions, but I imagine the recommendation will be to have more modern servers and clients.  Also, as you suggest, the EC2 environment might very well put afs at a disadvantage, for example, there might be NAT (though I have no real idea).  It's not really surprising that AFS doesn't compete well with SCP in this environment, though again, people have been working on performance of the existing UDP transport, as well as on a TCP transport which I might expect to do better.

Matt

----- "Ken Elkabany" <Ken@Elkabany.com> wrote:

> We're using 1.4.14 on the file servers (Ubuntu Natty) and 1.4.12 on
> the clients (Ubuntu Lucid). We don't know many details about the
> network topology as our servers are sitting on EC2, though as I stated
> previously, our scp benchmarks are significantly faster.
> 
> 
> The fileserver configuration is the default from the repository:
> /usr/lib/openafs/fileserver -p 23 -busyat 600 -rxpck 400 -s 1200 -l
> 1200 -cb 65535 -b 240 -vc 1200
> 
> 
> 
> On Wed, Aug 31, 2011 at 6:01 AM, Matt W. Benjamin < matt@linuxbox.com
> > wrote:
> 
> 
> Hi,
> 
> I think some more detail on the network/network path would be helpful.
> 
> Regards,
> 
> Matt
> 
> 
> 
> 
> ----- "Ken Elkabany" <Ken@Elkabany.com> wrote:
> 
> > Hi,
> >
> >
> > On a network capable of scp-ing files between machines at 60MB/sec,
> we
> > are only able to achieve 2-3MB/sec of throughput when using AFS.
> We've
> > been conducting tests on 300MB files, by copying them from the
> /afs/*
> > mount to the local filesystem with memcache enabled. In production,
> we
> > will not be using memcache, but we wanted to eliminate the overhead
> of
> > the on-disk cache manager. We've tried tweaking our options as
> > follows: "-verbose -nosettime -memcache -chunksize 20 -stat 2800
> > -daemons 5 -volumes 128". The most important option is the
> chunksize,
> > which did not have a measurable effect. Any other tips?
> >
> >
> > Thanks!
> > Ken
> 
> --
> 
> Matt Benjamin
> 
> The Linux Box
> 206 South Fifth Ave. Suite 150
> Ann Arbor, MI 48104
> 
> http://linuxbox.com
> 
> tel. 734-761-4689
> fax. 734-769-8938
> cel. 734-216-5309

-- 

Matt Benjamin

The Linux Box
206 South Fifth Ave. Suite 150
Ann Arbor, MI  48104

http://linuxbox.com

tel. 734-761-4689
fax. 734-769-8938
cel. 734-216-5309