[OpenAFS] Re: OpenAFS-info digest, Vol 1 #1859 - 2 msgs

Rob megarob@gmail.com
Thu, 1 Jul 2004 21:02:25 +0200

Currently around 4 million page views per day, maybe around 10 or 15
million file requests overall.. spread across 15 web servers now.
Generally the bulk of the traffic is to newly uploaded pages and
related files which lasts for a few days before they fade into
obscurity at least until googlebot comes visiting. There can be
several hundred or possibly thousands of new files each day. I was
thinking of spreading it across more servers.. maybe 25 or 30 with
each running afs client and server (to make a very BIG disk!).


On Thu,  1 Jul 2004 12:01:05 -0400 (EDT),
openafs-info-request@openafs.org <openafs-info-request@openafs.org>
> Date: Thu, 1 Jul 2004 09:08:15 -0400 (EDT)
> From: Derrick J Brashear <shadow@dementia.org>
> To: openafs-info@openafs.org
> Subject: Re: [OpenAFS] AFS suitability for hosting..
> On Thu, 1 Jul 2004, Rob wrote:
> > Hi,
> >
> > I've been thinking of using AFS for a (existing) hosting system but
> > not sure if its really suitable..
> >
> > First - can servers running afs server and client along with apache
> > (on linux) handle high traffic? Does afs use a lot of resources
> > (cpu/memory) in such a case?
> how high traffic? how much of the traffic is the same data set?
> > Second - currently the users do not actually have system accounts at
> > all - authentication including ftp is handled through a mysql db..  as
> > the users do not have 'real' accounts I don't want to create afs
> > accounts for them all either.. just directories on the afs 'disk'
> > which will then be handled in the same way as we do now.  Can I create
> > volumes that are writable by all ftp users, assuming they already
> > authenticated through my current db and the ftp server restricts them
> > to their home directories, without authenticating again through afs?
> either by authenticating the ftpd itself to afs and then enforcing access
> control as you do now (and Carnegie Mellon does this for its web
> publishing system) or by using an IP based ACL allowing the ftpd to write.
> I recommend the former.
> > Final question (for now ;)) - from what I can make out from the docs,
> > replication is based on volumes and when a single file is changed or a
> > new file is uploaded in a volume then the entire volume has to be
> > replicated each time rather than just replicating that file - is that
> > true?
> no.
> unless you vos release -f only what's changed gets pushed.
> --__--__--