[OpenAFS] 1.3.x memcache performance
Horst Birthelmer
horst@riback.net
Mon, 27 Dec 2004 21:19:07 +0100
On Dec 27, 2004, at 6:20 PM, Andrej Filipcic wrote:
> On Monday 27 December 2004 17:39, Kris Van Hees wrote:
>> On Mon, Dec 27, 2004 at 05:28:14PM +0100, Andrej Filipcic wrote:
>>>>> On gigabit network, the copy speed with memcache is never larger
>>>>> than
>>>>> 20
>>>>> mbyte/s, with disk cache it can go up to 70 mbyte/s.
>>>
>>> Well, it is not actually performance. dd if=/dev/zero to afs space
>>> transfer reaches something like that. This is of course a peak
>>> number.
>>> Half of time data is written to a local disk cache with no network
>>> activity, so on average, the transfer would be 30-40 MB/s. AFS read
>>> speed
>>> is between 10-20 MB/s.
>>>
>>> New memcache parameters give similar write transfer now (~60 MB/s on
>>> average).
>>
>> So basically, you are measuring a combination of how fast you can
>> write to
>> your cache, together with how fast the AFS client can flush the data
>> from
>> the cache to the server. Do you have writebehind turned on or off on
>> your
>> AFS client? If writebehind is allowed, then you only measure writing
>> to
>> the cache + part of the flushing to the server (since flushbehind
>> allows
>> the close() system call to return before the entire file has been
>> flushed
>> to the server).
>
> No such tuning. I wanted to know why memcache client was so slow as
> compared
> to diskcache (kde login to afs home, untar, ...) when the disk load on
> the
> server was very high. The default memcache settings are obviously not
> too
> usefull...
That depends on your network, the sizes of your files and the nature of
the file access.
But that's always the problem with default values on caches. ;-)
I'm not very sure how fast your AFS client is supposed to be...
Horst