[OpenAFS] Speed of replication

Sven Oehme oehmes@de.ibm.com
Mon, 21 Feb 2005 16:01:35 +0100


This is a multipart message in MIME format.
--=_alternative 00528AECC1256FAF_=
Content-Type: text/plain; charset="US-ASCII"

what os are you running, and post your BosConfig 

if you run linux please add the output from ifconfig -a and ethtool eth0 
and eth1 if you have multiple adapters ..

Sven
-------------------------------------------------------------------------------------------------------------------------
Dept. A153,  STG/ISC EMEA AIS Strategy and Architecture
Development Leader Stonehenge 
IBM intranet ---> http://w3.ais.mainz.de.ibm.com/stonehenge/
internet ---> http://www-5.ibm.com/services/de/storage/stonehenge.html
Phone (+49)-6131-84-3151
Fax      (+49)-6131-84-6708
Mobil   (+49)-171-970-6664
E-Mail : oehmes@de.ibm.com



Turbo Fredriksson <turbo@bayour.com> 
Sent by: openafs-info-admin@openafs.org
20/02/2005 13:12

To
openafs-info@openafs.org
cc

Subject
[OpenAFS] Speed of replication






I had a long talk with a friend of mine a few weeks ago that now
works at KTH (Stockholm, Sweden) about AFS, replication and long
running jobs (webservers etc).

One notable thing was that my replication takes AGES, whereas
theirs takes a matter of seconds (for roughly the same data).


I only have one AFS server (Sun Blade 1000, 2x750MHz Ultra III,
1Gb memory) with all the volumes on two software RAID5 (behind
a Symbios Logic 53c875 SCSI controller w/ two channels).

There are two AFS partitions (i.e. two RAID5 devices) - 'a' and
'b'. I've tried my best to split the disks evenly on both channels
to try to increase speed.


Doing a full replication of a volume that have roughly 1.3Gb data
takes me 76 minutes (all three steps below). This replication is
done from partition 'a' to partition 'b' on the same server.


I see that the replication is done in tree steps:
  1. Cloning                                             Takes about  8 
minutes
  2. Forwarding                 Takes about 60 minutes
  3. Deleting release volume    Takes about  8 minutes

With this, I get 288Kb/second. Seems _VERY_ (!!) slow... ?
Any ideas? Where should I start looking?

----- s n i p -----
user.turbo.src.mine
    RWrite: 536871340     ROnly: 536871341
    number of sites -> 2
       server aurora.bayour.com partition /vicepa RW Site
       server aurora.bayour.com partition /vicepb RO Site
This is a complete release of the volume 536871340
----- s n i p -----
_______________________________________________
OpenAFS-info mailing list
OpenAFS-info@openafs.org
https://lists.openafs.org/mailman/listinfo/openafs-info


--=_alternative 00528AECC1256FAF_=
Content-Type: text/html; charset="US-ASCII"


<br><font size=2 face="sans-serif">what os are you running, and post your
BosConfig </font>
<br>
<br><font size=2 face="sans-serif">if you run linux please add the output
from ifconfig -a and ethtool eth0 and eth1 if you have multiple adapters
..</font>
<br>
<br><font size=2 face="sans-serif">Sven<br>
-------------------------------------------------------------------------------------------------------------------------<br>
Dept. A153, &nbsp;STG/ISC EMEA AIS Strategy and Architecture<br>
Development Leader Stonehenge <br>
IBM intranet ---&gt; http://w3.ais.mainz.de.ibm.com/stonehenge/<br>
internet ---&gt; http://www-5.ibm.com/services/de/storage/stonehenge.html<br>
Phone (+49)-6131-84-3151<br>
Fax &nbsp; &nbsp; &nbsp;(+49)-6131-84-6708<br>
Mobil &nbsp; (+49)-171-970-6664<br>
E-Mail : oehmes@de.ibm.com</font>
<br>
<br>
<br>
<table width=100%>
<tr valign=top>
<td width=40%><font size=1 face="sans-serif"><b>Turbo Fredriksson &lt;turbo@bayour.com&gt;</b>
</font>
<br><font size=1 face="sans-serif">Sent by: openafs-info-admin@openafs.org</font>
<p><font size=1 face="sans-serif">20/02/2005 13:12</font>
<td width=59%>
<table width=100%>
<tr>
<td>
<div align=right><font size=1 face="sans-serif">To</font></div>
<td valign=top><font size=1 face="sans-serif">openafs-info@openafs.org</font>
<tr>
<td>
<div align=right><font size=1 face="sans-serif">cc</font></div>
<td valign=top>
<tr>
<td>
<div align=right><font size=1 face="sans-serif">Subject</font></div>
<td valign=top><font size=1 face="sans-serif">[OpenAFS] Speed of replication</font></table>
<br>
<table>
<tr valign=top>
<td>
<td></table>
<br></table>
<br>
<br>
<br><font size=2><tt>I had a long talk with a friend of mine a few weeks
ago that now<br>
works at KTH (Stockholm, Sweden) about AFS, replication and long<br>
running jobs (webservers etc).<br>
<br>
One notable thing was that my replication takes AGES, whereas<br>
theirs takes a matter of seconds (for roughly the same data).<br>
<br>
<br>
I only have one AFS server (Sun Blade 1000, 2x750MHz Ultra III,<br>
1Gb memory) with all the volumes on two software RAID5 (behind<br>
a Symbios Logic 53c875 SCSI controller w/ two channels).<br>
<br>
There are two AFS partitions (i.e. two RAID5 devices) - 'a' and<br>
'b'. I've tried my best to split the disks evenly on both channels<br>
to try to increase speed.<br>
<br>
<br>
Doing a full replication of a volume that have roughly 1.3Gb data<br>
takes me 76 minutes (all three steps below). This replication is<br>
done from partition 'a' to partition 'b' on the same server.<br>
<br>
<br>
I see that the replication is done in tree steps:<br>
 &nbsp;1. Cloning &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;
&nbsp; &nbsp; Takes about &nbsp;8 minutes<br>
 &nbsp;2. Forwarding &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;
Takes about 60 minutes<br>
 &nbsp;3. Deleting release volume &nbsp; &nbsp;Takes about &nbsp;8 minutes<br>
<br>
With this, I get 288Kb/second. Seems _VERY_ (!!) slow... ?<br>
Any ideas? Where should I start looking?<br>
<br>
----- s n i p -----<br>
user.turbo.src.mine<br>
 &nbsp; &nbsp;RWrite: 536871340 &nbsp; &nbsp; ROnly: 536871341<br>
 &nbsp; &nbsp;number of sites -&gt; 2<br>
 &nbsp; &nbsp; &nbsp; server aurora.bayour.com partition /vicepa RW Site<br>
 &nbsp; &nbsp; &nbsp; server aurora.bayour.com partition /vicepb RO Site<br>
This is a complete release of the volume 536871340<br>
----- s n i p -----<br>
_______________________________________________<br>
OpenAFS-info mailing list<br>
OpenAFS-info@openafs.org<br>
https://lists.openafs.org/mailman/listinfo/openafs-info<br>
</tt></font>
<br>
--=_alternative 00528AECC1256FAF_=--