[OpenAFS] ForwardMulti sessions
Antony Mayi
Antony Mayi <antonymayi@yahoo.com>
Wed, 18 Sep 2013 09:13:19 +0100 (BST)
---432612139-316115264-1379491999=:83222
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable
Hi,=0A=0AWhen releasing a volume I can see it starting an operation called =
ForwardMulti. I have 5 remote replicas for a volume and it seems to start t=
hree ForwardMulti sessions (two with single replica fileserver (ro3, ro5) a=
nd 1 with three (ro1 + ro2 + ro4)). Based on the observation (see the relea=
se report at the bottom) the sessions are started in sequence and all repli=
cations within same session run in parallel. If each individual replication=
operation takes T_repl time it means each ForwardMulti session also takes =
T_repl time and in my case the whole release operation takes 3*T_repl time.=
That makes me to think that it could have taken only 1*T_repl time had all=
the replications been made within single ForwardMulti session.=0A=0AI don'=
t seem to be able to find any information about what the=A0ForwardMulti is =
and why some replications are made within single=A0ForwardMulti session and=
others in separate ones. Just to give some background all the roX fileserv=
ers are in same rack, on same network.=0A=0AHow can I make all the replicat=
ion to run within single=A0ForwardMulti session?=0A=0AThanks,=0AAntony.=0A=
=0A=0AThe typical release in my case produces following report:=0A=0A/usr/s=
bin/vos release proj.prj1 -verbose=0Aproj.prj1=A0=0A=A0 =A0 RWrite: 5368714=
49 =A0 =A0 ROnly: 536871450 =A0 =A0 Backup: 536871451=A0=0A=A0 =A0 number o=
f sites -> 7=0A=A0 =A0 =A0 =A0server rw1 partition /vicepa RW Site=A0=0A=A0=
=A0 =A0 =A0server rw1 partition /vicepa RO Site=A0=0A=A0 =A0 =A0 =A0server=
ro5 partition /vicepa RO Site=A0=0A=A0 =A0 =A0 =A0server ro1 partition /vi=
cepa RO Site=A0=0A=A0 =A0 =A0 =A0server ro4 partition /vicepa RO Site=A0=0A=
=A0 =A0 =A0 =A0server ro2 partition /vicepa RO Site=A0=0A=A0 =A0 =A0 =A0ser=
ver ro3 partition /vicepa RO Site=A0=0AThis is a complete release of volume=
536871449=0ARe-cloning permanent RO volume 536871450 ... done=0AGetting st=
atus of parent volume 536871449... done=0AStarting transaction on RO clone =
volume 536871450... done=0ASetting volume flags for volume 536871450... don=
e=0AEnding transaction on volume 536871450... done=0AReplacing VLDB entry f=
or proj.prj1... done=0AStarting transaction on cloned volume 536871450... d=
one=0AUpdating existing ro volume 536871450 on ro5 ...=0AStarting ForwardMu=
lti from 536871450 to 536871450 on ro5 (as of Wed Sep 18 08:23:33 2013).=0A=
Updating existing ro volume 536871450 on ro1 ...=0AUpdating existing ro vol=
ume 536871450 on ro4 ...=0AUpdating existing ro volume 536871450 on ro2 ...=
=0AStarting ForwardMulti from 536871450 to 536871450 on ro1 and ro4 and ro2=
(as of Wed Sep 18 08:23:33 2013).=0AUpdating existing ro volume 536871450 =
on ro3 ...=0AStarting ForwardMulti from 536871450 to 536871450 on ro3 (as o=
f Wed Sep 18 08:23:33 2013).=0Aupdating VLDB ... done=0AReleased volume pro=
j.prj1 successfully=0A
---432612139-316115264-1379491999=:83222
Content-Type: text/html; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable
<html><body><div style=3D"color:#000; background-color:#fff; font-family:ti=
mes new roman, new york, times, serif;font-size:12pt"><div style=3D"font-fa=
mily: 'times new roman', 'new york', times, serif; font-size: 12pt;">Hi,</d=
iv><div style=3D"font-family: 'times new roman', 'new york', times, serif; =
font-size: 12pt;"><br></div><div style=3D"font-family: 'times new roman', '=
new york', times, serif; font-size: 16px; color: rgb(0, 0, 0); background-c=
olor: transparent; font-style: normal;">When releasing a volume I can see i=
t starting an operation called ForwardMulti. I have 5 remote replicas for a=
volume and it seems to start three ForwardMulti sessions (two with single =
replica fileserver (ro3, ro5) and 1 with three (ro1 + ro2 + ro4)). Based on=
the observation (see the release report at the bottom) the sessions are st=
arted in sequence and all replications within same session run in parallel.=
If each individual replication operation takes T_repl time it means each
ForwardMulti session also takes T_repl time and in my case the whole relea=
se operation takes 3*T_repl time. That makes me to think that it could have=
taken only 1*T_repl time had all the replications been made within single =
ForwardMulti session.</div><div style=3D"font-family: 'times new roman', 'n=
ew york', times, serif; font-size: 16px; color: rgb(0, 0, 0); background-co=
lor: transparent; font-style: normal;"><br></div><div style=3D"font-family:=
'times new roman', 'new york', times, serif; font-size: 16px; color: rgb(0=
, 0, 0); background-color: transparent; font-style: normal;">I don't seem t=
o be able to find any information about what the <span style=3D"font-s=
ize: 12pt;">ForwardMulti is and why some replications are made within singl=
e </span><span style=3D"font-size: 12pt;">ForwardMulti session and oth=
ers in separate ones. Just to give some background all the roX fileservers =
are in same rack, on same network.</span></div><div style=3D"font-family:
'times new roman', 'new york', times, serif; font-size: 12pt; color: rgb(0=
, 0, 0); background-color: transparent; font-style: normal;"><span style=3D=
"font-size: 12pt;"><br></span></div><div style=3D"background-color: transpa=
rent; font-style: normal; font-size: 16px; font-family: 'times new roman', =
'new york', times, serif; color: rgb(0, 0, 0);"><span style=3D"font-size: 1=
2pt;">How can I make all the replication to run within single </span>F=
orwardMulti session?</div><div style=3D"background-color: transparent; font=
-style: normal; font-size: 12pt; font-family: 'times new roman', 'new york'=
, times, serif; color: rgb(0, 0, 0);"><br></div><div style=3D"background-co=
lor: transparent; font-style: normal; font-size: 16px; font-family: 'times =
new roman', 'new york', times, serif; color: rgb(0, 0, 0);">Thanks,</div><d=
iv style=3D"background-color: transparent; font-style: normal; font-size: 1=
6px; font-family: 'times new roman', 'new york', times, serif; color: rgb(0=
, 0,
0);">Antony.</div><div style=3D"font-family: 'times new roman', 'new york'=
, times, serif; font-size: 16px; color: rgb(0, 0, 0); background-color: tra=
nsparent; font-style: normal;"><span style=3D"font-size: 12pt;"><br></span>=
</div><div style=3D"font-family: 'times new roman', 'new york', times, seri=
f; font-size: 16px; color: rgb(0, 0, 0); background-color: transparent; fon=
t-style: normal;"><span style=3D"font-size: 12pt;"><br></span></div><div st=
yle=3D"font-family: 'times new roman', 'new york', times, serif; font-size:=
16px; color: rgb(0, 0, 0); background-color: transparent; font-style: norm=
al;"><span style=3D"font-size: 12pt;">The typical release in my case produc=
es following report:</span></div><div style=3D"font-family: 'times new roma=
n', 'new york', times, serif; font-size: 12pt; color: rgb(0, 0, 0); backgro=
und-color: transparent; font-style: normal;"><span style=3D"font-size: 12pt=
;"><br></span></div><div style=3D"background-color: transparent;"><font fac=
e=3D"times
new roman, new york, times, serif">/usr/sbin/vos release proj.prj1 -verbos=
e</font></div><div style=3D"background-color: transparent;"><font face=3D"t=
imes new roman, new york, times, serif">proj.prj1 </font></div><div st=
yle=3D"background-color: transparent;"><font face=3D"times new roman, new y=
ork, times, serif"> RWrite: 536871449 ROnly: 536=
871450 Backup: 536871451 </font></div><div style=3D"back=
ground-color: transparent;"><font face=3D"times new roman, new york, times,=
serif"> number of sites -> 7</font></div><div style=3D"bac=
kground-color: transparent;"><font face=3D"times new roman, new york, times=
, serif"> server rw1 partition /vicepa RW Site&nb=
sp;</font></div><div style=3D"background-color: transparent;"><font face=3D=
"times new roman, new york, times, serif"> server=
rw1 partition /vicepa RO Site </font></div><div style=3D"background-c=
olor:
transparent;"><font face=3D"times new roman, new york, times, serif"> =
; server ro5 partition /vicepa RO Site </font></di=
v><div style=3D"background-color: transparent;"><font face=3D"times new rom=
an, new york, times, serif"> server ro1 partition=
/vicepa RO Site </font></div><div style=3D"background-color: transpar=
ent;"><font face=3D"times new roman, new york, times, serif"> =
server ro4 partition /vicepa RO Site </font></div><div st=
yle=3D"background-color: transparent;"><font face=3D"times new roman, new y=
ork, times, serif"> server ro2 partition /vicepa =
RO Site </font></div><div style=3D"background-color: transparent;"><fo=
nt face=3D"times new roman, new york, times, serif"> &n=
bsp;server ro3 partition /vicepa RO Site </font></div><div style=3D"ba=
ckground-color: transparent;"><font face=3D"times new roman, new york, time=
s, serif">This
is a complete release of volume 536871449</font></div><div style=3D"backgr=
ound-color: transparent;"><font face=3D"times new roman, new york, times, s=
erif">Re-cloning permanent RO volume 536871450 ... done</font></div><div st=
yle=3D"background-color: transparent;"><font face=3D"times new roman, new y=
ork, times, serif">Getting status of parent volume 536871449... done</font>=
</div><div style=3D"background-color: transparent;"><font face=3D"times new=
roman, new york, times, serif">Starting transaction on RO clone volume 536=
871450... done</font></div><div style=3D"background-color: transparent;"><f=
ont face=3D"times new roman, new york, times, serif">Setting volume flags f=
or volume 536871450... done</font></div><div style=3D"background-color: tra=
nsparent;"><font face=3D"times new roman, new york, times, serif">Ending tr=
ansaction on volume 536871450... done</font></div><div style=3D"background-=
color: transparent;"><font face=3D"times new roman, new york, times, serif"=
>Replacing VLDB
entry for proj.prj1... done</font></div><div style=3D"background-color: tr=
ansparent;"><font face=3D"times new roman, new york, times, serif">Starting=
transaction on cloned volume 536871450... done</font></div><div style=3D"b=
ackground-color: transparent;"><font face=3D"times new roman, new york, tim=
es, serif">Updating existing ro volume 536871450 on ro5 ...</font></div><di=
v style=3D"background-color: transparent;"><font face=3D"times new roman, n=
ew york, times, serif">Starting ForwardMulti from 536871450 to 536871450 on=
ro5 (as of Wed Sep 18 08:23:33 2013).</font></div><div style=3D"background=
-color: transparent;"><font face=3D"times new roman, new york, times, serif=
">Updating existing ro volume 536871450 on ro1 ...</font></div><div style=
=3D"background-color: transparent;"><font face=3D"times new roman, new york=
, times, serif">Updating existing ro volume 536871450 on ro4 ...</font></di=
v><div style=3D"background-color: transparent;"><font face=3D"times new rom=
an, new york,
times, serif">Updating existing ro volume 536871450 on ro2 ...</font></div=
><div style=3D"background-color: transparent;"><font face=3D"times new roma=
n, new york, times, serif">Starting ForwardMulti from 536871450 to 53687145=
0 on ro1 and ro4 and ro2 (as of Wed Sep 18 08:23:33 2013).</font></div><div=
style=3D"background-color: transparent;"><font face=3D"times new roman, ne=
w york, times, serif">Updating existing ro volume 536871450 on ro3 ...</fon=
t></div><div style=3D"background-color: transparent;"><font face=3D"times n=
ew roman, new york, times, serif">Starting ForwardMulti from 536871450 to 5=
36871450 on ro3 (as of Wed Sep 18 08:23:33 2013).</font></div><div style=3D=
"background-color: transparent;"><font face=3D"times new roman, new york, t=
imes, serif">updating VLDB ... done</font></div><div style=3D"background-co=
lor: transparent;"><font face=3D"times new roman, new york, times, serif">R=
eleased volume proj.prj1 successfully</font></div><div><br></div></div></bo=
dy></html>
---432612139-316115264-1379491999=:83222--