[OpenAFS] HELP! - We've lost our sync site
Mosley, Mike
jmmosley@uncc.edu
Sat, 10 Jan 2004 13:49:35 -0500
This message is in MIME format. Since your mail reader does not understand
this format, some or all of this message may not be legible.
------_=_NextPart_001_01C3D7AA.7DFD72C0
Content-Type: text/plain
All,
We need some quick advice. Beginning about 5-6 hours ago we no
longer have a sync site. All 3 of our database servers are up and can see
each other and seem to be voting for the lowest IP address as they should.
We've tried various scenarios of stopping and restarting the processes on
the machines to try to get it straightened out. Here's wheat udebug reports
on the machine that should be elected:
as-sm1# udebug as-sm1 7002 -long
Host's addresses are: 152.15.10.70
Host's 152.15.10.70 time is Sat Jan 10 13:22:20 2004
Local time is Sat Jan 10 13:22:20 2004 (time differential 0 secs)
Last yes vote for 152.15.10.70 was 5 secs ago (not sync site);
Last vote started 5 secs ago (at Sat Jan 10 13:22:15 2004)
Local db version is 1073480540.254
I am not sync site
Lowest host 152.15.10.70 was set 5 secs ago
Sync host 0.0.0.0 was set 1073758940 secs ago
Sync site's db version is 1073480540.254
0 locked pages, 0 of them for write
Server (152.15.13.7): (db 0.0)
last vote rcvd 8 secs ago (at Sat Jan 10 13:22:12 2004),
last beacon sent 5 secs ago (at Sat Jan 10 13:22:15 2004), last vote was
yes
dbcurrent=0, up=1 beaconSince=1
Server (152.15.30.27): (db 0.0)
last vote rcvd 6 secs ago (at Sat Jan 10 13:22:14 2004),
last beacon sent 5 secs ago (at Sat Jan 10 13:22:15 2004), last vote was
yes
dbcurrent=0, up=1 beaconSince=1
as-sm1#
as-sm1#
as-sm1#
as-sm1#
as-sm1#
as-sm1# udebug as-sm1 7003 -long
Host's addresses are: 152.15.10.70
Host's 152.15.10.70 time is Sat Jan 10 13:23:12 2004
Local time is Sat Jan 10 13:23:13 2004 (time differential 1 secs)
Last yes vote for 152.15.10.70 was 9 secs ago (not sync site);
Last vote started 9 secs ago (at Sat Jan 10 13:23:04 2004)
Local db version is 1073475763.1095
I am not sync site
Lowest host 152.15.10.70 was set 9 secs ago
Sync host 0.0.0.0 was set 1073758992 secs ago
Sync site's db version is 1073475763.1095
0 locked pages, 0 of them for write
Server (152.15.13.7): (db 0.0)
last vote rcvd 10 secs ago (at Sat Jan 10 13:23:03 2004),
last beacon sent 9 secs ago (at Sat Jan 10 13:23:04 2004), last vote was
yes
dbcurrent=0, up=1 beaconSince=1
Server (152.15.30.27): (db 0.0)
last vote rcvd 9 secs ago (at Sat Jan 10 13:23:04 2004),
last beacon sent 9 secs ago (at Sat Jan 10 13:23:04 2004), last vote was
yes
dbcurrent=0, up=1 beaconSince=1
as-sm1#
as-sm1#
as-sm1#
as-sm1#
as-sm1# udebug as-sm2 7002 -long
Host's addresses are: 152.15.13.7
Host's 152.15.13.7 time is Sat Jan 10 13:23:36 2004
Local time is Sat Jan 10 13:23:39 2004 (time differential 3 secs)
Last yes vote for 152.15.10.70 was 6 secs ago (not sync site);
Last vote started 5 secs ago (at Sat Jan 10 13:23:34 2004)
Local db version is 1073480540.254
I am not sync site
Lowest host 152.15.10.70 was set 6 secs ago
Sync host 0.0.0.0 was set 1073759016 secs ago
Sync site's db version is 1073480540.254
0 locked pages, 0 of them for write
Server (152.15.10.70): (db 0.0)
last vote rcvd 627 secs ago (at Sat Jan 10 13:13:12 2004),
last beacon sent 627 secs ago (at Sat Jan 10 13:13:12 2004), last vote
was n
o
dbcurrent=0, up=1 beaconSince=1
Server (152.15.30.27): (db 0.0)
last vote never rcvd
last beacon never sent
dbcurrent=0, up=1 beaconSince=0
as-sm1#
as-sm1#
as-sm1#
as-sm1#
as-sm1#
as-sm1#
as-sm1#
as-sm1#
as-sm1#
as-sm1# udebug as-sm1 7002 -long
Host's addresses are: 152.15.10.70
Host's 152.15.10.70 time is Sat Jan 10 13:25:15 2004
Local time is Sat Jan 10 13:25:17 2004 (time differential 2 secs)
Last yes vote for 152.15.10.70 was 8 secs ago (not sync site);
Last vote started 8 secs ago (at Sat Jan 10 13:25:09 2004)
Local db version is 1073480540.254
I am not sync site
Lowest host 152.15.10.70 was set 8 secs ago
Sync host 0.0.0.0 was set 1073759115 secs ago
Sync site's db version is 1073480540.254
0 locked pages, 0 of them for write
Server (152.15.13.7): (db 0.0)
last vote rcvd 10 secs ago (at Sat Jan 10 13:25:07 2004),
last beacon sent 8 secs ago (at Sat Jan 10 13:25:09 2004), last vote was
yes
dbcurrent=0, up=1 beaconSince=1
Server (152.15.30.27): (db 0.0)
last vote rcvd 8 secs ago (at Sat Jan 10 13:25:09 2004),
last beacon sent 8 secs ago (at Sat Jan 10 13:25:09 2004), last vote was
yes
dbcurrent=0, up=1 beaconSince=1
as-sm1# cd /usr/afs
as-sm1# ls
bin db etc local logs
as-sm1# cd etc
as-sm1# ls
CellServDB KeyFile License ThisCell UserList
as-sm1#
as-sm1#
as-sm1#
as-sm1# cd /usr/afs/
as-sm1# ls
bin db etc local logs
as-sm1# cd local
as-sm1# ls
BosConfig kaserverauxdb
as-sm1# ls -la
total 374
drwx------ 2 root sys 512 Jan 7 06:35 .
drwxr-xr-x 7 root sys 512 Jun 25 2003 ..
-rw-r--r-- 1 root root 266 Jan 7 06:35 BosConfig
-rw------- 1 root root 174216 Jan 10 12:40 kaserverauxdb
as-sm1# cd ..
as-sm1# ls
bin db etc local logs
as-sm1# cd etc
as-sm1# ls -la
total 14
drwxr-xr-x 2 root sys 512 Jun 25 2003 .
drwxr-xr-x 7 root sys 512 Jun 25 2003 ..
-rw-r--r-- 1 root sys 141 Feb 26 2003 CellServDB
-rw------- 1 root other 100 Mar 3 2003 KeyFile
-rw------- 1 root other 9 Mar 3 2003 License
-rwxr-xr-x 1 root sys 9 Nov 22 2002 ThisCell
-rw------- 1 root other 13 Mar 3 2003 UserList
as-sm1# cd ..
as-sm1# ls
bin db etc local logs
as-sm1# cd logs
as-sm1# ls
AuthLog AuthLog.old BackupLog BosLog.old PtLog.old VLLog.old
AuthLog.dir AuthLog.pag BosLog PtLog VLLog
as-sm1# tail PtLog
Sat Jan 10 12:59:33 2004 Using 152.15.10.70 as my primary address
Sat Jan 10 13:11:54 2004 ubik: A Remote Server has addresses: Sat Jan 10
13:11:5
4 2004 152.15.13.7 Sat Jan 10 13:11:54 2004
Sat Jan 10 13:12:04 2004 ubik:server 152.15.13.7 is back up: will be
contacted t
hrough 152.15.13.7
Sat Jan 10 13:16:49 2004 ubik: A Remote Server has addresses: Sat Jan 10
13:16:4
9 2004 152.15.30.27 Sat Jan 10 13:16:49 2004
Sat Jan 10 13:16:50 2004 ubik:server 152.15.30.27 is back up: will be
contacted
through 152.15.30.27
as-sm1#
as-sm1#
as-sm1#
as-sm1#
as-sm1# tail VLLog.old
Wed Jan 7 06:35:10 2004 Using 152.15.10.70 as my primary address
Wed Jan 7 06:35:10 2004 Starting AFS vlserver 4 (/usr/afs/bin/vlserver)
as-sm1# tail PtLog.old
Wed Jan 7 06:35:10 2004 Using 152.15.10.70 as my primary address
as-sm1# ls
AuthLog AuthLog.old BackupLog BosLog.old PtLog.old VLLog.old
AuthLog.dir AuthLog.pag BosLog PtLog VLLog
as-sm1# tail AuthLog
kerberos5/udp is unknown; check /etc/services. Using port=88 as default
sing level crypt for Ubik connections.
Sat Jan 10 12:59:33 2004 Using 152.15.10.70 as my primary address
Sat Jan 10 12:59:47 2004 Starting to process AuthServer requests
Starting to listen for UDP packets
start 5 min check lwp
Sat Jan 10 13:11:54 2004 ubik: A Remote Server has addresses: Sat Jan 10
13:11:5
4 2004 152.15.13.7 Sat Jan 10 13:11:54 2004
Sat Jan 10 13:12:18 2004 ubik:server 152.15.13.7 is back up: will be
contacted t
hrough 152.15.13.7
Sat Jan 10 13:16:49 2004 ubik: A Remote Server has addresses: Sat Jan 10
13:16:4
9 2004 152.15.30.27 Sat Jan 10 13:16:49 2004
Sat Jan 10 13:16:55 2004 ubik:server 152.15.30.27 is back up: will be
contacted
through 152.15.30.27
as-sm1#
as-sm1#
as-sm1#
as-sm1#
as-sm1#
as-sm1#
as-sm1#
as-sm1#
as-sm1#
as-sm1#
as-sm1#
as-sm1#
as-sm1# udebug 7002 as-sm1
udebug: can't resolve port name as-sm1
as-sm1# udebug as-sm1 7002 -long
Host's addresses are: 152.15.10.70
Host's 152.15.10.70 time is Sat Jan 10 13:45:10 2004
Local time is Sat Jan 10 13:45:12 2004 (time differential 2 secs)
Last yes vote for 152.15.10.70 was 12 secs ago (not sync site);
Last vote started 12 secs ago (at Sat Jan 10 13:45:00 2004)
Local db version is 1073480540.254
I am not sync site
Lowest host 152.15.10.70 was set 12 secs ago
Sync host 0.0.0.0 was set 1073760310 secs ago
Sync site's db version is 1073480540.254
0 locked pages, 0 of them for write
Server (152.15.13.7): (db 0.0)
last vote rcvd 15 secs ago (at Sat Jan 10 13:44:57 2004),
last beacon sent 12 secs ago (at Sat Jan 10 13:45:00 2004), last vote
was ye
s
dbcurrent=0, up=1 beaconSince=1
Server (152.15.30.27): (db 0.0)
last vote rcvd 12 secs ago (at Sat Jan 10 13:45:00 2004),
last beacon sent 12 secs ago (at Sat Jan 10 13:45:00 2004), last vote
was ye
s
dbcurrent=0, up=1 beaconSince=1
as-sm1#
The only odd thing we have noticed is that when we tried stopping and
starting the other servers, at one point this server did think he was the
sync site but he indicated that he was a sync site for a negative amount of
time. It appears that the time referred to about the time we started seeing
problems as indicated by the time stamp on the local database files.
Our database servers are Solaris 9 running OpenAFS 1.2.10
We have run out of ideas. What can we do to debug/troubleshoot this
problem? We are in a desperate situation at this point.
Mike
------_=_NextPart_001_01C3D7AA.7DFD72C0
Content-Type: text/html
Content-Transfer-Encoding: quoted-printable
<html>
<head>
<META HTTP-EQUIV=3D"Content-Type" CONTENT=3D"text/html; =
charset=3DUS-ASCII">
<meta name=3DGenerator content=3D"Microsoft Word 10 (filtered)">
<style>
<!--
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman";}
a:link, span.MsoHyperlink
{color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{color:purple;
text-decoration:underline;}
span.EmailStyle17
{font-family:Arial;
color:windowtext;}
@page Section1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;}
div.Section1
{page:Section1;}
-->
</style>
</head>
<body lang=3DEN-US link=3Dblue vlink=3Dpurple>
<div class=3DSection1>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>All,</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>  =
; We
need some quick advice. Beginning about 5-6 hours ago we no longer have =
a sync
site. All 3 of our database servers are up and can see each other and =
seem to
be voting for the lowest IP address as they should. We've tried
various scenarios of stopping and restarting the processes on the =
machines to
try to get it straightened out. Here's wheat udebug reports on =
the
machine that should be elected:</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> </span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> </span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# udebug as-sm1 7002 -long</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Host's addresses are: 152.15.10.70</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Host's 152.15.10.70 time is Sat Jan 10 =
</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>13:22:20</span></font><font=
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> 2004</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Local time is Sat Jan 10 </span></font><font
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>13:22:20</span></font><font=
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> 2004 (time
differential 0 secs)</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Last yes vote for 152.15.10.70 was 5 secs ago (not =
sync
site);</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Last vote started 5 secs ago (at Sat Jan 10 =
</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>13:22:15</span></font><font=
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> 2004)</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Local db version is 1073480540.254</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>I am not sync site</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Lowest host 152.15.10.70 was set 5 secs =
ago</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Sync host 0.0.0.0 was set 1073758940 secs ago</span><=
/font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Sync site's db version is =
1073480540.254</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>0 locked pages, 0 of them for =
write</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> </span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Server (152.15.13.7): (db 0.0)</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> last vote rcvd 8 secs ago (at Sat =
Jan 10 </span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>13:22:12</span></font><font=
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> 2004),</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> last beacon sent 5 secs ago (at =
Sat Jan
10 </span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>13:22:15</span></font><font size=3D2 =
face=3DArial><span
style=3D'font-size:10.0pt;font-family:Arial'> 2004), last vote was =
yes</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> dbcurrent=3D0, up=3D1 =
beaconSince=3D1</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> </span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Server (152.15.30.27): (db 0.0)</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> last vote rcvd 6 secs ago (at Sat =
Jan 10 </span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>13:22:14</span></font><font=
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> 2004),</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> last beacon sent 5 secs ago (at =
Sat Jan
10 </span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>13:22:15</span></font><font size=3D2 =
face=3DArial><span
style=3D'font-size:10.0pt;font-family:Arial'> 2004), last vote was =
yes</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> dbcurrent=3D0, up=3D1 =
beaconSince=3D1</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# udebug as-sm1 7003 -long</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Host's addresses are: 152.15.10.70</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Host's 152.15.10.70 time is Sat Jan 10 =
</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>13:23:12</span></font><font=
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> 2004</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Local time is Sat Jan 10 </span></font><font
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>13:23:13</span></font><font=
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> 2004 (time
differential 1 secs)</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Last yes vote for 152.15.10.70 was 9 secs ago (not =
sync
site);</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Last vote started 9 secs ago (at Sat Jan 10 =
</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>13:23:04</span></font><font=
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> 2004)</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Local db version is =
1073475763.1095</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>I am not sync site</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Lowest host 152.15.10.70 was set 9 secs =
ago</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Sync host 0.0.0.0 was set 1073758992 secs =
ago</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Sync site's db version is =
1073475763.1095</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>0 locked pages, 0 of them for =
write</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> </span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Server (152.15.13.7): (db 0.0)</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> last vote rcvd 10 secs ago (at =
Sat Jan 10
</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:
Arial'>13:23:03</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial'> 2004),</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> last beacon sent 9 secs ago (at =
Sat Jan
10 </span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>13:23:04</span></font><font size=3D2 =
face=3DArial><span
style=3D'font-size:10.0pt;font-family:Arial'> 2004), last vote was =
yes</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> dbcurrent=3D0, up=3D1 =
beaconSince=3D1</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> </span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Server (152.15.30.27): (db 0.0)</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> last vote rcvd 9 secs ago (at Sat =
Jan 10 </span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>13:23:04</span></font><font=
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> 2004),</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> last beacon sent 9 secs ago (at =
Sat Jan 10
</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:
Arial'>13:23:04</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial'> 2004), last vote was yes</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> dbcurrent=3D0, up=3D1 =
beaconSince=3D1</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# udebug as-sm2 7002 -long</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Host's addresses are: 152.15.13.7</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Host's 152.15.13.7 time is Sat Jan 10 =
</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>13:23:36</span></font><font=
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> 2004</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Local time is Sat Jan 10 </span></font><font
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>13:23:39</span></font><font=
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> 2004 (time
differential 3 secs)</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Last yes vote for 152.15.10.70 was 6 secs ago (not =
sync
site);</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Last vote started 5 secs ago (at Sat Jan 10 =
</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>13:23:34</span></font><font=
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> 2004)</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Local db version is 1073480540.254</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>I am not sync site</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Lowest host 152.15.10.70 was set 6 secs =
ago</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Sync host 0.0.0.0 was set 1073759016 secs =
ago</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Sync site's db version is =
1073480540.254</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>0 locked pages, 0 of them for =
write</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> </span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Server (152.15.10.70): (db 0.0)</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> last vote rcvd 627 secs ago (at =
Sat Jan
10 </span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>13:13:12</span></font><font size=3D2 =
face=3DArial><span
style=3D'font-size:10.0pt;font-family:Arial'> 2004),</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> last beacon sent 627 secs ago (at =
Sat Jan
10 </span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>13:13:12</span></font><font size=3D2 =
face=3DArial><span
style=3D'font-size:10.0pt;font-family:Arial'> 2004), last vote was =
n</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>o</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> dbcurrent=3D0, up=3D1 =
beaconSince=3D1</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> </span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Server (152.15.30.27): (db 0.0)</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> last vote never =
rcvd</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> last beacon never =
sent</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> dbcurrent=3D0, up=3D1 =
beaconSince=3D0</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# udebug as-sm1 7002 -long</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Host's addresses are: 152.15.10.70</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Host's 152.15.10.70 time is Sat Jan 10 =
</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>13:25:15</span></font><font=
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> 2004</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Local time is Sat Jan 10 </span></font><font
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>13:25:17</span></font><font=
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> 2004 (time
differential 2 secs)</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Last yes vote for 152.15.10.70 was 8 secs ago (not =
sync
site);</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Last vote started 8 secs ago (at Sat Jan 10 =
</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>13:25:09</span></font><font=
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> 2004)</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Local db version is 1073480540.254</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>I am not sync site</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Lowest host 152.15.10.70 was set 8 secs ago</span></f=
ont></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Sync host 0.0.0.0 was set 1073759115 secs =
ago</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Sync site's db version is =
1073480540.254</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>0 locked pages, 0 of them for =
write</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> </span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Server (152.15.13.7): (db 0.0)</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> last vote rcvd 10 secs ago (at =
Sat Jan 10
</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:
Arial'>13:25:07</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial'> 2004),</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> last beacon sent 8 secs ago (at =
Sat Jan
10 </span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>13:25:09</span></font><font size=3D2 =
face=3DArial><span
style=3D'font-size:10.0pt;font-family:Arial'> 2004), last vote was =
yes</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> dbcurrent=3D0, up=3D1 =
beaconSince=3D1</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> </span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Server (152.15.30.27): (db 0.0)</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> last vote rcvd 8 secs ago (at Sat =
Jan 10 </span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>13:25:09</span></font><font=
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> 2004),</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> last beacon sent 8 secs ago (at =
Sat Jan
10 </span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>13:25:09</span></font><font size=3D2 =
face=3DArial><span
style=3D'font-size:10.0pt;font-family:Arial'> 2004), last vote was =
yes</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> dbcurrent=3D0, up=3D1 =
beaconSince=3D1</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# cd /usr/afs</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# ls</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>bin db
etc local logs</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# cd etc</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# ls</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>CellServDB KeyFile
License ThisCell =
UserList</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# cd /usr/afs/</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# ls</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>bin db
etc local logs</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# cd local</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# ls</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>BosConfig =
kaserverauxdb</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# ls -la</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>total 374</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>drwx------ 2 =
root
sys 512 Jan =
7 </span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>06:35</span></font><font
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> .</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>drwxr-xr-x 7 =
root
sys 512 =
</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>Jun 25 =
2003</span></font><font
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> ..</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>-rw-r--r-- 1 =
root =
root
266 Jan 7 </span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial'>06:35</span></font><font size=3D2 =
face=3DArial><span
style=3D'font-size:10.0pt;font-family:Arial'> =
BosConfig</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>-rw------- 1 =
root root
174216 Jan 10 </span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial'>12:40</span></font><font size=3D2 =
face=3DArial><span
style=3D'font-size:10.0pt;font-family:Arial'> =
kaserverauxdb</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# cd ..</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# ls</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>bin db
etc local logs</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# cd etc</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# ls -la</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>total 14</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>drwxr-xr-x 2 =
root
sys 512 </span></f=
ont><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>Jun 25 =
2003</span></font><font
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> .</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>drwxr-xr-x 7 =
root
sys 512 =
</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>Jun 25 =
2003</span></font><font
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> ..</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>-rw-r--r-- 1 =
root
sys 141 =
</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>Feb 26 =
2003</span></font><font
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> =
CellServDB</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>-rw------- 1 =
root
other 100 </span></font><font =
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>Mar 3
2003</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> KeyFile</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>-rw------- 1 =
root
other 9 =
</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>Mar 3
2003</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> License</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>-rwxr-xr-x 1 =
root
sys 9 =
Nov 22
2002 ThisCell</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>-rw------- 1 =
root
other 13 =
</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>Mar 3
2003</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> UserList</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# cd ..</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# ls</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>bin db
etc local logs</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# cd logs</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# ls</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>AuthLog =
AuthLog.old BackupLog
BosLog.old PtLog.old =
VLLog.old</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>AuthLog.dir AuthLog.pag =
BosLog
PtLog VLLog</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# tail PtLog</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Sat Jan 10 </span></font><font size=3D2 =
face=3DArial><span
=
style=3D'font-size:10.0pt;font-family:Arial'>12:59:33</span></font><font=
size=3D2
face=3DArial><span style=3D'font-size:10.0pt;font-family:Arial'> 2004 =
Using
152.15.10.70 as my primary address</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Sat Jan 10 </span></font><font size=3D2 =
face=3DArial><span
=
style=3D'font-size:10.0pt;font-family:Arial'>13:11:54</span></font><font=
size=3D2
face=3DArial><span style=3D'font-size:10.0pt;font-family:Arial'> 2004 =
ubik: A
Remote Server has addresses: Sat Jan 10 13:11:5</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>4 2004 152.15.13.7 Sat Jan 10 </span></font><font =
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>13:11:54</span></font><font=
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> 2004</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Sat Jan 10 </span></font><font size=3D2 =
face=3DArial><span
=
style=3D'font-size:10.0pt;font-family:Arial'>13:12:04</span></font><font=
size=3D2
face=3DArial><span style=3D'font-size:10.0pt;font-family:Arial'> 2004 =
ubik:server
152.15.13.7 is back up: will be contacted t</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>hrough 152.15.13.7</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Sat Jan 10 </span></font><font size=3D2 =
face=3DArial><span
=
style=3D'font-size:10.0pt;font-family:Arial'>13:16:49</span></font><font=
size=3D2
face=3DArial><span style=3D'font-size:10.0pt;font-family:Arial'> 2004 =
ubik: A
Remote Server has addresses: Sat Jan 10 13:16:4</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>9 2004 152.15.30.27 Sat Jan 10 </span></font><font =
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>13:16:49</span></font><font=
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> 2004</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Sat Jan 10 </span></font><font size=3D2 =
face=3DArial><span
=
style=3D'font-size:10.0pt;font-family:Arial'>13:16:50</span></font><font=
size=3D2
face=3DArial><span style=3D'font-size:10.0pt;font-family:Arial'> 2004 =
ubik:server
152.15.30.27 is back up: will be contacted</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>through 152.15.30.27</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# tail VLLog.old</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Wed Jan 7 </span></font><font size=3D2 =
face=3DArial><span
=
style=3D'font-size:10.0pt;font-family:Arial'>06:35:10</span></font><font=
size=3D2
face=3DArial><span style=3D'font-size:10.0pt;font-family:Arial'> 2004 =
Using
152.15.10.70 as my primary address</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Wed Jan 7 </span></font><font size=3D2 =
face=3DArial><span
=
style=3D'font-size:10.0pt;font-family:Arial'>06:35:10</span></font><font=
size=3D2
face=3DArial><span style=3D'font-size:10.0pt;font-family:Arial'> 2004 =
Starting AFS vlserver
4 (/usr/afs/bin/vlserver)</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# tail PtLog.old</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Wed Jan 7 </span></font><font size=3D2 =
face=3DArial><span
=
style=3D'font-size:10.0pt;font-family:Arial'>06:35:10</span></font><font=
size=3D2
face=3DArial><span style=3D'font-size:10.0pt;font-family:Arial'> 2004 =
Using
152.15.10.70 as my primary address</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# ls</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>AuthLog =
AuthLog.old BackupLog
BosLog.old PtLog.old =
VLLog.old</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>AuthLog.dir AuthLog.pag =
BosLog
PtLog VLLog</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# tail AuthLog</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>kerberos5/udp is unknown; check /etc/services. =
Using
port=3D88 as default</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>sing level crypt for Ubik =
connections.</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Sat Jan 10 </span></font><font size=3D2 =
face=3DArial><span
=
style=3D'font-size:10.0pt;font-family:Arial'>12:59:33</span></font><font=
size=3D2
face=3DArial><span style=3D'font-size:10.0pt;font-family:Arial'> 2004 =
Using
152.15.10.70 as my primary address</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Sat Jan 10 </span></font><font size=3D2 =
face=3DArial><span
=
style=3D'font-size:10.0pt;font-family:Arial'>12:59:47</span></font><font=
size=3D2
face=3DArial><span style=3D'font-size:10.0pt;font-family:Arial'> 2004 =
Starting to
process AuthServer requests</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Starting to listen for UDP packets</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>start 5 min check lwp</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Sat Jan 10 </span></font><font size=3D2 =
face=3DArial><span
=
style=3D'font-size:10.0pt;font-family:Arial'>13:11:54</span></font><font=
size=3D2
face=3DArial><span style=3D'font-size:10.0pt;font-family:Arial'> 2004 =
ubik: A
Remote Server has addresses: Sat Jan 10 13:11:5</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>4 2004 152.15.13.7 Sat Jan 10 </span></font><font =
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>13:11:54</span></font><font=
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> 2004</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Sat Jan 10 </span></font><font size=3D2 =
face=3DArial><span
=
style=3D'font-size:10.0pt;font-family:Arial'>13:12:18</span></font><font=
size=3D2
face=3DArial><span style=3D'font-size:10.0pt;font-family:Arial'> 2004 =
ubik:server
152.15.13.7 is back up: will be contacted t</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>hrough 152.15.13.7</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Sat Jan 10 </span></font><font size=3D2 =
face=3DArial><span
=
style=3D'font-size:10.0pt;font-family:Arial'>13:16:49</span></font><font=
size=3D2
face=3DArial><span style=3D'font-size:10.0pt;font-family:Arial'> 2004 =
ubik: A
Remote Server has addresses: Sat Jan 10 13:16:4</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>9 2004 152.15.30.27 Sat Jan 10 </span></font><font =
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>13:16:49</span></font><font=
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> 2004</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Sat Jan 10 </span></font><font size=3D2 =
face=3DArial><span
=
style=3D'font-size:10.0pt;font-family:Arial'>13:16:55</span></font><font=
size=3D2
face=3DArial><span style=3D'font-size:10.0pt;font-family:Arial'> 2004 =
ubik:server
152.15.30.27 is back up: will be contacted</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>through 152.15.30.27</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# udebug 7002 as-sm1</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>udebug: can't resolve port name =
as-sm1</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1# udebug as-sm1 7002 -long</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Host's addresses are: 152.15.10.70</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Host's 152.15.10.70 time is Sat Jan 10 =
</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>13:45:10</span></font><font=
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> 2004</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Local time is Sat Jan 10 </span></font><font
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>13:45:12</span></font><font=
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> 2004 (time
differential 2 secs)</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Last yes vote for 152.15.10.70 was 12 secs ago (not =
sync
site);</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Last vote started 12 secs ago (at Sat Jan 10 =
</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'>13:45:00</span></font><font=
size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'> 2004)</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Local db version is 1073480540.254</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>I am not sync site</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Lowest host 152.15.10.70 was set 12 secs =
ago</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Sync host 0.0.0.0 was set 1073760310 secs =
ago</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Sync site's db version is =
1073480540.254</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>0 locked pages, 0 of them for =
write</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> </span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Server (152.15.13.7): (db 0.0)</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> last vote rcvd 15 secs ago (at =
Sat Jan 10
</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:
Arial'>13:44:57</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial'> 2004),</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> last beacon sent 12 secs ago (at =
Sat Jan
10 </span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>13:45:00</span></font><font size=3D2 =
face=3DArial><span
style=3D'font-size:10.0pt;font-family:Arial'> 2004), last vote was =
ye</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>s</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> dbcurrent=3D0, up=3D1 =
beaconSince=3D1</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> </span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Server (152.15.30.27): (db 0.0)</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> last vote rcvd 12 secs ago (at =
Sat Jan 10
</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;font-family:
Arial'>13:45:00</span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial'> 2004),</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> last beacon sent 12 secs ago (at =
Sat Jan
10 </span></font><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>13:45:00</span></font><font size=3D2 =
face=3DArial><span
style=3D'font-size:10.0pt;font-family:Arial'> 2004), last vote was =
ye</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>s</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> dbcurrent=3D0, up=3D1 =
beaconSince=3D1</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>as-sm1#</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span style=3D'font-siz=
e:10.0pt;
font-family:Arial'> </span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>The only odd thing we have noticed is that when we =
tried
stopping and starting the other servers, at one point this server did =
think he
was the sync site but he indicated that he was a sync site for a =
negative
amount of time. It appears that the time referred to about the =
time we
started seeing problems as indicated by the time stamp on the local =
database
files. </span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> </span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Our database servers are Solaris 9 running OpenAFS =
1.2.10</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> </span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>We have run out of ideas. What can we do to
debug/troubleshoot this problem? We are in a desperate situation =
at this
point.</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> </span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Mike</span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> </span></font></p>
<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'> </span></font></p>
</div>
</body>
</html>
------_=_NextPart_001_01C3D7AA.7DFD72C0--