[OpenAFS] Help: Volume inaccessible after incident
Franco Milicchio
fmilicchio@me.com
Mon, 01 Sep 2014 13:04:44 +0200
--Apple-Mail=_B985ED34-784E-458D-8E68-C13E89CCEC1B
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
charset=windows-1252
Dear all,
I am trying to restore my AFS web volume after an incident. The problem =
seemed to be a piece of cake, but I was wrong: the volume is still =
inaccessible.
Symptoms:
No access to the web volume (html forbidden error).
So, I=92ve logged on a client and saw this:
$ ls -l
ls: cannot access html: Connection timed out
total 6197
d????????? ? ? ? ? ? html/
-rw-r--r-- 1 milicchio diaafs 6339727 May 8 19:45 latest.zip
-rw-r--r-- 1 milicchio diaafs 218 Sep 10 2012 README.txt
-rw------- 1 milicchio diaafs 395 Jul 24 10:11 ssh-public-key
-rw-r--r-- 1 milicchio diaafs 955 Sep 10 2012 test-pc.c
drwxr-xr-x 5 milicchio diaafs 2048 May 30 10:36 wordpress/
Then, I examined it:
$ vos examine html.milicchio
Could not fetch the information about volume 536871913 from the server
: No such device
Volume does not exist on server aux.dia.uniroma3.it as indicated by the =
VLDB
Dump only information from VLDB
html.milicchio=20
RWrite: 536871913 Backup: 536871915=20
number of sites -> 1
server aux.dia.uniroma3.it partition /vicepa RW Site=20
$ ls -l
ls: cannot access html: Connection timed out
total 6197
d????????? ? ? ? ? ? html/
-rw-r--r-- 1 milicchio diaafs 6339727 May 8 19:45 latest.zip
-rw-r--r-- 1 milicchio diaafs 218 Sep 10 2012 README.txt
-rw------- 1 milicchio diaafs 395 Jul 24 10:11 ssh-public-key
-rw-r--r-- 1 milicchio diaafs 955 Sep 10 2012 test-pc.c
drwxr-xr-x 5 milicchio diaafs 2048 May 30 10:36 wordpress/
I=92ve tried some basic commands:
$ vos syncserv aux
Server aux synchronized with VLDB
$ vos syncvldb aux
VLDB synchronized with state of server aux
But it didn=92t work. So, I started salvaging, but it didn=92t work:
$ bos salvage aux -all
bos: shutting down 'fs'.
Starting salvage.
bos: waiting for salvage to complete.
bos: waiting for salvage to complete.
bos: waiting for salvage to complete.
bos: waiting for salvage to complete.
bos: waiting for salvage to complete.
bos: waiting for salvage to complete.
bos: waiting for salvage to complete.
bos: waiting for salvage to complete.
bos: salvage completed
bos: restarting fs.
milicchio:public$ ls -l
ls: cannot access html: Connection timed out
total 6197
d????????? ? ? ? ? ? html/
-rw-r--r-- 1 milicchio diaafs 6339727 May 8 19:45 latest.zip
-rw-r--r-- 1 milicchio diaafs 218 Sep 10 2012 README.txt
-rw------- 1 milicchio diaafs 395 Jul 24 10:11 ssh-public-key
-rw-r--r-- 1 milicchio diaafs 955 Sep 10 2012 test-pc.c
drwxr-xr-x 5 milicchio diaafs 2048 May 30 10:36 wordpress/
The volume now seems to be in the VLDB and on the server, since vos =
doesn=92t bark:
$ vos examine html.milicchio
html.milicchio 536871913 RW 2401123 K On-line
aux.dia.uniroma3.it /vicepa=20
RWrite 536871913 ROnly 0 Backup 536871915=20
MaxQuota 100000000 K=20
Creation Wed Jul 6 16:33:25 2005
Copy Thu May 24 17:15:09 2012
Backup Thu Aug 28 01:00:05 2014
Last Access Fri Aug 29 09:42:46 2014
Last Update Fri Aug 29 09:42:20 2014
0 accesses in the past day (i.e., vnode references)
RWrite: 536871913 Backup: 536871915=20
number of sites -> 1
server aux.dia.uniroma3.it partition /vicepa RW Site=20
$ fs rmmount html
$ ls
latest.zip README.txt ssh-public-key test-pc.c wordpress/
$ fs mkmount html html.milicchio
$ ls -l
ls: cannot access html: Connection timed out
total 6197
d????????? ? ? ? ? ? html/
-rw-r--r-- 1 milicchio diaafs 6339727 May 8 19:45 latest.zip
-rw-r--r-- 1 milicchio diaafs 218 Sep 10 2012 README.txt
-rw------- 1 milicchio diaafs 395 Jul 24 10:11 ssh-public-key
-rw-r--r-- 1 milicchio diaafs 955 Sep 10 2012 test-pc.c
drwxr-xr-x 5 milicchio diaafs 2048 May 30 10:36 wordpress/
Can you help me in restoring the volume back?
Thanks!
--=20
Franco Milicchio <fmilicchio@me.com>
DIA - Dept. of Engineering
University Roma Tre
http://plm.dia.uniroma3.it/milicchio/
--Apple-Mail=_B985ED34-784E-458D-8E68-C13E89CCEC1B
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html;
charset=windows-1252
<html><head><meta http-equiv=3D"Content-Type" content=3D"text/html =
charset=3Dwindows-1252"></head><body style=3D"word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space;">Dear =
all,<div><br></div><div>I am trying to restore my AFS web volume after =
an incident. The problem seemed to be a piece of cake, but I was wrong: =
the volume is still =
inaccessible.</div><div><br></div><div>Symptoms:</div><div><span =
class=3D"Apple-tab-span" style=3D"white-space:pre"> </span>No access =
to the web volume (html forbidden error).</div><div><br></div><div>So, =
I=92ve logged on a client and saw this:</div><div><br></div><div><div =
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;">$ ls =
-l</div><div style=3D"margin: 0px; font-size: 11px; font-family: =
Menlo;">ls: cannot access html: Connection timed out</div><div =
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;">total =
6197</div><div style=3D"margin: 0px; font-size: 11px; font-family: =
Menlo;">d????????? ? ? ? =
? ? <span =
style=3D"color: rgb(76, 122, 255);">html</span>/</div><div =
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;">-rw-r--r-- 1 =
milicchio diaafs 6339727 May 8 19:45 <span style=3D"color: =
#ff3b1d">latest.zip</span></div><div style=3D"margin: 0px; font-size: =
11px; font-family: Menlo;">-rw-r--r-- 1 milicchio diaafs =
218 Sep 10 2012 README.txt</div><div style=3D"margin: 0px; =
font-size: 11px; font-family: Menlo;">-rw------- 1 milicchio diaafs =
395 Jul 24 10:11 ssh-public-key</div><div style=3D"margin: =
0px; font-size: 11px; font-family: Menlo;">-rw-r--r-- 1 milicchio diaafs =
955 Sep 10 2012 test-pc.c</div><div style=3D"margin: =
0px; font-size: 11px; font-family: Menlo;">drwxr-xr-x 5 milicchio =
diaafs 2048 May 30 10:36 <span style=3D"color: =
#4c7aff">wordpress</span>/</div><div><br></div><div><br =
class=3D"webkit-block-placeholder"></div><div>
<span class=3D"Apple-style-span" style=3D"border-collapse: separate; =
border-spacing: 0px;"><div style=3D"word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><span =
class=3D"Apple-style-span" style=3D"border-collapse: separate; color: =
rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: =
normal; font-variant: normal; font-weight: normal; letter-spacing: =
normal; line-height: normal; orphans: 2; text-indent: 0px; =
text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; =
border-spacing: 0px; -webkit-text-decorations-in-effect: none; =
-webkit-text-stroke-width: 0px;"><div style=3D"word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: after-white-space;"><span =
class=3D"Apple-style-span" style=3D"border-collapse: separate; color: =
rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: =
normal; font-variant: normal; font-weight: normal; letter-spacing: =
normal; line-height: normal; orphans: 2; text-indent: 0px; =
text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; =
border-spacing: 0px; -webkit-text-decorations-in-effect: none; =
-webkit-text-stroke-width: 0px;"><div style=3D"word-wrap: break-word; =
-webkit-nbsp-mode: space; -webkit-line-break: =
after-white-space;"><div><div>Then, I examined =
it:</div><div><br></div><div><div style=3D"orphans: auto; widows: =
auto;"><div style=3D"margin: 0px; font-size: 11px; font-family: =
Menlo;">$ vos examine html.milicchio</div><div style=3D"margin: 0px; =
font-size: 11px; font-family: Menlo;">Could not fetch the information =
about volume 536871913 from the server</div><div style=3D"margin: 0px; =
font-size: 11px; font-family: Menlo;">: No such device</div><div =
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;">Volume does =
not exist on server <a =
href=3D"http://aux.dia.uniroma3.it">aux.dia.uniroma3.it</a> as =
indicated by the VLDB</div><div style=3D"margin: 0px; font-size: 11px; =
font-family: Menlo; min-height: 13px;"><br></div><div style=3D"margin: =
0px; font-size: 11px; font-family: Menlo;">Dump only information from =
VLDB</div><div style=3D"margin: 0px; font-size: 11px; font-family: =
Menlo; min-height: 13px;"><br></div><div style=3D"margin: 0px; =
font-size: 11px; font-family: Menlo;">html.milicchio </div><div =
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;"> =
RWrite: 536871913 Backup: 536871915 </div><div =
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;"> =
number of sites -> 1</div><div style=3D"margin: 0px; =
font-size: 11px; font-family: Menlo;"> =
server <a =
href=3D"http://aux.dia.uniroma3.it">aux.dia.uniroma3.it</a> partition=
/vicepa RW Site </div></div><div style=3D"orphans: auto; widows: =
auto;"><div style=3D"margin: 0px; font-size: 11px; font-family: =
Menlo;">$ ls -l</div><div style=3D"margin: 0px; font-size: 11px; =
font-family: Menlo;">ls: cannot access html: Connection timed =
out</div><div style=3D"margin: 0px; font-size: 11px; font-family: =
Menlo;">total 6197</div><div style=3D"margin: 0px; font-size: 11px; =
font-family: Menlo;">d????????? ? ? ? =
? =
? <span style=3D"color: rgb(76, 122, =
255);">html</span>/</div><div style=3D"margin: 0px; font-size: 11px; =
font-family: Menlo;">-rw-r--r-- 1 milicchio diaafs 6339727 May 8 =
19:45 <span style=3D"color: rgb(255, 59, =
29);">latest.zip</span></div><div style=3D"margin: 0px; font-size: 11px; =
font-family: Menlo;">-rw-r--r-- 1 milicchio diaafs 218 Sep =
10 2012 README.txt</div><div style=3D"margin: 0px; font-size: =
11px; font-family: Menlo;">-rw------- 1 milicchio diaafs =
395 Jul 24 10:11 ssh-public-key</div><div style=3D"margin: 0px; =
font-size: 11px; font-family: Menlo;">-rw-r--r-- 1 milicchio diaafs =
955 Sep 10 2012 test-pc.c</div><div style=3D"margin: =
0px; font-size: 11px; font-family: Menlo;">drwxr-xr-x 5 milicchio =
diaafs 2048 May 30 10:36 <span style=3D"color: rgb(76, =
122, =
255);">wordpress</span>/</div><div><br></div></div><div><br></div><div>I=92=
ve tried some basic commands:</div><div><br></div><div><div =
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;">$ vos =
syncserv aux</div><div style=3D"margin: 0px; font-size: 11px; =
font-family: Menlo;">Server aux synchronized with =
VLDB</div></div><div><br></div><div><div style=3D"margin: 0px; =
font-size: 11px; font-family: Menlo;">$ vos syncvldb aux</div><div =
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;">VLDB =
synchronized with state of server =
aux</div></div><div><br></div><div><br></div><div>But it didn=92t work. =
So, I started salvaging, but it didn=92t =
work:</div><div><br></div><div><div style=3D"margin: 0px; font-size: =
11px; font-family: Menlo;">$ bos salvage aux -all</div><div =
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;">bos: =
shutting down 'fs'.</div><div style=3D"margin: 0px; font-size: 11px; =
font-family: Menlo;">Starting salvage.</div><div style=3D"margin: 0px; =
font-size: 11px; font-family: Menlo;">bos: waiting for salvage to =
complete.</div><div style=3D"margin: 0px; font-size: 11px; font-family: =
Menlo;">bos: waiting for salvage to complete.</div><div style=3D"margin: =
0px; font-size: 11px; font-family: Menlo;">bos: waiting for salvage to =
complete.</div><div style=3D"margin: 0px; font-size: 11px; font-family: =
Menlo;">bos: waiting for salvage to complete.</div><div style=3D"margin: =
0px; font-size: 11px; font-family: Menlo;">bos: waiting for salvage to =
complete.</div><div style=3D"margin: 0px; font-size: 11px; font-family: =
Menlo;">bos: waiting for salvage to complete.</div><div style=3D"margin: =
0px; font-size: 11px; font-family: Menlo;">bos: waiting for salvage to =
complete.</div><div style=3D"margin: 0px; font-size: 11px; font-family: =
Menlo;">bos: waiting for salvage to complete.</div><div style=3D"margin: =
0px; font-size: 11px; font-family: Menlo;">bos: salvage =
completed</div><div style=3D"margin: 0px; font-size: 11px; font-family: =
Menlo;">bos: restarting fs.</div><div style=3D"margin: 0px; font-size: =
11px; font-family: Menlo;"><br></div><div style=3D"margin: 0px; =
font-size: 11px; font-family: Menlo;">milicchio:public$ ls -l</div><div =
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;">ls: cannot =
access html: Connection timed out</div><div style=3D"margin: 0px; =
font-size: 11px; font-family: Menlo;">total 6197</div><div =
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;">d????????? ? =
? ? =
? ? <span style=3D"color: =
#4c7aff">html</span>/</div><div style=3D"margin: 0px; font-size: 11px; =
font-family: Menlo;">-rw-r--r-- 1 milicchio diaafs 6339727 May 8 =
19:45 <span style=3D"color: #ff3b1d">latest.zip</span></div><div =
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;">-rw-r--r-- 1 =
milicchio diaafs 218 Sep 10 2012 =
README.txt</div><div style=3D"margin: 0px; font-size: 11px; font-family: =
Menlo;">-rw------- 1 milicchio diaafs 395 Jul 24 10:11 =
ssh-public-key</div><div style=3D"margin: 0px; font-size: 11px; =
font-family: Menlo;">-rw-r--r-- 1 milicchio diaafs 955 Sep =
10 2012 test-pc.c</div><div style=3D"margin: 0px; font-size: 11px; =
font-family: Menlo;">drwxr-xr-x 5 milicchio diaafs 2048 May =
30 10:36 <span style=3D"color: =
#4c7aff">wordpress</span>/</div></div><div><br></div><div><br></div><div>T=
he volume now seems to be in the VLDB and on the server, since vos =
doesn=92t bark:</div><div><br></div><div><div style=3D"margin: 0px; =
font-size: 11px; font-family: Menlo;">$ vos examine =
html.milicchio</div><div style=3D"margin: 0px; font-size: 11px; =
font-family: Menlo;">html.milicchio =
536871913 RW 2401123 =
K On-line</div><div style=3D"margin: 0px; font-size: 11px; =
font-family: Menlo;"> <a =
href=3D"http://aux.dia.uniroma3.it">aux.dia.uniroma3.it</a> =
/vicepa </div><div style=3D"margin: 0px; font-size: 11px; =
font-family: Menlo;"> RWrite 536871913 ROnly =
0 Backup 536871915 </div><div =
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;"> =
MaxQuota 100000000 K </div><div style=3D"margin: 0px; =
font-size: 11px; font-family: Menlo;"> Creation =
Wed Jul 6 16:33:25 2005</div><div style=3D"margin: 0px; =
font-size: 11px; font-family: Menlo;"> Copy =
Thu May 24 17:15:09 2012</div><div style=3D"margin: 0px; =
font-size: 11px; font-family: Menlo;"> Backup =
Thu Aug 28 01:00:05 2014</div><div style=3D"margin: 0px; =
font-size: 11px; font-family: Menlo;"> Last Access Fri Aug =
29 09:42:46 2014</div><div style=3D"margin: 0px; font-size: 11px; =
font-family: Menlo;"> Last Update Fri Aug 29 09:42:20 =
2014</div><div style=3D"margin: 0px; font-size: 11px; font-family: =
Menlo;"> 0 accesses in the past day (i.e., vnode =
references)</div><div style=3D"margin: 0px; font-size: 11px; =
font-family: Menlo; min-height: 13px;"><br></div><div style=3D"margin: =
0px; font-size: 11px; font-family: Menlo;"> RWrite: =
536871913 Backup: 536871915 </div><div style=3D"margin:=
0px; font-size: 11px; font-family: Menlo;"> number of =
sites -> 1</div><div style=3D"margin: 0px; font-size: 11px; =
font-family: Menlo;"> server <a =
href=3D"http://aux.dia.uniroma3.it">aux.dia.uniroma3.it</a> partition =
/vicepa RW Site </div></div><div><br></div><div><br></div><div><div =
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;">$ fs rmmount =
html</div><div style=3D"margin: 0px; font-size: 11px; font-family: =
Menlo;"><br></div><div style=3D"margin: 0px; font-size: 11px; =
font-family: Menlo;">$ ls</div><div style=3D"margin: 0px; font-size: =
11px; font-family: Menlo;"><span style=3D"color: =
#ff3b1d">latest.zip</span> README.txt ssh-public-key =
test-pc.c <span style=3D"color: =
#4c7aff">wordpress</span>/</div><div style=3D"margin: 0px; font-size: =
11px; font-family: Menlo;"><br></div><div style=3D"margin: 0px; =
font-size: 11px; font-family: Menlo;">$ fs mkmount html =
html.milicchio</div><div style=3D"margin: 0px; font-size: 11px; =
font-family: Menlo;"><br></div><div style=3D"margin: 0px; font-size: =
11px; font-family: Menlo;">$ ls -l</div><div style=3D"margin: 0px; =
font-size: 11px; font-family: Menlo;">ls: cannot access html: Connection =
timed out</div><div style=3D"margin: 0px; font-size: 11px; font-family: =
Menlo;">total 6197</div><div style=3D"margin: 0px; font-size: 11px; =
font-family: Menlo;">d????????? ? ? ? =
? =
? <span style=3D"color: #4c7aff">html</span>/</div><div =
style=3D"margin: 0px; font-size: 11px; font-family: Menlo;">-rw-r--r-- 1 =
milicchio diaafs 6339727 May 8 19:45 <span style=3D"color: =
#ff3b1d">latest.zip</span></div><div style=3D"margin: 0px; font-size: =
11px; font-family: Menlo;">-rw-r--r-- 1 milicchio diaafs =
218 Sep 10 2012 README.txt</div><div style=3D"margin: 0px; =
font-size: 11px; font-family: Menlo;">-rw------- 1 milicchio diaafs =
395 Jul 24 10:11 ssh-public-key</div><div style=3D"margin: =
0px; font-size: 11px; font-family: Menlo;">-rw-r--r-- 1 milicchio diaafs =
955 Sep 10 2012 test-pc.c</div><div style=3D"margin: =
0px; font-size: 11px; font-family: Menlo;">drwxr-xr-x 5 milicchio =
diaafs 2048 May 30 10:36 <span style=3D"color: =
#4c7aff">wordpress</span>/</div></div><div><br></div><div><br></div><div>C=
an you help me in restoring the volume =
back?</div><div><br></div><div>Thanks!</div><div><br></div><br>-- </d=
iv><div>Franco Milicchio <<a =
href=3D"mailto:fmilicchio@me.com">fmilicchio@me.com</a>></div><div><br>=
</div><div>DIA - Dept. of Engineering</div><div>University Roma =
Tre</div></div><a =
href=3D"http://plm.dia.uniroma3.it/milicchio/">http://plm.dia.uniroma3.it/=
milicchio/</a></div></span></div></span></div></span>
</div>
<br></div></body></html>=
--Apple-Mail=_B985ED34-784E-458D-8E68-C13E89CCEC1B--