[OpenAFS] volume offline due to too low uniquifier (and salvage cannot fix it)

[Jakub Moscicki]

Hello,

Around the time of nightly backup one of our volumes went offline and we ca=
nnot bring it back online. We moved it to another server but this did not f=
ix the issue. The same issue persists on the online backup snapshot which w=
as dumped and restored under a different name. The vos online command silen=
tly fails.

Any ideas how to fix this would be greatly appreciated=85 should we attempt=
 fixing the uniquifier bits manually in the volume header?

Here is the symptom:

FileLog:=20
=3D=3D=3D=3D=3D=3D
Mon Apr 15 19:22:20 2013 GetBitmap: bad volume uniquifier for volume p.cvs.=
volname; volume needs salvage
Mon Apr 15 19:22:20 2013 VAttachVolume: error getting bitmap for volume (/v=
icepck//V1934053454.vol)
=3D=3D=3D=3D=3D=3D

This is the first appearance of the error in FileLog and it coincides with =
clone operation done by the vos backupsys 20 seconds before

The salvage subsequently says that it fixed it but in reality nothing chang=
es. Here is the salvage output:

=3D=3D=3D=3D=3D=3D
>>>Tue Apr 16 11:34:06 2013: /usr/afs/bin/volinfo -part /vicepac -vol 19340=
53454 -fixheader
Inode 8306696333780058111: Good magic 78a1b2c5 and version 1
Inode 8306696333847166975: Good magic 99776655 and version 1
Inode 8306696333914275839: Good magic 88664433 and version 1
Inode 8306696334115602431: Good magic 99877712 and version 1
Volume header for volume 1934053454 (p.cvs.volname)
stamp.magic =3D 78a1b2c5, stamp.version =3D 1
inUse =3D 0, inService =3D 1, blessed =3D 1, needsSalvaged =3D 0, dontSalva=
ge =3D 0
type =3D 0 (read/write), uniquifier =3D 638, needsCallback =3D 0, destroyMe=
 =3D 0
id =3D 1934053454, parentId =3D 1934053454, cloneId =3D 0, backupId =3D 0, =
restoredFromId =3D 0
maxquota =3D 150000000, minquota =3D 0, maxfiles =3D 0, filecount =3D 72917=
8, diskused =3D 89814946
creationDate =3D 1269940121 (2010/03/30.11:08:41), copyDate =3D 1366098855 =
(2013/04/16.09:54:15)

>>>Tue Apr 16 11:34:07 2013: /usr/afs/bin/salvager /vicepac 1934053454 -sho=
wlog -orphans remove
@(#) OpenAFS 1.4.14 built  2013-03-05 4294967295 0
04/16/2013 11:34:07 STARTING AFS SALVAGER 2.4 (/usr/afs/bin/salvager /vicep=
ac 1934053454 -showlog -orphans remove)
04/16/2013 11:34:21 1 nVolumesInInodeFile 32=20
04/16/2013 11:34:21 SALVAGING VOLUME 1934053454.
04/16/2013 11:34:21 p.cvs.volname (1934053454) updated 04/15/2013 19:50
04/16/2013 11:34:21 totalInodes 729182
04/16/2013 11:35:53 Volume uniquifier is too low; fixed
04/16/2013 11:35:53 Salvaged p.cvs.volname (1934053454): 729178 files, 8981=
4946 blocks
 +++ 0 +++

=3D=3D=3D=3D=3D=3D

Many thanks,

kuba