[OpenAFS] Incremental backups

Kristen J. Webb kwebb@teradactyl.com
Fri, 25 Apr 2008 15:06:44 -0600


This is a cryptographically signed message in MIME format.

--------------ms020108000804050308050009
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit



Stephen Joyce wrote:
> Have you tested it with plain "vos dump" (not TiBs synthetic backups)?
Yes, vos dump ... -time ... is what we use to obtain the incremental
dumps.  I believe the decision to send a file to backup is based on
the vnode:uniquifier data, but I haven't dug into the code on the volserver
side to figure that out yet.
> 
> If what you say is true, great!, although it disagrees with the docs 
> that I was reading. From the "vos dump" section of the Admin Reference:
> 
> --begin quote--
> 
> The following command writes a full dump of the volume user.terry to the 
> file /afs/abc.com/common/dumps/terry.dump.
> 
>  % vos dump -id user.terry -time 0 -file 
> /afs/abc.com/common/dumps/terry.dump
> 
> The following command writes an incremental dump of the volume 
> user.smith to the file smith.990131.dump in the current working 
> directory. Only those files in the volume with modification time stamps 
> later than 6:00 p.m. on 31 January 1999 are included in the dump.
> 
>    % vos dump -id user.smith -time "01/31/1999 18:00" -file 
> smith.990131.dump
> 
> --endquote--
> 
> This wouldn't be the first case of the OpenAFS docs being incorrect or 
> outdated...
> 
> Cheers, Stephen
> -- 
> Stephen Joyce
> Systems Administrator                                            P A N I C
> Physics & Astronomy Department                         Physics & Astronomy
> University of North Carolina at Chapel Hill         Network Infrastructure
> voice: (919) 962-7214                                        and Computing
> fax: (919) 962-0480                               http://www.panic.unc.edu
> 
> The purpose of the icons, the purpose of the entire OS X look and feel, is
> to keep the customer happy during that critical period between the time of
> sale and the time the check clears.
> 
> On Fri, 25 Apr 2008, Kristen J. Webb wrote:
> 
>> Stephen Joyce wrote:
>>
>>>
>>> One other thing to be aware of is that giving the -time option to vos 
>>> dump makes it look at the files' modification timestamps to determine 
>>> what to back up. It's very possible to create a file with an old 
>>> timestamp (using tar, touch, etc) so that it won't be caught by 
>>> anything except a full backup. Mv'ing a file between volumes is an 
>>> easy way to accidentally cause this. Just something to be aware of.
>>
>> The vos dump process does not look at unix time stamps to determine
>> if a file needs to be backed up.  This is a nice feature of AFS.
>> Any modification to the volume updates the volume time stamp, and
>> if you keep track of these correctly, you'll get the new data even if
>> the unix times would not predict that.
>>
>> I cp -p /usr/bin/filesize to my afs volume.  As you can see
>> it is all of the unix times are from 2000:
>>
>> # stat filesize
>>  File: `filesize'
>>  Size: 68              Blocks: 2          IO Block: 4096   regular file
>> Device: dh/13d  Inode: 80281630    Links: 1
>> Access: (0755/-rwxr-xr-x)  Uid: (    0/    root)   Gid: (    0/    root)
>> Access: 2000-09-04 11:24:42.000000000 -0400
>> Modify: 2000-09-04 11:24:42.000000000 -0400
>> Change: 2000-09-04 11:24:42.000000000 -0400
>>
>> I then took an incremental backup of the volume and checked our
>> file lookup database and the file is there:
>>
>> FILE                 68 Mon Sep  4 11:24:42 2000  
>> afs|user.kwebb|/filesize
>>
>> If vos dump did not give us these older files consistently,
>> our synthetic backup process would detect it.
>>
>> Kris
>> -- 
>> Mr. Kristen J. Webb
>> Teradactyl LLC.
>>
>> PHONE: 1-505-242-1091
>> EMAIL: kwebb@teradactyl.com
>> VISIT: http://www.teradactyl.com
>>
>>     Home of the
>>
>> True incremental Backup System
>>
> _______________________________________________
> OpenAFS-info mailing list
> OpenAFS-info@openafs.org
> https://lists.openafs.org/mailman/listinfo/openafs-info
> 
> 

-- 
Mr. Kristen J. Webb
Teradactyl LLC.

PHONE: 1-505-242-1091
EMAIL: kwebb@teradactyl.com
VISIT: http://www.teradactyl.com

  	Home of the

  True incremental Backup System

--------------ms020108000804050308050009
Content-Type: application/x-pkcs7-signature; name="smime.p7s"
Content-Transfer-Encoding: base64
Content-Disposition: attachment; filename="smime.p7s"
Content-Description: S/MIME Cryptographic Signature

MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIP1jCC
BMwwggQ1oAMCAQICEByunWua9OYvIoqj2nRhbB4wDQYJKoZIhvcNAQEFBQAwXzELMAkGA1UE
BhMCVVMxFzAVBgNVBAoTDlZlcmlTaWduLCBJbmMuMTcwNQYDVQQLEy5DbGFzcyAxIFB1Ymxp
YyBQcmltYXJ5IENlcnRpZmljYXRpb24gQXV0aG9yaXR5MB4XDTA1MTAyODAwMDAwMFoXDTE1
MTAyNzIzNTk1OVowgd0xCzAJBgNVBAYTAlVTMRcwFQYDVQQKEw5WZXJpU2lnbiwgSW5jLjEf
MB0GA1UECxMWVmVyaVNpZ24gVHJ1c3QgTmV0d29yazE7MDkGA1UECxMyVGVybXMgb2YgdXNl
IGF0IGh0dHBzOi8vd3d3LnZlcmlzaWduLmNvbS9ycGEgKGMpMDUxHjAcBgNVBAsTFVBlcnNv
bmEgTm90IFZhbGlkYXRlZDE3MDUGA1UEAxMuVmVyaVNpZ24gQ2xhc3MgMSBJbmRpdmlkdWFs
IFN1YnNjcmliZXIgQ0EgLSBHMjCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBAMnf
rOfq+PgDFMQAktXBfjbCPO98chXLwKuMPRyVzm8eECw/AO2XJua2x+atQx0/pIdHR0w+VPhs
+Mf8sZ69MHC8l7EDBeqV8a1AxUR6SwWi8mD81zplYu//EHuiVrvFTnAt1qIfPO2wQuhejVch
rKaZ2RHp0hoHwHRHQgv8xTTq/ea6JNEdCBU3otdzzwFBL2OyOj++pRpu9MlKWz2VphW7NQIZ
+dTvvI8OcXZZu0u2Ptb8Whb01g6J8kn+bAztFenZiHWcec5gJ925rXXOL3OVekA6hXVJsLjf
aLyrzROChRFQo+A8C67AClPN1zBvhTJGG+RJEMJs4q8fef/btLUCAwEAAaOCAYQwggGAMBIG
A1UdEwEB/wQIMAYBAf8CAQAwRAYDVR0gBD0wOzA5BgtghkgBhvhFAQcXATAqMCgGCCsGAQUF
BwIBFhxodHRwczovL3d3dy52ZXJpc2lnbi5jb20vcnBhMAsGA1UdDwQEAwIBBjARBglghkgB
hvhCAQEEBAMCAQYwLgYDVR0RBCcwJaQjMCExHzAdBgNVBAMTFlByaXZhdGVMYWJlbDMtMjA0
OC0xNTUwHQYDVR0OBBYEFBF9Xhl9PATfamzWoooaPzHYO5RSMDEGA1UdHwQqMCgwJqAkoCKG
IGh0dHA6Ly9jcmwudmVyaXNpZ24uY29tL3BjYTEuY3JsMIGBBgNVHSMEejB4oWOkYTBfMQsw
CQYDVQQGEwJVUzEXMBUGA1UEChMOVmVyaVNpZ24sIEluYy4xNzA1BgNVBAsTLkNsYXNzIDEg
UHVibGljIFByaW1hcnkgQ2VydGlmaWNhdGlvbiBBdXRob3JpdHmCEQDNun9W8N/kvFT+Iqyz
cqpVMA0GCSqGSIb3DQEBBQUAA4GBALEv2ZbhkqLugWDlyCog++FnLNYAmFOjAhvpkEv4GESf
D0b3+qD+0x0Yo9K/HOzWGZ9KTUP4yru+E4BJBd0hczNXwkJavvoAk7LmBDGRTl088HMFN2Pr
v4NZmP1m3umGMpqSKTw6rlTaphJRsY/IytNHeObbpR6HBuPRFMDCIfa6MIIFfzCCBGegAwIB
AgIQbxEIani/7YYWYzAfV7c0ZDANBgkqhkiG9w0BAQUFADCB3TELMAkGA1UEBhMCVVMxFzAV
BgNVBAoTDlZlcmlTaWduLCBJbmMuMR8wHQYDVQQLExZWZXJpU2lnbiBUcnVzdCBOZXR3b3Jr
MTswOQYDVQQLEzJUZXJtcyBvZiB1c2UgYXQgaHR0cHM6Ly93d3cudmVyaXNpZ24uY29tL3Jw
YSAoYykwNTEeMBwGA1UECxMVUGVyc29uYSBOb3QgVmFsaWRhdGVkMTcwNQYDVQQDEy5WZXJp
U2lnbiBDbGFzcyAxIEluZGl2aWR1YWwgU3Vic2NyaWJlciBDQSAtIEcyMB4XDTA3MDkyNzAw
MDAwMFoXDTA4MDkyNjIzNTk1OVowggEWMRcwFQYDVQQKEw5WZXJpU2lnbiwgSW5jLjEfMB0G
A1UECxMWVmVyaVNpZ24gVHJ1c3QgTmV0d29yazFGMEQGA1UECxM9d3d3LnZlcmlzaWduLmNv
bS9yZXBvc2l0b3J5L1JQQSBJbmNvcnAuIGJ5IFJlZi4sTElBQi5MVEQoYyk5ODEeMBwGA1UE
CxMVUGVyc29uYSBOb3QgVmFsaWRhdGVkMTMwMQYDVQQLEypEaWdpdGFsIElEIENsYXNzIDEg
LSBOZXRzY2FwZSBGdWxsIFNlcnZpY2UxGDAWBgNVBAMUD0tyaXN0ZW4gSi4gV2ViYjEjMCEG
CSqGSIb3DQEJARYUa3dlYmJAdGVyYWRhY3R5bC5jb20wggEiMA0GCSqGSIb3DQEBAQUAA4IB
DwAwggEKAoIBAQC9MCdBviU0dIZjCr1dEZZ9B6yRbKNFwas6sR44t8HixtHUm8vTkhQTXGzR
pDdCrI7eUqJpRtor8Rc4ZAYlLnJ43iXMHeSlwpvOIzsJXPEpAOTzHS+eCIWPsDynBh890Ae4
8jqsg3veJSEjnHqMJg6OXXwQy9fN2Z1LD+eQ4v3Pcbl2o6UknWe4ldRtpQwQwIr/J/ihl4/W
KlW0xf9+A7c3dYCblKTzuVyu4TFdzipYEC0okYFaTaSgV9SpXqoAnkPVwLN/vU3bzCYcsRkM
halE2ReARISRW1oInoNUf4bxYyBPpuT27cknoS+izlolOIt9UTH3ZoVi0zKRXPjWbQ6lAgMB
AAGjgf4wgfswCQYDVR0TBAIwADBEBgNVHSAEPTA7MDkGC2CGSAGG+EUBBxcDMCowKAYIKwYB
BQUHAgEWHGh0dHBzOi8vd3d3LnZlcmlzaWduLmNvbS9ycGEwCwYDVR0PBAQDAgWgMB0GA1Ud
JQQWMBQGCCsGAQUFBwMEBggrBgEFBQcDAjAwBgpghkgBhvhFAQYHBCIWIDdlM2ExMzNlNTY2
NDg3MTI1MTBkNjc5NWM3ZGYxZDI2MEoGA1UdHwRDMEEwP6A9oDuGOWh0dHA6Ly9JbmRDMURp
Z2l0YWxJRC1jcmwudmVyaXNpZ24uY29tL0luZEMxRGlnaXRhbElELmNybDANBgkqhkiG9w0B
AQUFAAOCAQEAD2K2NjGCd3DkliPfIuiUsIJ58O03qCFsD8olxVXtZz72CoNWL8qLUIBhW8bJ
CPO5eknVMjQYPpHPYBVSfoGxfmWGkzDRjnKEDmNP8vL9XkSD4Y2DFCP9erJtf60a/oQytYA4
SSIwGVyKOwRYJS70Ui2Dut9yF5dxmTDFZoHjmIe1jXP8dPHtYNq/rKSLnDiuDq/NlGSIeIGc
sqHvusL91WewuXeR818r1JTsHUxbC3stOd3R5VVWiS9aKFDwToq26uvQjm5lbDhPSn9sLWff
GII8loK+0PjPkyJoP478IOcrA9AECF5bA/epdKb80j06IX1rXb3xxnT1BLWN9BoFtDCCBX8w
ggRnoAMCAQICEG8RCGp4v+2GFmMwH1e3NGQwDQYJKoZIhvcNAQEFBQAwgd0xCzAJBgNVBAYT
AlVTMRcwFQYDVQQKEw5WZXJpU2lnbiwgSW5jLjEfMB0GA1UECxMWVmVyaVNpZ24gVHJ1c3Qg
TmV0d29yazE7MDkGA1UECxMyVGVybXMgb2YgdXNlIGF0IGh0dHBzOi8vd3d3LnZlcmlzaWdu
LmNvbS9ycGEgKGMpMDUxHjAcBgNVBAsTFVBlcnNvbmEgTm90IFZhbGlkYXRlZDE3MDUGA1UE
AxMuVmVyaVNpZ24gQ2xhc3MgMSBJbmRpdmlkdWFsIFN1YnNjcmliZXIgQ0EgLSBHMjAeFw0w
NzA5MjcwMDAwMDBaFw0wODA5MjYyMzU5NTlaMIIBFjEXMBUGA1UEChMOVmVyaVNpZ24sIElu
Yy4xHzAdBgNVBAsTFlZlcmlTaWduIFRydXN0IE5ldHdvcmsxRjBEBgNVBAsTPXd3dy52ZXJp
c2lnbi5jb20vcmVwb3NpdG9yeS9SUEEgSW5jb3JwLiBieSBSZWYuLExJQUIuTFREKGMpOTgx
HjAcBgNVBAsTFVBlcnNvbmEgTm90IFZhbGlkYXRlZDEzMDEGA1UECxMqRGlnaXRhbCBJRCBD
bGFzcyAxIC0gTmV0c2NhcGUgRnVsbCBTZXJ2aWNlMRgwFgYDVQQDFA9LcmlzdGVuIEouIFdl
YmIxIzAhBgkqhkiG9w0BCQEWFGt3ZWJiQHRlcmFkYWN0eWwuY29tMIIBIjANBgkqhkiG9w0B
AQEFAAOCAQ8AMIIBCgKCAQEAvTAnQb4lNHSGYwq9XRGWfQeskWyjRcGrOrEeOLfB4sbR1JvL
05IUE1xs0aQ3QqyO3lKiaUbaK/EXOGQGJS5yeN4lzB3kpcKbziM7CVzxKQDk8x0vngiFj7A8
pwYfPdAHuPI6rIN73iUhI5x6jCYOjl18EMvXzdmdSw/nkOL9z3G5dqOlJJ1nuJXUbaUMEMCK
/yf4oZeP1ipVtMX/fgO3N3WAm5Sk87lcruExXc4qWBAtKJGBWk2koFfUqV6qAJ5D1cCzf71N
28wmHLEZDIWpRNkXgESEkVtaCJ6DVH+G8WMgT6bk9u3JJ6Evos5aJTiLfVEx92aFYtMykVz4
1m0OpQIDAQABo4H+MIH7MAkGA1UdEwQCMAAwRAYDVR0gBD0wOzA5BgtghkgBhvhFAQcXAzAq
MCgGCCsGAQUFBwIBFhxodHRwczovL3d3dy52ZXJpc2lnbi5jb20vcnBhMAsGA1UdDwQEAwIF
oDAdBgNVHSUEFjAUBggrBgEFBQcDBAYIKwYBBQUHAwIwMAYKYIZIAYb4RQEGBwQiFiA3ZTNh
MTMzZTU2NjQ4NzEyNTEwZDY3OTVjN2RmMWQyNjBKBgNVHR8EQzBBMD+gPaA7hjlodHRwOi8v
SW5kQzFEaWdpdGFsSUQtY3JsLnZlcmlzaWduLmNvbS9JbmRDMURpZ2l0YWxJRC5jcmwwDQYJ
KoZIhvcNAQEFBQADggEBAA9itjYxgndw5JYj3yLolLCCefDtN6ghbA/KJcVV7Wc+9gqDVi/K
i1CAYVvGyQjzuXpJ1TI0GD6Rz2AVUn6BsX5lhpMw0Y5yhA5jT/Ly/V5Eg+GNgxQj/XqybX+t
Gv6EMrWAOEkiMBlcijsEWCUu9FItg7rfcheXcZkwxWaB45iHtY1z/HTx7WDav6yki5w4rg6v
zZRkiHiBnLKh77rC/dVnsLl3kfNfK9SU7B1MWwt7LTnd0eVVVokvWihQ8E6Kturr0I5uZWw4
T0p/bC1n3xiCPJaCvtD4z5MiaD+O/CDnKwPQBAheWwP3qXSm/NI9OiF9a1298cZ09QS1jfQa
BbQxggTfMIIE2wIBATCB8jCB3TELMAkGA1UEBhMCVVMxFzAVBgNVBAoTDlZlcmlTaWduLCBJ
bmMuMR8wHQYDVQQLExZWZXJpU2lnbiBUcnVzdCBOZXR3b3JrMTswOQYDVQQLEzJUZXJtcyBv
ZiB1c2UgYXQgaHR0cHM6Ly93d3cudmVyaXNpZ24uY29tL3JwYSAoYykwNTEeMBwGA1UECxMV
UGVyc29uYSBOb3QgVmFsaWRhdGVkMTcwNQYDVQQDEy5WZXJpU2lnbiBDbGFzcyAxIEluZGl2
aWR1YWwgU3Vic2NyaWJlciBDQSAtIEcyAhBvEQhqeL/thhZjMB9XtzRkMAkGBSsOAwIaBQCg
ggLBMBgGCSqGSIb3DQEJAzELBgkqhkiG9w0BBwEwHAYJKoZIhvcNAQkFMQ8XDTA4MDQyNTIx
MDY0NFowIwYJKoZIhvcNAQkEMRYEFM5iL1T6w/9dK5nvVeBQN+rQBHtcMFIGCSqGSIb3DQEJ
DzFFMEMwCgYIKoZIhvcNAwcwDgYIKoZIhvcNAwICAgCAMA0GCCqGSIb3DQMCAgFAMAcGBSsO
AwIHMA0GCCqGSIb3DQMCAgEoMIIBAwYJKwYBBAGCNxAEMYH1MIHyMIHdMQswCQYDVQQGEwJV
UzEXMBUGA1UEChMOVmVyaVNpZ24sIEluYy4xHzAdBgNVBAsTFlZlcmlTaWduIFRydXN0IE5l
dHdvcmsxOzA5BgNVBAsTMlRlcm1zIG9mIHVzZSBhdCBodHRwczovL3d3dy52ZXJpc2lnbi5j
b20vcnBhIChjKTA1MR4wHAYDVQQLExVQZXJzb25hIE5vdCBWYWxpZGF0ZWQxNzA1BgNVBAMT
LlZlcmlTaWduIENsYXNzIDEgSW5kaXZpZHVhbCBTdWJzY3JpYmVyIENBIC0gRzICEG8RCGp4
v+2GFmMwH1e3NGQwggEFBgsqhkiG9w0BCRACCzGB9aCB8jCB3TELMAkGA1UEBhMCVVMxFzAV
BgNVBAoTDlZlcmlTaWduLCBJbmMuMR8wHQYDVQQLExZWZXJpU2lnbiBUcnVzdCBOZXR3b3Jr
MTswOQYDVQQLEzJUZXJtcyBvZiB1c2UgYXQgaHR0cHM6Ly93d3cudmVyaXNpZ24uY29tL3Jw
YSAoYykwNTEeMBwGA1UECxMVUGVyc29uYSBOb3QgVmFsaWRhdGVkMTcwNQYDVQQDEy5WZXJp
U2lnbiBDbGFzcyAxIEluZGl2aWR1YWwgU3Vic2NyaWJlciBDQSAtIEcyAhBvEQhqeL/thhZj
MB9XtzRkMA0GCSqGSIb3DQEBAQUABIIBAIv3ERAqVSdNTNp9D8Z+v8otF5HQob8eSg0XWTQK
q1UMByRVotlyo77P3iQFB9id3SxY++tloFMXcn7vCfFKyJpG83Icty6z/VFcV8WnZsqqUzSu
oGAKDORZhD5fB9gVY8p0BKCDKj6jjauYofT4Kv8Vzz0Lud/M8dj+Cnq2LL225JW3hSDIccTr
EvhhYEtMPKiCvWhcIUmrMcr1l2N+zNqiWTkrvPRiCPX9hTb3pCdhLyAG6pt68UYk5xskmcw8
41WP0Nbi6fHwS1kZzK9knv42ZDjEx719zzTvFxAwlH/rFbr13EAyxNMhqevVmKvve4JPYkHF
y6dQLSxKgLTn29sAAAAAAAA=
--------------ms020108000804050308050009--