[OpenAFS] backup solutions

Sat, 19 Feb 2005 06:52:15 -0600

This is a cryptographically signed message in MIME format.

--------------ms070507080703020607040601
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

Kurt A. Seiffert wrote:
> We are considering creating a very large OpenAFS cell. We are looking to 
> replace our current DCE/DFS cell. That currently has about 50,000 
> accounts with 1.3TB of data.
> 
> We are not sure if the new AFS cell will hold quite as many users, but 
> the lower working number is 10,000 accounts with about 40TB of space.
> 
> I'm concerned about backups solutions. If we assume an 8 hour backup 
> window, our estimated backup rate has to be about 57GB/min.  We can look 
> at some things like dividing our space into 7 backup blocks and spread 
> the full backups throughout the week interleaving the incrementals for 
> the other blocks. But we still get a rate of about 16GB/min. This is 
> also the floor estimate. The ceiling estimates climb to about 241GB/min.
With 40 TB of data to support, I recommend rethinking your
backup schedule.  Our measurements indicate a typical daily
change rate of 1-2% of total data each day.  We also find only
about 5% of the total data changing over a 1 week period.  So
about 95% of the workload for new full backups is data that was
backed up the week before.  At 40 TB of data, it makes sense
to introduce one or more additional backup levels.  For example,
in a quarterly, monthly, weekly, daily backup schedule, the amount
of new full backup data generated is about .5 TB per day.
> 
> Does anyone have any advice for backup solutions for this much AFS data?
Our TiBS backup product has many special features for dealing with
AFS backups:

	http://www.teradactyl.com/Products/Afs.html

We are currently rolling out a single linux backup server solution
for a 50,000+ volume cell, I'm not sure of the total data size.
> 
> Any other general advice or thoughts would be appriciated as well.
With TiBS, only the new network changes (the 1-2% daily) is taken
from the cell, so you are looking at 400-800 GB of network backup
each night for 40 TB.  With an 8 hour backup this comes out to
only a few GB/min.

Additionally, for AFS, we only "vos dump" the volumes that have
changed since the previous days backup.

The rest of the lower level backups, regardless of the number
of backup levels you chose, are produced entirely by dedicated
backup servers.  These backups can be generated outside your
backup window with no impact on the network or your cell.

Even if your cell is more active that the average, limiting the
network backup window to what has changed on a day-to-day basis
is an efficient way to backup a large cell.
> 
> Thanks.
> 
> -KAS
> 
-- 
Mr. Kristen J. Webb
Teradactyl LLC.

PHONE: 1-505-242-1091
EMAIL: kwebb@teradactyl.com
VISIT: http://www.teradactyl.com

  	Home of the

  True incremental Backup System

--------------ms070507080703020607040601
Content-Type: application/x-pkcs7-signature; name="smime.p7s"
Content-Transfer-Encoding: base64
Content-Disposition: attachment; filename="smime.p7s"
Content-Description: S/MIME Cryptographic Signature

MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIMtjCC
A2IwggLLoAMCAQICEAvaCxfBP4mOqwl0erTOLjMwDQYJKoZIhvcNAQECBQAwXzELMAkGA1UE
BhMCVVMxFzAVBgNVBAoTDlZlcmlTaWduLCBJbmMuMTcwNQYDVQQLEy5DbGFzcyAxIFB1Ymxp
YyBQcmltYXJ5IENlcnRpZmljYXRpb24gQXV0aG9yaXR5MB4XDTk4MDUxMjAwMDAwMFoXDTA4
MDUxMjIzNTk1OVowgcwxFzAVBgNVBAoTDlZlcmlTaWduLCBJbmMuMR8wHQYDVQQLExZWZXJp
U2lnbiBUcnVzdCBOZXR3b3JrMUYwRAYDVQQLEz13d3cudmVyaXNpZ24uY29tL3JlcG9zaXRv
cnkvUlBBIEluY29ycC4gQnkgUmVmLixMSUFCLkxURChjKTk4MUgwRgYDVQQDEz9WZXJpU2ln
biBDbGFzcyAxIENBIEluZGl2aWR1YWwgU3Vic2NyaWJlci1QZXJzb25hIE5vdCBWYWxpZGF0
ZWQwgZ8wDQYJKoZIhvcNAQEBBQADgY0AMIGJAoGBALtaRIoEFrtV/QN6ii2UTxV4NrgNSrJv
nFS/vOh3Kp258Gi7ldkxQXB6gUu5SBNWLccI4YRCq8CikqtEXKpC8IIOAukv+8I7u77JJwpd
trA2QjO1blSIT4dKvxna+RXoD4e2HOPMxpqOf2okkuP84GW6p7F+78nbN2rISsgJBuSZAgMB
AAGjgbAwga0wDwYDVR0TBAgwBgEB/wIBADBHBgNVHSAEQDA+MDwGC2CGSAGG+EUBBwEBMC0w
KwYIKwYBBQUHAgEWH3d3dy52ZXJpc2lnbi5jb20vcmVwb3NpdG9yeS9SUEEwMQYDVR0fBCow
KDAmoCSgIoYgaHR0cDovL2NybC52ZXJpc2lnbi5jb20vcGNhMS5jcmwwCwYDVR0PBAQDAgEG
MBEGCWCGSAGG+EIBAQQEAwIBBjANBgkqhkiG9w0BAQIFAAOBgQACfZ5vRUs4oLje6VNkIbzk
TCuPHv6SQKzYCjlqoTIhLAebq1n+0mIafVU4sDdz3PQHZmNiveFTcFKH56jYUulbLarh3s+s
MVTUixnI2COo7wQrMn0sGBzIfImoLnfyRNFlCk10te7TG5JzdC6JOzUTcudAMZrTssSr51a+
i+P7FTCCBKQwggQNoAMCAQICECBAjKeA9JHKOyMnWYTx/CkwDQYJKoZIhvcNAQEEBQAwgcwx
FzAVBgNVBAoTDlZlcmlTaWduLCBJbmMuMR8wHQYDVQQLExZWZXJpU2lnbiBUcnVzdCBOZXR3
b3JrMUYwRAYDVQQLEz13d3cudmVyaXNpZ24uY29tL3JlcG9zaXRvcnkvUlBBIEluY29ycC4g
QnkgUmVmLixMSUFCLkxURChjKTk4MUgwRgYDVQQDEz9WZXJpU2lnbiBDbGFzcyAxIENBIElu
ZGl2aWR1YWwgU3Vic2NyaWJlci1QZXJzb25hIE5vdCBWYWxpZGF0ZWQwHhcNMDQwOTI0MDAw
MDAwWhcNMDUwOTI0MjM1OTU5WjCCARYxFzAVBgNVBAoTDlZlcmlTaWduLCBJbmMuMR8wHQYD
VQQLExZWZXJpU2lnbiBUcnVzdCBOZXR3b3JrMUYwRAYDVQQLEz13d3cudmVyaXNpZ24uY29t
L3JlcG9zaXRvcnkvUlBBIEluY29ycC4gYnkgUmVmLixMSUFCLkxURChjKTk4MR4wHAYDVQQL
ExVQZXJzb25hIE5vdCBWYWxpZGF0ZWQxMzAxBgNVBAsTKkRpZ2l0YWwgSUQgQ2xhc3MgMSAt
IE5ldHNjYXBlIEZ1bGwgU2VydmljZTEYMBYGA1UEAxQPS3Jpc3RlbiBKLiBXZWJiMSMwIQYJ
KoZIhvcNAQkBFhRrd2ViYkB0ZXJhZGFjdHlsLmNvbTCBnzANBgkqhkiG9w0BAQEFAAOBjQAw
gYkCgYEAqI4FHMcpcWQQMeik5UOwpQFJNHXTacXb+f1QHYuBNaUhHv7OqVcNE6f6x1q25D9R
Y8N3CCcf30Nnpcs/hWWyHYuas4OTlDkRJreRCLVME5JXfkQv71mH8/FDrVOiXAfyvipwnNJB
pCZNgYezhXcOlPx8pix+5NVY5l+bvtfCdXUCAwEAAaOCATgwggE0MAkGA1UdEwQCMAAwgawG
A1UdIASBpDCBoTCBngYLYIZIAYb4RQEHAQEwgY4wKAYIKwYBBQUHAgEWHGh0dHBzOi8vd3d3
LnZlcmlzaWduLmNvbS9DUFMwYgYIKwYBBQUHAgIwVjAVFg5WZXJpU2lnbiwgSW5jLjADAgEB
Gj1WZXJpU2lnbidzIENQUyBpbmNvcnAuIGJ5IHJlZmVyZW5jZSBsaWFiLiBsdGQuIChjKTk3
IFZlcmlTaWduMBEGCWCGSAGG+EIBAQQEAwIHgDAwBgpghkgBhvhFAQYHBCIWIDdlM2ExMzNl
NTY2NDg3MTI1MTBkNjc5NWM3ZGYxZDI2MDMGA1UdHwQsMCowKKAmoCSGImh0dHA6Ly9jcmwu
dmVyaXNpZ24uY29tL2NsYXNzMS5jcmwwDQYJKoZIhvcNAQEEBQADgYEAIFyHtdsvdVE0DLJ9
2TTbngj9WKC7NOAnPIBHBltnEPbsRDmfqkMHf4QY61hntLQy/EwGJ+mVMp8o6LUSRimfCAS2
idZbHcjEyLzHN0sQjUsItwZTEPtTLUyNilNI8notd67oVb4De6t7Xu/2DM6IdHIwS5UykhMJ
IzsuXXY7iBcwggSkMIIEDaADAgECAhAgQIyngPSRyjsjJ1mE8fwpMA0GCSqGSIb3DQEBBAUA
MIHMMRcwFQYDVQQKEw5WZXJpU2lnbiwgSW5jLjEfMB0GA1UECxMWVmVyaVNpZ24gVHJ1c3Qg
TmV0d29yazFGMEQGA1UECxM9d3d3LnZlcmlzaWduLmNvbS9yZXBvc2l0b3J5L1JQQSBJbmNv
cnAuIEJ5IFJlZi4sTElBQi5MVEQoYyk5ODFIMEYGA1UEAxM/VmVyaVNpZ24gQ2xhc3MgMSBD
QSBJbmRpdmlkdWFsIFN1YnNjcmliZXItUGVyc29uYSBOb3QgVmFsaWRhdGVkMB4XDTA0MDky
NDAwMDAwMFoXDTA1MDkyNDIzNTk1OVowggEWMRcwFQYDVQQKEw5WZXJpU2lnbiwgSW5jLjEf
MB0GA1UECxMWVmVyaVNpZ24gVHJ1c3QgTmV0d29yazFGMEQGA1UECxM9d3d3LnZlcmlzaWdu
LmNvbS9yZXBvc2l0b3J5L1JQQSBJbmNvcnAuIGJ5IFJlZi4sTElBQi5MVEQoYyk5ODEeMBwG
A1UECxMVUGVyc29uYSBOb3QgVmFsaWRhdGVkMTMwMQYDVQQLEypEaWdpdGFsIElEIENsYXNz
IDEgLSBOZXRzY2FwZSBGdWxsIFNlcnZpY2UxGDAWBgNVBAMUD0tyaXN0ZW4gSi4gV2ViYjEj
MCEGCSqGSIb3DQEJARYUa3dlYmJAdGVyYWRhY3R5bC5jb20wgZ8wDQYJKoZIhvcNAQEBBQAD
gY0AMIGJAoGBAKiOBRzHKXFkEDHopOVDsKUBSTR102nF2/n9UB2LgTWlIR7+zqlXDROn+sda
tuQ/UWPDdwgnH99DZ6XLP4Vlsh2LmrODk5Q5ESa3kQi1TBOSV35EL+9Zh/PxQ61TolwH8r4q
cJzSQaQmTYGHs4V3DpT8fKYsfuTVWOZfm77XwnV1AgMBAAGjggE4MIIBNDAJBgNVHRMEAjAA
MIGsBgNVHSAEgaQwgaEwgZ4GC2CGSAGG+EUBBwEBMIGOMCgGCCsGAQUFBwIBFhxodHRwczov
L3d3dy52ZXJpc2lnbi5jb20vQ1BTMGIGCCsGAQUFBwICMFYwFRYOVmVyaVNpZ24sIEluYy4w
AwIBARo9VmVyaVNpZ24ncyBDUFMgaW5jb3JwLiBieSByZWZlcmVuY2UgbGlhYi4gbHRkLiAo
Yyk5NyBWZXJpU2lnbjARBglghkgBhvhCAQEEBAMCB4AwMAYKYIZIAYb4RQEGBwQiFiA3ZTNh
MTMzZTU2NjQ4NzEyNTEwZDY3OTVjN2RmMWQyNjAzBgNVHR8ELDAqMCigJqAkhiJodHRwOi8v
Y3JsLnZlcmlzaWduLmNvbS9jbGFzczEuY3JsMA0GCSqGSIb3DQEBBAUAA4GBACBch7XbL3VR
NAyyfdk0254I/ViguzTgJzyARwZbZxD27EQ5n6pDB3+EGOtYZ7S0MvxMBifplTKfKOi1EkYp
nwgEtonWWx3IxMi8xzdLEI1LCLcGUxD7Uy1MjYpTSPJ6LXeu6FW+A3ure17v9gzOiHRyMEuV
MpITCSM7Ll12O4gXMYIEKTCCBCUCAQEwgeEwgcwxFzAVBgNVBAoTDlZlcmlTaWduLCBJbmMu
MR8wHQYDVQQLExZWZXJpU2lnbiBUcnVzdCBOZXR3b3JrMUYwRAYDVQQLEz13d3cudmVyaXNp
Z24uY29tL3JlcG9zaXRvcnkvUlBBIEluY29ycC4gQnkgUmVmLixMSUFCLkxURChjKTk4MUgw
RgYDVQQDEz9WZXJpU2lnbiBDbGFzcyAxIENBIEluZGl2aWR1YWwgU3Vic2NyaWJlci1QZXJz
b25hIE5vdCBWYWxpZGF0ZWQCECBAjKeA9JHKOyMnWYTx/CkwCQYFKw4DAhoFAKCCAp0wGAYJ
KoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMDUwMjE5MTI1MjE1WjAj
BgkqhkiG9w0BCQQxFgQUGKyCTE2Vk8X5F/+XevDnRB1V62IwUgYJKoZIhvcNAQkPMUUwQzAK
BggqhkiG9w0DBzAOBggqhkiG9w0DAgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYI
KoZIhvcNAwICASgwgfIGCSsGAQQBgjcQBDGB5DCB4TCBzDEXMBUGA1UEChMOVmVyaVNpZ24s
IEluYy4xHzAdBgNVBAsTFlZlcmlTaWduIFRydXN0IE5ldHdvcmsxRjBEBgNVBAsTPXd3dy52
ZXJpc2lnbi5jb20vcmVwb3NpdG9yeS9SUEEgSW5jb3JwLiBCeSBSZWYuLExJQUIuTFREKGMp
OTgxSDBGBgNVBAMTP1ZlcmlTaWduIENsYXNzIDEgQ0EgSW5kaXZpZHVhbCBTdWJzY3JpYmVy
LVBlcnNvbmEgTm90IFZhbGlkYXRlZAIQIECMp4D0kco7IydZhPH8KTCB9AYLKoZIhvcNAQkQ
AgsxgeSggeEwgcwxFzAVBgNVBAoTDlZlcmlTaWduLCBJbmMuMR8wHQYDVQQLExZWZXJpU2ln
biBUcnVzdCBOZXR3b3JrMUYwRAYDVQQLEz13d3cudmVyaXNpZ24uY29tL3JlcG9zaXRvcnkv
UlBBIEluY29ycC4gQnkgUmVmLixMSUFCLkxURChjKTk4MUgwRgYDVQQDEz9WZXJpU2lnbiBD
bGFzcyAxIENBIEluZGl2aWR1YWwgU3Vic2NyaWJlci1QZXJzb25hIE5vdCBWYWxpZGF0ZWQC
ECBAjKeA9JHKOyMnWYTx/CkwDQYJKoZIhvcNAQEBBQAEgYBbbtSSEtHe/+xkPiy7QU0cFh0Q
otBxGa92BvqJKzi9z6QcO01ZHHHkKh5ZOiFQHYmBj+uE0rwKT/k7AEnm23DHRytmxUN2JcXb
l19WxgtwyzmZopAnp3wRb8LQEr+DxeSC6OpXY/H6bpL+4XUZhlO/lNT5yT+eEn4GhiHU7yHA
cQAAAAAAAA==
--------------ms070507080703020607040601--