[OpenAFS] Overview? Linux filesystem choices

Stephan Wiesand stephan.wiesand@desy.de
Fri, 1 Oct 2010 17:08:44 +0200


--Apple-Mail-54-548362634
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=us-ascii


On Oct 1, 2010, at 16:20, Douglas E. Engert wrote:

> On 10/1/2010 4:35 AM, Harald Barth wrote:
>>=20
>> Another way to tackle the data corruption issue in the AFS case would
>> be to add checksum functionality to the fileserver backend. In
>> contrast to NFS, we have the advantage that noone reads the data
>> directly from the file system but always through the client.
>=20
> ZFS stores the checksum of a block, not in the block, but in a higher =
level
> block. This can then detect if a block failed to be written when its =
read back.
> Other file systems could not detect this, as they would read old data,
> with an old checksum.

We've also seen disks randomly reading and returning a different sector =
than the one requested.

> Keep this in mind if checksums are added to AFS.

This would be an awesome feature to have. Presumably, for each file one =
would keep an auxiliary one with, say,  4 or 8 bytes of checksum for =
each 512 bytes block of payload? Or 64 bytes of Hamming codes, allowing =
single bit error correction and dual bit detection?

--=20
Stephan Wiesand
DESY -DV-
Platanenallee 6
15738 Zeuthen, Germany





--Apple-Mail-54-548362634
Content-Disposition: attachment;
	filename=smime.p7s
Content-Type: application/pkcs7-signature;
	name=smime.p7s
Content-Transfer-Encoding: base64

MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIOZDCCBCEw
ggMJoAMCAQICAgDHMA0GCSqGSIb3DQEBBQUAMHExCzAJBgNVBAYTAkRFMRwwGgYDVQQKExNEZXV0
c2NoZSBUZWxla29tIEFHMR8wHQYDVQQLExZULVRlbGVTZWMgVHJ1c3QgQ2VudGVyMSMwIQYDVQQD
ExpEZXV0c2NoZSBUZWxla29tIFJvb3QgQ0EgMjAeFw0wNjEyMTkxMDI5MDBaFw0xOTA2MzAyMzU5
MDBaMFoxCzAJBgNVBAYTAkRFMRMwEQYDVQQKEwpERk4tVmVyZWluMRAwDgYDVQQLEwdERk4tUEtJ
MSQwIgYDVQQDExtERk4tVmVyZWluIFBDQSBHbG9iYWwgLSBHMDEwggEiMA0GCSqGSIb3DQEBAQUA
A4IBDwAwggEKAoIBAQDpm8NnhfkNrvWNVMOWUDU9YuluTO2U1wBblSJ01CDrNI/W7MAxBAuZgeKm
FNJSoCgjhIt0iQReW+DieMF4yxbLKDU5ey2QRdDtoAB6fL9KDhsAw4bpXCsxEXsM84IkQ4wcOItq
aACa7txPeKvSxhObdq3u3ibo7wGvdA/BCaL2a869080UME/15eOkyGKbghoDJzANAmVgTe3RCSMq
ljVYJ9N2xnG2kB3E7f81hn1vM7PbD8URwoqDoZRdQWvY0hD1TP3KUazZve+Sg7va64sWVlZDz+HV
Ez2mHycwzUlU28kTNJpxdcVs6qcLmPkhnSevPqM5OUhqjK3JmfvDEvK9AgMBAAGjgdkwgdYwcAYD
VR0fBGkwZzBloGOgYYZfaHR0cDovL3BraS50ZWxlc2VjLmRlL2NnaS1iaW4vc2VydmljZS9hZl9E
b3dubG9hZEFSTC5jcmw/LWNybF9mb3JtYXQ9WF81MDkmLWlzc3Vlcj1EVF9ST09UX0NBXzIwHQYD
VR0OBBYEFEm3xs/oPR9/6kR7Eyn38QpwPt5kMB8GA1UdIwQYMBaAFDHDeRu69VPXF+CJei0XbAqz
K50zMA4GA1UdDwEB/wQEAwIBBjASBgNVHRMBAf8ECDAGAQH/AgECMA0GCSqGSIb3DQEBBQUAA4IB
AQA74Vp3wEgX3KkY7IGvWonwvSiSpspZGBJw7Cjy565/lizn8l0ZMfYTK3S9vYCyufdnyTmieTvh
ERHua3iRM347XyYndVNljjNj7s9zw7CSI0khUHUjoR8Y4pSFPT8z6XcgjaK95qGFKUD2P3MyWA0J
a6bahWzAP7uNZmRWJE6uDT8yNQFb6YyC2XJZT7GGhfF0hVblw/hc843uR7NTBXDn5U2KaYMo4RMJ
hp5eyOpYHgwf+aTUWgRo/Sg+iwK2WLX2oSw3VwBnqyNojWOl75lrXP1LVvarQIc01BGSbOyHxQoL
BzNytG8MHVQs2FHHzL8w00Ny8TK/jM5JY6gA9/IcMIIFCzCCA/OgAwIBAgIECgIjQTANBgkqhkiG
9w0BAQUFADBaMQswCQYDVQQGEwJERTETMBEGA1UEChMKREZOLVZlcmVpbjEQMA4GA1UECxMHREZO
LVBLSTEkMCIGA1UEAxMbREZOLVZlcmVpbiBQQ0EgR2xvYmFsIC0gRzAxMB4XDTA3MDIyNjA5MTcz
OVoXDTE5MDIyNTAwMDAwMFowgYIxCzAJBgNVBAYTAkRFMS4wLAYDVQQKEyVEZXV0c2NoZXMgRWxl
a3Ryb25lbi1TeW5jaHJvdHJvbiBERVNZMQswCQYDVQQLEwJJVDEWMBQGA1UEAxMNREVTWSBDQSAt
IEcwMjEeMBwGCSqGSIb3DQEJARYPZGVzeS1jYUBkZXN5LmRlMIIBIjANBgkqhkiG9w0BAQEFAAOC
AQ8AMIIBCgKCAQEA4c1VF6YTFoC8yZufAZ+ceKaupY72FFp60pca6vE91Az3QXrlhweCcdXbi1N2
f/ZpMJEi8vakPWqKcAoLszPEWojUXZMs/RmZ8pSRh1MeF17hyV3SI84TRRIaLQrzbMzZqs2PKbhn
cAiwq+nIZXbFZDgPvpsTPIDhY2/unLz81ScY+84g6HJZLMIzbqKw3ga+Ijjh/mKyTKj6jAx6Ubvt
j8eKDrQHMJ8TnXDzg7CjN4inCNzFvkV+8OZ3Ez6p04wyd0ESF+4HwgJeQp+drR2MnxO1S+at6TZq
hqgIAFVsvwcGqlCi4xAPyE4lJXFxclzHTmd164ZjFUkKa0RWNYjWTQIDAQABo4IBrjCCAaowDwYD
VR0TAQH/BAUwAwEB/zALBgNVHQ8EBAMCAQYwHQYDVR0OBBYEFJSX58dzgIIijnL6/92eNIXjtHYU
MB8GA1UdIwQYMBaAFEm3xs/oPR9/6kR7Eyn38QpwPt5kMBoGA1UdEQQTMBGBD2Rlc3ktY2FAZGVz
eS5kZTCBiAYDVR0fBIGAMH4wPaA7oDmGN2h0dHA6Ly9jZHAxLnBjYS5kZm4uZGUvZ2xvYmFsLXJv
b3QtY2EvcHViL2NybC9jYWNybC5jcmwwPaA7oDmGN2h0dHA6Ly9jZHAyLnBjYS5kZm4uZGUvZ2xv
YmFsLXJvb3QtY2EvcHViL2NybC9jYWNybC5jcmwwgaIGCCsGAQUFBwEBBIGVMIGSMEcGCCsGAQUF
BzAChjtodHRwOi8vY2RwMS5wY2EuZGZuLmRlL2dsb2JhbC1yb290LWNhL3B1Yi9jYWNlcnQvY2Fj
ZXJ0LmNydDBHBggrBgEFBQcwAoY7aHR0cDovL2NkcDIucGNhLmRmbi5kZS9nbG9iYWwtcm9vdC1j
YS9wdWIvY2FjZXJ0L2NhY2VydC5jcnQwDQYJKoZIhvcNAQEFBQADggEBAG2JDWDdZEMc5TmSst6Z
LChNcrsn27oIT1pJn51Vxtt5bpZ07L/zrqj1um7p14Mqq/Bu2+svMu+l+Be90AGdB1DpG3++qedt
8piOjqYziD0Za9AkzIc3MWZJVU48aY0KOVR0qHAYe+JKCtAQO2Gfeq+Vnne021sGf6vzHVN8xTTG
WTFOzCm5LGQd/eZ0VP/uZGex5fp4ZyW6BP0bv8Zc8QXDi5FipMllCpspr9phUKDA7mnD50coqFv8
khI1/vg8x/uFM+dQvAWpOZ9wbZ335mKT/Qxe+ELuZ/O0cnNGtakvOO5E0cZyCM5xle36NUtu+Kye
QrI0SNacFZ0ahnfoe2YwggUsMIIEFKADAgECAgQOojLnMA0GCSqGSIb3DQEBBQUAMIGCMQswCQYD
VQQGEwJERTEuMCwGA1UEChMlRGV1dHNjaGVzIEVsZWt0cm9uZW4tU3luY2hyb3Ryb24gREVTWTEL
MAkGA1UECxMCSVQxFjAUBgNVBAMTDURFU1kgQ0EgLSBHMDIxHjAcBgkqhkiG9w0BCQEWD2Rlc3kt
Y2FAZGVzeS5kZTAeFw0wOTA4MTIxMjI4MDdaFw0xMjA4MTExMjI4MDdaMGQxCzAJBgNVBAYTAkRF
MS4wLAYDVQQKEyVEZXV0c2NoZXMgRWxla3Ryb25lbi1TeW5jaHJvdHJvbiBERVNZMQswCQYDVQQL
EwJEVjEYMBYGA1UEAxMPU3RlcGhhbiBXaWVzYW5kMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIB
CgKCAQEAvmv0eaQIuKKSyi5dXs/pK29CIU/n/BP3l78FSmGKsfBM3trxX7qxcbW6b9yZrIMcMkO/
pZ2GAujlc+TCrrQAfTxbKhqc6Y3XaubaMAVs1lDnNbQHk3Vyxd+LFIagea6yKnFqNi3UHrNxBTme
PR9i//tBaA9H8GbJLbN8uSKAE/RAq+CFzNzSORk6PhPiveqQlMWBkH0smt1tWdm2ANzfNHen1rg8
Uc1iQ/18CLOcbikd8fRmqXlRPqL/Cle4btOaUg/pt9jw9GisFwwRVQwJ8mhOo6N3U/2H0gndexSM
E36ZrPJHrLKgL75HiycNunXggRIiBftnmXNixqgMyHsVbwIDAQABo4IBxTCCAcEwCQYDVR0TBAIw
ADALBgNVHQ8EBAMCBeAwKQYDVR0lBCIwIAYIKwYBBQUHAwIGCCsGAQUFBwMEBgorBgEEAYI3FAIC
MB0GA1UdDgQWBBQHYBBFOi3BuEgLoWAa4OHFqhPP1zAfBgNVHSMEGDAWgBSUl+fHc4CCIo5y+v/d
njSF47R2FDAiBgNVHREEGzAZgRdzdGVwaGFuLndpZXNhbmRAZGVzeS5kZTB9BgNVHR8EdjB0MDig
NqA0hjJodHRwOi8vY2RwMS5wY2EuZGZuLmRlL2Rlc3ktY2EvcHViL2NybC9nX2NhY3JsLmNybDA4
oDagNIYyaHR0cDovL2NkcDIucGNhLmRmbi5kZS9kZXN5LWNhL3B1Yi9jcmwvZ19jYWNybC5jcmww
gZgGCCsGAQUFBwEBBIGLMIGIMEIGCCsGAQUFBzAChjZodHRwOi8vY2RwMS5wY2EuZGZuLmRlL2Rl
c3ktY2EvcHViL2NhY2VydC9nX2NhY2VydC5jcnQwQgYIKwYBBQUHMAKGNmh0dHA6Ly9jZHAyLnBj
YS5kZm4uZGUvZGVzeS1jYS9wdWIvY2FjZXJ0L2dfY2FjZXJ0LmNydDANBgkqhkiG9w0BAQUFAAOC
AQEAZaf9oE7o7DyeleVE/h/uFblKmLOOvhKfbqp+ROqzNo6F7t0YVu4LRnxvIGAWC6/aIO2kTGsx
CGEuH6PbU+LW/6cWchzGOkB71at2EFVLFdUx698QXuZgArz2F80A+y4KPK2JQMAVMleBEsB5w5L3
P4bt5EsHn0oXdKkRJdiape0tDXcx1GiERYtu1pueaw1yokmdqkOXMXqi5Dl8zL+baBO6iDtmsb7+
AFDH0FR8f4UnivgO0At43n++qDPlkKXFcip9YQyT6UdaBpLtSQoJROajWHCpy5aZHHAICQy/PSy7
yIBfYrYt7VKJodPi42WzUsRG+AAC60XI74sdXmlUVDGCA1QwggNQAgEBMIGLMIGCMQswCQYDVQQG
EwJERTEuMCwGA1UEChMlRGV1dHNjaGVzIEVsZWt0cm9uZW4tU3luY2hyb3Ryb24gREVTWTELMAkG
A1UECxMCSVQxFjAUBgNVBAMTDURFU1kgQ0EgLSBHMDIxHjAcBgkqhkiG9w0BCQEWD2Rlc3ktY2FA
ZGVzeS5kZQIEDqIy5zAJBgUrDgMCGgUAoIIBnTAYBgkqhkiG9w0BCQMxCwYJKoZIhvcNAQcBMBwG
CSqGSIb3DQEJBTEPFw0xMDEwMDExNTA4NDRaMCMGCSqGSIb3DQEJBDEWBBQGjnJIK/seOsX+ShGs
SIjP6OaRADCBnAYJKwYBBAGCNxAEMYGOMIGLMIGCMQswCQYDVQQGEwJERTEuMCwGA1UEChMlRGV1
dHNjaGVzIEVsZWt0cm9uZW4tU3luY2hyb3Ryb24gREVTWTELMAkGA1UECxMCSVQxFjAUBgNVBAMT
DURFU1kgQ0EgLSBHMDIxHjAcBgkqhkiG9w0BCQEWD2Rlc3ktY2FAZGVzeS5kZQIEDqIy5zCBngYL
KoZIhvcNAQkQAgsxgY6ggYswgYIxCzAJBgNVBAYTAkRFMS4wLAYDVQQKEyVEZXV0c2NoZXMgRWxl
a3Ryb25lbi1TeW5jaHJvdHJvbiBERVNZMQswCQYDVQQLEwJJVDEWMBQGA1UEAxMNREVTWSBDQSAt
IEcwMjEeMBwGCSqGSIb3DQEJARYPZGVzeS1jYUBkZXN5LmRlAgQOojLnMA0GCSqGSIb3DQEBAQUA
BIIBAJud+z8ZNtETfmo6WyIJYBaIcXE9BeS8gBqAUMJLYKfxKNO2t0NHu8GuJ4Qi+R11GIp7ik0n
9gReVddAz6YIJRlL2PtSRR+pbURrK1v+nL/zGaCZF0uJbk81GtQ1eNKge6r+Udjmn8e0Y2GpiW9K
FCBuZl/vQBSXTFaxy2wN91v2Onz89pJGCrMLIHqvmdRWzQp6r7i2nlx4lJ/noCQ1PCLUXkD/yxjK
3zGWOkFvEhgtYMHe2VZK9f6g/xnVfYsO1To/rF2AuiyELWoK3XRTe7eYjmuqrmilUuIdFtBP92EU
EUcoJxK8g6o0WaOC42bjb075ULg4HjCet3GY+0vybSQAAAAAAAA=

--Apple-Mail-54-548362634--