[OpenAFS] Overview? Linux filesystem choices

Stephan Wiesand stephan.wiesand@desy.de
Thu, 30 Sep 2010 16:00:08 +0200


--Apple-Mail-379-457978975
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=us-ascii


On Sep 30, 2010, at 15:40 , Gary Buhrmaster wrote:

> On Thu, Sep 30, 2010 at 05:19, Stephan Wiesand =
<stephan.wiesand@desy.de> wrote:
> ...
>=20
>> Anyway, the next best option if ZFS is not available is to run parity =
checks on all your arrays regularly.
>=20
> Perhaps it is the best one can do, but be aware that
> a (rare, but real) failure mode of disks is that they
> return the contents of a different block than asked.

I know :-)

> No amount of background scrubbing fixes that
> unless the failures are solid (and they are usually
> not).

As I said: my experience is that a disk either does it or not. If it =
does, it does so when it's new and shiny. But yes, I'd still like to =
have ZFS's data protection.

> That does not even include the issue that
> most disk controller data paths (and cache
> memories) are not even parity checked, and
> bit flipping can happen there too.

right :-(

> NetApp recognized this and dealt with it with
> the WAFL file system years ago.  They actually
> wrote a checksum for the block and the block id
> onto disk and checked when they read a block
> back.
>=20
> Getting back the data your wrote is a hard
> problem.  ZFS presumes that everything
> downstream of it will (eventually) fail.  There
> is overhead there, but it does solve a set
> of problems that other solutions do not.
> (And the highly paranoid presume ZFS will
> fail, so take different precautions).
>=20
> As Jeff stated, if you really care about your
> data, you need ZFS.
> Gary

Alas, ZFS is only available with an OS that's *really* troublesome to =
maintain. Frankly, I wouldn't mind the cost. But those patch orgies make =
Solaris a no-go here. And two decades after the invention of RPMS and =
DEBs, they come up with ... IPS. Sorry, no matter how good and =
exceptional ZFS may be, it's just not worth it...

Stephan


--=20
Stephan Wiesand
DESY -DV-
Platanenenallee 6
15738 Zeuthen, Germany


--Apple-Mail-379-457978975
Content-Disposition: attachment;
	filename=smime.p7s
Content-Type: application/pkcs7-signature;
	name=smime.p7s
Content-Transfer-Encoding: base64

MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIFMDCCBSww
ggQUoAMCAQICBA6iMucwDQYJKoZIhvcNAQEFBQAwgYIxCzAJBgNVBAYTAkRFMS4wLAYDVQQKEyVE
ZXV0c2NoZXMgRWxla3Ryb25lbi1TeW5jaHJvdHJvbiBERVNZMQswCQYDVQQLEwJJVDEWMBQGA1UE
AxMNREVTWSBDQSAtIEcwMjEeMBwGCSqGSIb3DQEJARYPZGVzeS1jYUBkZXN5LmRlMB4XDTA5MDgx
MjEyMjgwN1oXDTEyMDgxMTEyMjgwN1owZDELMAkGA1UEBhMCREUxLjAsBgNVBAoTJURldXRzY2hl
cyBFbGVrdHJvbmVuLVN5bmNocm90cm9uIERFU1kxCzAJBgNVBAsTAkRWMRgwFgYDVQQDEw9TdGVw
aGFuIFdpZXNhbmQwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQC+a/R5pAi4opLKLl1e
z+krb0IhT+f8E/eXvwVKYYqx8Eze2vFfurFxtbpv3JmsgxwyQ7+lnYYC6OVz5MKutAB9PFsqGpzp
jddq5towBWzWUOc1tAeTdXLF34sUhqB5rrIqcWo2LdQes3EFOZ49H2L/+0FoD0fwZskts3y5IoAT
9ECr4IXM3NI5GTo+E+K96pCUxYGQfSya3W1Z2bYA3N80d6fWuDxRzWJD/XwIs5xuKR3x9GapeVE+
ov8KV7hu05pSD+m32PD0aKwXDBFVDAnyaE6jo3dT/YfSCd17FIwTfpms8kessqAvvkeLJw26deCB
EiIF+2eZc2LGqAzIexVvAgMBAAGjggHFMIIBwTAJBgNVHRMEAjAAMAsGA1UdDwQEAwIF4DApBgNV
HSUEIjAgBggrBgEFBQcDAgYIKwYBBQUHAwQGCisGAQQBgjcUAgIwHQYDVR0OBBYEFAdgEEU6LcG4
SAuhYBrg4cWqE8/XMB8GA1UdIwQYMBaAFJSX58dzgIIijnL6/92eNIXjtHYUMCIGA1UdEQQbMBmB
F3N0ZXBoYW4ud2llc2FuZEBkZXN5LmRlMH0GA1UdHwR2MHQwOKA2oDSGMmh0dHA6Ly9jZHAxLnBj
YS5kZm4uZGUvZGVzeS1jYS9wdWIvY3JsL2dfY2FjcmwuY3JsMDigNqA0hjJodHRwOi8vY2RwMi5w
Y2EuZGZuLmRlL2Rlc3ktY2EvcHViL2NybC9nX2NhY3JsLmNybDCBmAYIKwYBBQUHAQEEgYswgYgw
QgYIKwYBBQUHMAKGNmh0dHA6Ly9jZHAxLnBjYS5kZm4uZGUvZGVzeS1jYS9wdWIvY2FjZXJ0L2df
Y2FjZXJ0LmNydDBCBggrBgEFBQcwAoY2aHR0cDovL2NkcDIucGNhLmRmbi5kZS9kZXN5LWNhL3B1
Yi9jYWNlcnQvZ19jYWNlcnQuY3J0MA0GCSqGSIb3DQEBBQUAA4IBAQBlp/2gTujsPJ6V5UT+H+4V
uUqYs46+Ep9uqn5E6rM2joXu3RhW7gtGfG8gYBYLr9og7aRMazEIYS4fo9tT4tb/pxZyHMY6QHvV
q3YQVUsV1THr3xBe5mACvPYXzQD7Lgo8rYlAwBUyV4ESwHnDkvc/hu3kSwefShd0qREl2Jql7S0N
dzHUaIRFi27Wm55rDXKiSZ2qQ5cxeqLkOXzMv5toE7qIO2axvv4AUMfQVHx/hSeK+A7QC3jef76o
M+WQpcVyKn1hDJPpR1oGku1JCglE5qNYcKnLlpkccAgJDL89LLvIgF9iti3tUomh0+LjZbNSxEb4
AALrRcjvix1eaVRUMYIDVDCCA1ACAQEwgYswgYIxCzAJBgNVBAYTAkRFMS4wLAYDVQQKEyVEZXV0
c2NoZXMgRWxla3Ryb25lbi1TeW5jaHJvdHJvbiBERVNZMQswCQYDVQQLEwJJVDEWMBQGA1UEAxMN
REVTWSBDQSAtIEcwMjEeMBwGCSqGSIb3DQEJARYPZGVzeS1jYUBkZXN5LmRlAgQOojLnMAkGBSsO
AwIaBQCgggGdMBgGCSqGSIb3DQEJAzELBgkqhkiG9w0BBwEwHAYJKoZIhvcNAQkFMQ8XDTEwMDkz
MDE0MDIyMFowIwYJKoZIhvcNAQkEMRYEFIMYWC+eMVSChXi3s7oAyEk/4MfbMIGcBgkrBgEEAYI3
EAQxgY4wgYswgYIxCzAJBgNVBAYTAkRFMS4wLAYDVQQKEyVEZXV0c2NoZXMgRWxla3Ryb25lbi1T
eW5jaHJvdHJvbiBERVNZMQswCQYDVQQLEwJJVDEWMBQGA1UEAxMNREVTWSBDQSAtIEcwMjEeMBwG
CSqGSIb3DQEJARYPZGVzeS1jYUBkZXN5LmRlAgQOojLnMIGeBgsqhkiG9w0BCRACCzGBjqCBizCB
gjELMAkGA1UEBhMCREUxLjAsBgNVBAoTJURldXRzY2hlcyBFbGVrdHJvbmVuLVN5bmNocm90cm9u
IERFU1kxCzAJBgNVBAsTAklUMRYwFAYDVQQDEw1ERVNZIENBIC0gRzAyMR4wHAYJKoZIhvcNAQkB
Fg9kZXN5LWNhQGRlc3kuZGUCBA6iMucwDQYJKoZIhvcNAQEBBQAEggEAuF6DsQPXBmuvZRzNejXa
GR1jK8hRKuHUpp5FQL3yOg2F5MV+9gSQxjgp4iabMcm61DL+a6BGulMD+Z3P/8wBp/otyHB4DSE5
rT6xhy134i2fqYIiFzUMAilv1jRCoWGzynElIFVXiqFqypeRKvHvjJpfnNMRVYA5qW225hSr09x7
tJGV+ZYrkkuA3F7wKtbZ2kiFpmAkPkCwSclUcv5jAfGnBH1kypEtYv2ESoKC6SDnxirS5vY0oeJR
Lnu6aWO6cH0LeidxDbVqilW2d3y2UKwm/CHVsYDkYEkDD5vqGbxRKb5MNzRdZsJ8yH7caKsq4N8l
86SQs7oOWrVVjwNNLQAAAAAAAA==

--Apple-Mail-379-457978975--