[OpenAFS] Connection timed out - problem with cache manager?

Wed, 30 Nov 2016 11:56:50 +0100

This is a cryptographically signed message in MIME format.

--------------ms020905040903020002070107
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: quoted-printable

Some users at our site reports problems with downloading files directly=20
to AFS (and this problem has existed for years).

I'm now working to try to find the cause. Just to eliminate the server,=20
we have moved the user's volume to our YFS server, but we experience=20
exactly the same problem.

I can't seem to reproduce it on my own machine (Ubuntu 14.04.1 LTS with=20
openafs client 1.6.7-1ubuntu1.1).

However, the machine where I have managed to reproduce the problem is a=20
terminal server (with lots of users). It's a Ubuntu 12.04.5 LTS with=20
openafs version 1.6.1-1+ubuntu0.7.

The AFS cache is set to:
 > cat /etc/openafs/cacheinfo
/afs:/cache/openafs:5000000

What happens is this:
I run a wget (from siemens in this case, but probably not important).=20
The wget either aborts at 70% or so, with a "Connection timed out", or,=20
as happened for me just now:

HTTP request sent, awaiting response... 200 OK
Length: 1983588866 (1,8G) [application/zip]
Saving to: `nx-9.0.3.zip.1'

100%[=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D>] 1 983 588 866 17,7M/s   in=20
1m 50s

utime(nx-9.0.3.zip.1): Connection timed out
2016-11-30 11:33:39 (17,3 MB/s) - `nx-9.0.3.zip.1' saved=20
[1983588866/1983588866]

So, the file downloaded 100% (to the AFS cache). Then there was a delay=20
for some time before the error popped up (while flushing the cache, I=20
would guess).

If I look at the resulting file, I see that it's corrupt.

Downloading to local disk first, and then copy to AFS seems to work=20
every time.

Does anyone recognize this problem?

/Staffan

--------------ms020905040903020002070107
Content-Type: application/pkcs7-signature; name="smime.p7s"
Content-Transfer-Encoding: base64
Content-Disposition: attachment; filename="smime.p7s"
Content-Description: S/MIME Cryptographic Signature

MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgEFADCABgkqhkiG9w0BBwEAAKCC
ClAwggUAMIID6KADAgECAhADS+4XH7fhBjcv1HJCQL0qMA0GCSqGSIb3DQEBCwUAMGUxCzAJ
BgNVBAYTAlVTMRUwEwYDVQQKEwxEaWdpQ2VydCBJbmMxGTAXBgNVBAsTEHd3dy5kaWdpY2Vy
dC5jb20xJDAiBgNVBAMTG0RpZ2lDZXJ0IEFzc3VyZWQgSUQgUm9vdCBDQTAeFw0xNDExMTgx
MjAwMDBaFw0yNDExMTgxMjAwMDBaMGkxCzAJBgNVBAYTAk5MMRYwFAYDVQQIEw1Ob29yZC1I
b2xsYW5kMRIwEAYDVQQHEwlBbXN0ZXJkYW0xDzANBgNVBAoTBlRFUkVOQTEdMBsGA1UEAxMU
VEVSRU5BIFBlcnNvbmFsIENBIDMwggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQDG
pbsfVYL0pTRyFHJlm1/V6qBo2JuCiU9TYpx7jM4O2tQyDq8bjMum69vg6wM0lMGHflMgqB75
GxeKfQFmEldoXi2cLishqFUvU2cJeM3SaRsLk2BsuCgTzh9NsYgmrUX60KHOq7eYKVZxbPFW
JF2nMOBuMXNu2qBXTGSLeLXHnNvG3r7TLzGg1oA5teAxQE6Eo8ySSeIXbP7wZB76urwlh51P
IbrJZjkDjdQVELh7OlTP1WO6T/Hf6BsEfeFcpoa1e+MW/lw0VetTPPHQ15HYKYP2WYohHxzD
iC+QUwE7UZVBlp9cXIpwHuDzSibc5RG3z0n/j2SQCx0Dk5FMAUErAgMBAAGjggGmMIIBojAS
BgNVHRMBAf8ECDAGAQH/AgEAMA4GA1UdDwEB/wQEAwIBhjB5BggrBgEFBQcBAQRtMGswJAYI
KwYBBQUHMAGGGGh0dHA6Ly9vY3NwLmRpZ2ljZXJ0LmNvbTBDBggrBgEFBQcwAoY3aHR0cDov
L2NhY2VydHMuZGlnaWNlcnQuY29tL0RpZ2lDZXJ0QXNzdXJlZElEUm9vdENBLmNydDCBgQYD
VR0fBHoweDA6oDigNoY0aHR0cDovL2NybDMuZGlnaWNlcnQuY29tL0RpZ2lDZXJ0QXNzdXJl
ZElEUm9vdENBLmNybDA6oDigNoY0aHR0cDovL2NybDQuZGlnaWNlcnQuY29tL0RpZ2lDZXJ0
QXNzdXJlZElEUm9vdENBLmNybDA9BgNVHSAENjA0MDIGBFUdIAAwKjAoBggrBgEFBQcCARYc
aHR0cHM6Ly93d3cuZGlnaWNlcnQuY29tL0NQUzAdBgNVHQ4EFgQU8CHpSXdzn4WuGDvoUnAU
Bu1C7sowHwYDVR0jBBgwFoAUReuir/SSy4IxLVGLp6chnfNtyA8wDQYJKoZIhvcNAQELBQAD
ggEBADrCGyv+Y967YbS5R6j8fAWxJiAiUZvIPfn1xVgesF6jspwCQY8xGn/MG04d+Jh97I8I
/Xfx29JEEFq2rQmw4PxiO9RiDZ7xoDxNd4rrRDR7jrtOKQP8J+o+ah0vSOP62hnD/zPS7NRM
tIyVS2G277KAL5fIR62ngr984fmJghDv0bsjGAmeu3EP0xhUsDJT61IoAGoKBnxBPAeg3WXs
dSm4Gn7btyvakeyFtYebr2KmOBSa28PRqGSDur56aZhJoM2eMzc6prmvGwwtAzRsc5t2OsKR
uHWV6O3anP2K27jGZR2bi1VX1NQUvIbpVNTuwjm+XcZtsa/AAJF9KGkEseAwggVIMIIEMKAD
AgECAhAOikWnK8F4Uhe3Tu/SPELjMA0GCSqGSIb3DQEBCwUAMGkxCzAJBgNVBAYTAk5MMRYw
FAYDVQQIEw1Ob29yZC1Ib2xsYW5kMRIwEAYDVQQHEwlBbXN0ZXJkYW0xDzANBgNVBAoTBlRF
UkVOQTEdMBsGA1UEAxMUVEVSRU5BIFBlcnNvbmFsIENBIDMwHhcNMTYxMTE1MDAwMDAwWhcN
MTkxMTE1MTIwMDAwWjCBijELMAkGA1UEBhMCU0UxEzARBgNVBAgTCk5vcnJib3R0ZW4xDzAN
BgNVBAcMBkx1bGXDpTEkMCIGA1UECgwbTHVsZcOlIHRla25pc2thIHVuaXZlcnNpdGV0MRMw
EQYDVQQLEwpJVC1zZXJ2aWNlMRowGAYDVQQDDBFTdGFmZmFuIEjDpG3DpGzDpDCCASIwDQYJ
KoZIhvcNAQEBBQADggEPADCCAQoCggEBAMrLuMzkYdUuA36vuhSoB1fISbLFeUYrN/LVAT2B
YoNIe3hkVx3JxI7JA1W7qrGN9N2XUFBA0qxulZsc11I0ackAbXLOKDAjrFSsj3uP7K9WJPZ7
A21sRhCRconNHRryn1p4PQsxVJPxdHHXbBcCWckywnXm1BgwrwEppdcLif+QTUTy1G8ZMgZ6
ZQ7I3hgFvRvZ613CxzLJetgu5BlS/NZDs+a2dFVbCJ1SvF4rdSsR8Dds1r5+GV2Bympb7iwY
BIczEOTmPDtvvsLbicNnCb+mSbCQ0rz8WhN0ZNopYHB04Zca55Sdv4yzbxHRrl3hcZMQT1kz
r4vSWWYLbW/sxEsCAwEAAaOCAcgwggHEMB8GA1UdIwQYMBaAFPAh6Ul3c5+Frhg76FJwFAbt
Qu7KMB0GA1UdDgQWBBRIph3ewbKwh2QPNq7V81dXESBEVTAMBgNVHRMBAf8EAjAAMBQGA1Ud
EQQNMAuBCXNoQGx0dS5zZTAOBgNVHQ8BAf8EBAMCBaAwHQYDVR0lBBYwFAYIKwYBBQUHAwIG
CCsGAQUFBwMEMEMGA1UdIAQ8MDowOAYKYIZIAYb9bAQBAjAqMCgGCCsGAQUFBwIBFhxodHRw
czovL3d3dy5kaWdpY2VydC5jb20vQ1BTMHUGA1UdHwRuMGwwNKAyoDCGLmh0dHA6Ly9jcmwz
LmRpZ2ljZXJ0LmNvbS9URVJFTkFQZXJzb25hbENBMy5jcmwwNKAyoDCGLmh0dHA6Ly9jcmw0
LmRpZ2ljZXJ0LmNvbS9URVJFTkFQZXJzb25hbENBMy5jcmwwcwYIKwYBBQUHAQEEZzBlMCQG
CCsGAQUFBzABhhhodHRwOi8vb2NzcC5kaWdpY2VydC5jb20wPQYIKwYBBQUHMAKGMWh0dHA6
Ly9jYWNlcnRzLmRpZ2ljZXJ0LmNvbS9URVJFTkFQZXJzb25hbENBMy5jcnQwDQYJKoZIhvcN
AQELBQADggEBALM/9K49cViNPrXwZdebcAJqnQfzqQzj+t902Gw/DgEzokgMof6DkIBzo35P
vTWgfJZkXO40atDVQ0di2lcpP7lGC2iyjW7E26SI30BFy0i/jQMqqm4mfYgpvXTIIkjqfT/q
k7hrE/OmR0adMJxUbwZLrEUn45Ky7w1KJkoHVOs+ymA0nRLGpPQ0oHcYiEJuLQDABaogdNV5
7gOqxH0IrgXQfHFUhPVgw6plcbINg9qLJI3N8ZDmcbFRNMmh37XEHIH483OyqPAAGdBQ/fb3
oLFlixgVj8i+zi2XgUK4Xq0oRjWD3JzNnVatgJTyI77tUxrmwLusaS4NHf3v4hZFW/ExggOj
MIIDnwIBATB9MGkxCzAJBgNVBAYTAk5MMRYwFAYDVQQIEw1Ob29yZC1Ib2xsYW5kMRIwEAYD
VQQHEwlBbXN0ZXJkYW0xDzANBgNVBAoTBlRFUkVOQTEdMBsGA1UEAxMUVEVSRU5BIFBlcnNv
bmFsIENBIDMCEA6KRacrwXhSF7dO79I8QuMwDQYJYIZIAWUDBAIBBQCgggH3MBgGCSqGSIb3
DQEJAzELBgkqhkiG9w0BBwEwHAYJKoZIhvcNAQkFMQ8XDTE2MTEzMDEwNTY1MFowLwYJKoZI
hvcNAQkEMSIEIMsnIIdGJAkW1+ItyEMDMpJyVqQf8gS6jNP8I5mvNHv+MGwGCSqGSIb3DQEJ
DzFfMF0wCwYJYIZIAWUDBAEqMAsGCWCGSAFlAwQBAjAKBggqhkiG9w0DBzAOBggqhkiG9w0D
AgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYIKoZIhvcNAwICASgwgYwGCSsGAQQB
gjcQBDF/MH0waTELMAkGA1UEBhMCTkwxFjAUBgNVBAgTDU5vb3JkLUhvbGxhbmQxEjAQBgNV
BAcTCUFtc3RlcmRhbTEPMA0GA1UEChMGVEVSRU5BMR0wGwYDVQQDExRURVJFTkEgUGVyc29u
YWwgQ0EgMwIQDopFpyvBeFIXt07v0jxC4zCBjgYLKoZIhvcNAQkQAgsxf6B9MGkxCzAJBgNV
BAYTAk5MMRYwFAYDVQQIEw1Ob29yZC1Ib2xsYW5kMRIwEAYDVQQHEwlBbXN0ZXJkYW0xDzAN
BgNVBAoTBlRFUkVOQTEdMBsGA1UEAxMUVEVSRU5BIFBlcnNvbmFsIENBIDMCEA6KRacrwXhS
F7dO79I8QuMwDQYJKoZIhvcNAQEBBQAEggEAE89Yy+KT1WOF3qSaCo0OFjE0mtYa/gl6Xbms
FaZT9VqZx0FW77ZwKU2u7n5BM3saTW73J+1X5srFt7FW5fcaXxVbxsTtOGM5pZqoLdrj0BYL
mYQxInTKA+Lkrg/IixB65Re3BCx0AINXUcCDZh7ow6opkLRw0I7eqc5sR/R7wlYViNeP/Lna
Ej5I0dIylDDWEfqJGBSgngZmmeuTFnoQpF15vk7wwxqAr9A4PyX58sTnDwGwRF/ml7X5+k4S
17wV3zisNZWWVX4RybQvjy8l1ar48KpKwj09SUu+zhWzMtokNz2qPiCoiXjkZu43Xn+p5ThD
aIFuWQQtPXXEv4vlSgAAAAAAAA==
--------------ms020905040903020002070107--