[OpenAFS-devel] Cannot start afsd with 30GB cache

Martin MOKREJŠ mmokrejs@ribosome.natur.cuni.cz
Mon, 10 Oct 2005 19:56:30 +0200


Hi Jeff,
  thanks for quick answers.

Jeffrey Hutzelman wrote:
> 
> 
> On Monday, October 10, 2005 05:12:35 PM +0200 Martin MOKREJ©
> <mmokrejs@ribosome.natur.cuni.cz> wrote:
> 
>> afsd: Can't mount AFS on /afs(2)
> 
> 
> errno 2 is ENOENT.  Does /afs exist?


Hmm, it did but somehow it disappeared. I am testing partly the gentoo
openafs packages and installed them on a system which worked with manually
installed openafs, something must had deleted the directory. :(
I'll investigate that later. Is it possible to make afsd to die immediately upon
startup if the mountpoint does not exist?




So now I started afsd without dynroot and afsdb using the huge cache and it
claims it got started fine. But when I ran 'df' command the bournal shell stopped
interactivity. I still can login through ssh and issue some commands
if I type in full-paths to the binary. ;) So, at the moment the server answers
but the 'df' comamnd and several others apparently hang.


# /usr/sbin/rxdebug -server phylo -long
Trying 195.113.57.18 (port 7000):
Free packets: 265, packet reclaims: 0, calls: 2, used FDs: 42
not waiting for packets.
0 calls waiting for a thread
11 threads are idle
Connection from host 195.113.57.18, port 7001, Cuid a06cef10/d0509e4
  serial 4,  natMTU 1444, security index 0, client conn
    call 0: # 2, state dally, mode: receiving, flags: receive_done
    call 1: # 0, state not initialized
    call 2: # 0, state not initialized
    call 3: # 0, state not initialized
Connection from host 195.113.57.18, port 7002, Cuid a06cef10/cea7393c
  serial 7,  natMTU 1444, flags pktCksum, security index 2, client conn
  rxkad: level crypt, flags pktCksum
  Received 64 bytes in 3 packets
  Sent 24 bytes in 3 packets
    call 0: # 3, state dally, mode: receiving, flags: receive_done
    call 1: # 0, state not initialized
    call 2: # 0, state not initialized
    call 3: # 0, state not initialized
Done.
#

The above output does not change over the time. Actually not even the one below.


# /usr/bin/cmdebug -server phylo -long
Lock afs_xvcache status: (none_waiting)
Lock afs_xdcache status: (none_waiting)
Lock afs_xserver status: (none_waiting)
Lock afs_xvcb status: (none_waiting)
Lock afs_xbrs status: (none_waiting)
Lock afs_xcell status: (none_waiting)
Lock afs_xconn status: (none_waiting)
Lock afs_xuser status: (none_waiting)
Lock afs_xvolume status: (none_waiting)
Lock puttofile status: (none_waiting)
Lock afs_ftf status: (none_waiting)
Lock afs_xcbhash status: (none_waiting)
Lock afs_xaxs status: (none_waiting)
Lock afs_xinterface status: (none_waiting)
Lock afs_xosi status: (none_waiting)
Lock afs_xsrvAddr status: (none_waiting)
** Cache entry @ 0xf43c6d4c for 1.536870913.1.1 [phylo.natur.cuni.cz]
    2048 bytes  DV 3 refcnt 2
    callback f6bc411c   expires 1128972108
    0 opens     0 writers
    volume root
    states (0x5), stat'd, read-only
#


Here are some connections from the afsd client running on phylo.natur.cuni.cz/195.113.57.18
to the local afs server.

19:28:24.952414 IP (tos 0x0, ttl  64, id 29215, offset 0, flags [none], proto: UDP (17), length: 124) phylo.natur.cuni.cz.afs3-fileserver > phylo.natur.cuni.cz.afs3-vlserver: [bad udp cksum 8173!]  rx data cid cea73934 call# 5 seq 1 ser 6 <client-init>,<last-pckt> vldb call regaddr (96)
        0x0000:  4500 007c 721f 0000 4011 0f4b c371 3912
        0x0010:  c371 3912 1b58 1b5b 0068 f980 a06c ef10
        0x0020:  cea7 3934 0000 0005 0000 0001 0000 0006
        0x0030:  0105 0002 b31e 0034 0000 0214 0083 660c
        0x0040:  0000 17da 0000 131f ffff ff8a 0000 0004
        0x0050:  0000 0012 0000 0039 0000 0071 ffff ffc3
        0x0060:  ffff ffaa 0000 0077 0000 0000 0000 0003
        0x0070:  c371 3912 c0a8 01fe c0a8 02fe
19:28:24.952526 IP (tos 0x0, ttl  64, id 29216, offset 0, flags [none], proto: UDP (17), length: 60) phylo.natur.cuni.cz.afs3-vlserver > phylo.natur.cuni.cz.afs3-fileserver: [bad udp cksum 826!]  rx abort cid cea73934 call# 5 seq 0 ser 6 vldb reply regaddr errcode 5376 (32)
        0x0000:  4500 003c 7220 0000 4011 0f8a c371 3912
        0x0010:  c371 3912 1b5b 1b58 0028 f940 a06c ef10
        0x0020:  cea7 3934 0000 0005 0000 0000 0000 0006
        0x0030:  0400 0002 0000 0034 0000 1500
19:28:24.952919 IP (tos 0x0, ttl  64, id 29217, offset 0, flags [none], proto: UDP (17), length: 124) phylo.natur.cuni.cz.afs3-fileserver > phylo.natur.cuni.cz.afs3-vlserver: [bad udp cksum 110e!]  rx data cid cea73934 call# 6 seq 1 ser 7 <client-init>,<last-pckt> vldb call regaddr (96)
        0x0000:  4500 007c 7221 0000 4011 0f49 c371 3912
        0x0010:  c371 3912 1b58 1b5b 0068 f980 a06c ef10
        0x0020:  cea7 3934 0000 0006 0000 0001 0000 0007
        0x0030:  0105 0002 188d 0034 0000 0214 0083 660c
        0x0040:  0000 17da 0000 131f ffff ff8a 0000 0004
        0x0050:  0000 0012 0000 0039 0000 0071 ffff ffc3
        0x0060:  ffff ffaa 0000 0077 0000 0000 0000 0003
        0x0070:  c371 3912 c0a8 01fe c0a8 02fe
19:28:24.952978 IP (tos 0x0, ttl  64, id 29218, offset 0, flags [none], proto: UDP (17), length: 60) phylo.natur.cuni.cz.afs3-vlserver > phylo.natur.cuni.cz.afs3-fileserver: [bad udp cksum 626!]  rx abort cid cea73934 call# 6 seq 0 ser 7 vldb reply regaddr errcode 5376 (32)
        0x0000:  4500 003c 7222 0000 4011 0f88 c371 3912
        0x0010:  c371 3912 1b5b 1b58 0028 f940 a06c ef10
        0x0020:  cea7 3934 0000 0006 0000 0000 0000 0007
        0x0030:  0400 0002 0000 0034 0000 1500



19:38:24.911199 IP (tos 0x0, ttl  64, id 29413, offset 0, flags [none], proto: UDP (17), length: 104) phylo.natur.cuni.cz.afs3-fileserver > phylo.natur.cuni.cz.afs3-callback: [bad udp cksum 42d1!]  rx data cid 0d0509e4 call# 3 seq 1 ser 5 <client-init>,<last-pckt> cb call probeuuid afsuuid 005fa605a2d0134a9cd3c3713912aa77 (76)
        0x0000:  4500 0068 72e5 0000 4011 0e99 c371 3912
        0x0010:  c371 3912 1b58 1b59 0054 f96c a06c ef10
        0x0020:  0d05 09e4 0000 0003 0000 0001 0000 0005
        0x0030:  0105 0000 0000 0001 0000 00d6 005f a605
        0x0040:  0000 a2d0 0000 134a ffff ff9c ffff ffd3
        0x0050:  ffff ffc3 0000 0071 0000 0039 0000 0012
        0x0060:  ffff ffaa 0000 0077
19:38:24.911292 IP (tos 0x0, ttl  64, id 29414, offset 0, flags [none], proto: UDP (17), length: 56) phylo.natur.cuni.cz.afs3-callback > phylo.natur.cuni.cz.afs3-fileserver: [bad udp cksum 402f!]  rx data cid 0d0509e4 call# 3 seq 1 ser 1 <last-pckt> (28)
        0x0000:  4500 0038 72e6 0000 4011 0ec8 c371 3912
        0x0010:  c371 3912 1b59 1b58 0024 f93c a06c ef10
        0x0020:  0d05 09e4 0000 0003 0000 0001 0000 0001
        0x0030:  0104 0000 0000 0001
19:38:24.911338 IP (tos 0x0, ttl  64, id 29415, offset 0, flags [none], proto: UDP (17), length: 93) phylo.natur.cuni.cz.afs3-fileserver > phylo.natur.cuni.cz.afs3-callback: [bad udp cksum 9121!]  rx ack cid 0d0509e4 call# 3 seq 0 ser 6 <client-init>,<slow-start> first 2 serial 0 reason delay ifmtu 5692 maxmtu 1444 rwind 32 maxpackets 4 (65)
        0x0000:  4500 005d 72e7 0000 4011 0ea2 c371 3912
        0x0010:  c371 3912 1b58 1b59 0049 f961 a06c ef10
        0x0020:  0d05 09e4 0000 0003 0000 0000 0000 0006
        0x0030:  0221 0000 0000 0001 0000 0000 0000 0002
        0x0040:  0000 0001 0000 0000 0800 0000 0000 0016
        0x0050:  3c00 0005 a400 0000 2000 0000 04
19:38:24.915216 IP (tos 0x0, ttl  64, id 29416, offset 0, flags [none], proto: UDP (17), length: 124) phylo.natur.cuni.cz.afs3-fileserver > phylo.natur.cuni.cz.afs3-vlserver: [bad udp cksum 80bd!]  rx data cid cea73934 call# 9 seq 1 ser 10 <client-init>,<last-pckt> vldb call regaddr (96)
        0x0000:  4500 007c 72e8 0000 4011 0e82 c371 3912
        0x0010:  c371 3912 1b58 1b5b 0068 f980 a06c ef10
        0x0020:  cea7 3934 0000 0009 0000 0001 0000 000a
        0x0030:  0105 0002 6917 0034 0000 0214 0083 660c
        0x0040:  0000 17da 0000 131f ffff ff8a 0000 0004
        0x0050:  0000 0012 0000 0039 0000 0071 ffff ffc3
        0x0060:  ffff ffaa 0000 0077 0000 0000 0000 0003
        0x0070:  c371 3912 c0a8 01fe c0a8 02fe
19:38:24.915321 IP (tos 0x0, ttl  64, id 29417, offset 0, flags [none], proto: UDP (17), length: 60) phylo.natur.cuni.cz.afs3-vlserver > phylo.natur.cuni.cz.afs3-fileserver: [bad udp cksum 26!]  rx abort cid cea73934 call# 9 seq 0 ser 10 vldb reply regaddr errcode 5376 (32)
        0x0000:  4500 003c 72e9 0000 4011 0ec1 c371 3912
        0x0010:  c371 3912 1b5b 1b58 0028 f940 a06c ef10
        0x0020:  cea7 3934 0000 0009 0000 0000 0000 000a
        0x0030:  0400 0002 0000 0034 0000 1500
19:38:24.915791 IP (tos 0x0, ttl  64, id 29418, offset 0, flags [none], proto: UDP (17), length: 124) phylo.natur.cuni.cz.afs3-fileserver > phylo.natur.cuni.cz.afs3-vlserver: [bad udp cksum 7e73!]  rx data cid cea73934 call# 10 seq 1 ser 11 <client-init>,<last-pckt> vldb call regaddr (96)
        0x0000:  4500 007c 72ea 0000 4011 0e80 c371 3912
        0x0010:  c371 3912 1b58 1b5b 0068 f980 a06c ef10
        0x0020:  cea7 3934 0000 000a 0000 0001 0000 000b
        0x0030:  0105 0002 b317 0034 0000 0214 0083 660c
        0x0040:  0000 17da 0000 131f ffff ff8a 0000 0004
        0x0050:  0000 0012 0000 0039 0000 0071 ffff ffc3
        0x0060:  ffff ffaa 0000 0077 0000 0000 0000 0003
        0x0070:  c371 3912 c0a8 01fe c0a8 02fe
19:38:24.915850 IP (tos 0x0, ttl  64, id 29419, offset 0, flags [none], proto: UDP (17), length: 60) phylo.natur.cuni.cz.afs3-vlserver > phylo.natur.cuni.cz.afs3-fileserver: [bad udp cksum fe25!]  rx abort cid cea73934 call# 10 seq 0 ser 11 vldb reply regaddr errcode 5376 (32)
        0x0000:  4500 003c 72eb 0000 4011 0ebf c371 3912
        0x0010:  c371 3912 1b5b 1b58 0028 f940 a06c ef10
        0x0020:  cea7 3934 0000 000a 0000 0000 0000 000b
        0x0030:  0400 0002 0000 0034 0000 1500


19:43:24.896535 IP (tos 0x0, ttl  64, id 29423, offset 0, flags [none], proto: UDP (17), length: 104) phylo.natur.cuni.cz.afs3-fileserver > phylo.natur.cuni.cz.afs3-callback: [bad udp cksum 3fd1!]  rx data cid 0d0509e4 call# 4 seq 1 ser 7 <client-init>,<last-pckt> cb call probeuuid afsuuid 005fa605a2d0134a9cd3c3713912aa77 (76)
        0x0000:  4500 0068 72ef 0000 4011 0e8f c371 3912
        0x0010:  c371 3912 1b58 1b59 0054 f96c a06c ef10
        0x0020:  0d05 09e4 0000 0004 0000 0001 0000 0007
        0x0030:  0105 0000 0000 0001 0000 00d6 005f a605
        0x0040:  0000 a2d0 0000 134a ffff ff9c ffff ffd3
        0x0050:  ffff ffc3 0000 0071 0000 0039 0000 0012
        0x0060:  ffff ffaa 0000 0077
19:43:24.896625 IP (tos 0x0, ttl  64, id 29424, offset 0, flags [none], proto: UDP (17), length: 56) phylo.natur.cuni.cz.afs3-callback > phylo.natur.cuni.cz.afs3-fileserver: [bad udp cksum 3e2f!]  rx data cid 0d0509e4 call# 4 seq 1 ser 2 <last-pckt> (28)
        0x0000:  4500 0038 72f0 0000 4011 0ebe c371 3912
        0x0010:  c371 3912 1b59 1b58 0024 f93c a06c ef10
        0x0020:  0d05 09e4 0000 0004 0000 0001 0000 0002
        0x0030:  0104 0000 0000 0001
19:43:24.896673 IP (tos 0x0, ttl  64, id 29425, offset 0, flags [none], proto: UDP (17), length: 93) phylo.natur.cuni.cz.afs3-fileserver > phylo.natur.cuni.cz.afs3-callback: [bad udp cksum 8e21!]  rx ack cid 0d0509e4 call# 4 seq 0 ser 8 <client-init>,<slow-start> first 2 serial 0 reason delay ifmtu 5692 maxmtu 1444 rwind 32 maxpackets 4 (65)
        0x0000:  4500 005d 72f1 0000 4011 0e98 c371 3912
        0x0010:  c371 3912 1b58 1b59 0049 f961 a06c ef10
        0x0020:  0d05 09e4 0000 0004 0000 0000 0000 0008
        0x0030:  0221 0000 0000 0001 0000 0000 0000 0002
        0x0040:  0000 0001 0000 0000 0800 0000 0000 0016
        0x0050:  3c00 0005 a400 0000 2000 0000 04
19:43:24.900546 IP (tos 0x0, ttl  64, id 29426, offset 0, flags [none], proto: UDP (17), length: 124) phylo.natur.cuni.cz.afs3-fileserver > phylo.natur.cuni.cz.afs3-vlserver: [bad udp cksum 88d3!]  rx data cid cea73934 call# 11 seq 1 ser 12 <client-init>,<last-pckt> vldb call regaddr (96)
        0x0000:  4500 007c 72f2 0000 4011 0e78 c371 3912
        0x0010:  c371 3912 1b58 1b5b 0068 f980 a06c ef10
        0x0020:  cea7 3934 0000 000b 0000 0001 0000 000c
        0x0030:  0105 0002 530b 0034 0000 0214 0083 660c
        0x0040:  0000 17da 0000 131f ffff ff8a 0000 0004
        0x0050:  0000 0012 0000 0039 0000 0071 ffff ffc3
        0x0060:  ffff ffaa 0000 0077 0000 0000 0000 0003
        0x0070:  c371 3912 c0a8 01fe c0a8 02fe
19:43:24.900649 IP (tos 0x0, ttl  64, id 29427, offset 0, flags [none], proto: UDP (17), length: 60) phylo.natur.cuni.cz.afs3-vlserver > phylo.natur.cuni.cz.afs3-fileserver: [bad udp cksum fc25!]  rx abort cid cea73934 call# 11 seq 0 ser 12 vldb reply regaddr errcode 5376 (32)
        0x0000:  4500 003c 72f3 0000 4011 0eb7 c371 3912
        0x0010:  c371 3912 1b5b 1b58 0028 f940 a06c ef10
        0x0020:  cea7 3934 0000 000b 0000 0000 0000 000c
        0x0030:  0400 0002 0000 0034 0000 1500
19:43:24.901087 IP (tos 0x0, ttl  64, id 29428, offset 0, flags [none], proto: UDP (17), length: 124) phylo.natur.cuni.cz.afs3-fileserver > phylo.natur.cuni.cz.afs3-vlserver: [bad udp cksum 817d!]  rx data cid cea73934 call# 12 seq 1 ser 13 <client-init>,<last-pckt> vldb call regaddr (96)
        0x0000:  4500 007c 72f4 0000 4011 0e76 c371 3912
        0x0010:  c371 3912 1b58 1b5b 0068 f980 a06c ef10
        0x0020:  cea7 3934 0000 000c 0000 0001 0000 000d
        0x0030:  0105 0002 a910 0034 0000 0214 0083 660c
        0x0040:  0000 17da 0000 131f ffff ff8a 0000 0004
        0x0050:  0000 0012 0000 0039 0000 0071 ffff ffc3
        0x0060:  ffff ffaa 0000 0077 0000 0000 0000 0003
        0x0070:  c371 3912 c0a8 01fe c0a8 02fe
19:43:24.901142 IP (tos 0x0, ttl  64, id 29429, offset 0, flags [none], proto: UDP (17), length: 60) phylo.natur.cuni.cz.afs3-vlserver > phylo.natur.cuni.cz.afs3-fileserver: [bad udp cksum fa25!]  rx abort cid cea73934 call# 12 seq 0 ser 13 vldb reply regaddr errcode 5376 (32)
        0x0000:  4500 003c 72f5 0000 4011 0eb5 c371 3912
        0x0010:  c371 3912 1b5b 1b58 0028 f940 a06c ef10
        0x0020:  cea7 3934 0000 000c 0000 0000 0000 000d
        0x0030:  0400 0002 0000 0034 0000 1500