This is a multi-part message in MIME format.
--------------000900050408060703090407
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Hi, I have tested openafs snapshot from Apr 8 on i686 box and have
noticed the machine mor eor less blocks on shutdown. Yesteday the
xscreensaver was running, but typing password on keyboard did not result
in asterisks appearing in the box, so I couldn't unlock the screen (not
even ctrl+alt+backspace).
Today I've connected remote serial console, so I can confirm afs doesn't
crash, but have managed to get using SysRq keys some stack where it's
hanging. The machine is running typical server services under bos and
also a client (memcache). /vicepa is ext2. The kernel is linux-2.6.11.6
and I can provide configure options used to compile it (largefile enabled).
Any clues what to do to find the problem? Attached is what I've
collected on remote console before turning the power off again. :(
Martin
--------------000900050408060703090407
Content-Type: text/plain;
name="shutdown.txt"
Content-Transfer-Encoding: 7bit
Content-Disposition: inline;
filename="shutdown.txt"
<6>SysRq : Emergency Sync
SysRq : Emergency Sync
SysRq : Emergency Sync
SysRq : Show State
SysRq : Kill All Tasks
BkG... <6>SysRq : Kill All Tasks
SysRq : Kill All Tasks
SysRq : Show State
sibling
task PC pid father child younger older
init S C2961EA4 0 1 0 2 (NOTLB)
c2961ea0 00000086 000000d0 c2961ea4 c013bb8d 00000001 00000000 00000000
dcf65747 000006cd c2939b10 0000a921 dcf65747 000006cd c2936c60 006d4e91
c2961eb4 0000000b c2961edc c03d0365 c2961f3c c2961ec4 c2961ec4 c0582c98
Call Trace:
[<c03d0365>] schedule_timeout+0x57/0xa4
[<c0167ab3>] do_select+0x252/0x291
[<c0167d3b>] sys_select+0x22c/0x435
[<c0102e57>] syscall_call+0x7/0xb
ksoftirqd/0 S C012CEE0 0 2 1 3 (L-TLB)
c2963fb4 00000046 c2963f88 c012cee0 00000000 c0582148 00000006 c2963f94
c0122053 00000001 c2963fa8 000000ab dcf65df5 000006cd c2939c60 c2962000
c2962000 c2962000 c2963fc8 c01221ed c2962000 c2961f84 00000000 c2963fec
Call Trace:
[<c01221ed>] ksoftirqd+0xb4/0xb6
[<c0130021>] kthread+0x8a/0xb7
[<c01012b1>] kernel_thread_helper+0x5/0xb
events/0 R running 0 3 1 4 2 (L-TLB)
khelper S C294AF10 0 4 1 9 3 (L-TLB)
c2983f3c 00000046 00000000 c294af10 00000001 00000003 00000000 00000082
00000001 c2983f3c dfc08b10 00000079 db687752 000006cd c294bc60 dfc2dc34
00000292 c294af00 c2983fc8 c012c1d9 00000000 c2936b10 c2936b10 c2982000
Call Trace:
[<c012c1d9>] worker_thread+0x128/0x27c
[<c0130021>] kthread+0x8a/0xb7
[<c01012b1>] kernel_thread_helper+0x5/0xb
kthread S C2991F10 0 9 1 20 120 4 (L-TLB)
c2995f3c 00000046 0000007b c2991f10 00000001 00000003 00000000 00000082 00000001 c2995f3c f76c9b10 00000043 98bca133 0000000b c295dc60 c2961eec
00000292 c2991f00 c2995fc8 c012c1d9 00000000 c2936b10 c2936b10 c2994000
Call Trace:
[<c012c1d9>] worker_thread+0x128/0x27c
[<c0130021>] kthread+0x8a/0xb7
[<c01012b1>] kernel_thread_helper+0x5/0xb
kacpid S 5A5A5A5A 0 20 9 107 (L-TLB)
c29c7f3c 00000046 5a5a5a5a 5a5a5a5a 5a5a5a5a 00010000 00010000 c29a3b10
c29c6000 c29c7f3c c2936b10 0000031e aedd03e4 0000000a c29a3c60 c29c6000
c2961f28 c29c7f90 c29c7fc8 c012c1d9 00000000 c295db10 c295db10 c29c6000
Call Trace:
[<c012c1d9>] worker_thread+0x128/0x27c
[<c0130021>] kthread+0x8a/0xb7
[<c01012b1>] kernel_thread_helper+0x5/0xb
kblockd/0 S F7E91F10 0 107 9 203 20 (L-TLB)
f7e29f3c 00000046 f7e29f1c f7e91f10 00000001 00000003 00000000 00000082
00000001 f7e29f3c c0119bbc 0000184a 9c3adf35 000006ba f7dfbc60 f775ff18
00000246 f7e91f00 f7e29fc8 c012c1d9 00000000 c295db10 c295db10 f7e28000
Call Trace:
[<c012c1d9>] worker_thread+0x128/0x27c
[<c0130021>] kthread+0x8a/0xb7
[<c01012b1>] kernel_thread_helper+0x5/0xb
pdflush D 5A5A5A5A 0 203 9 204 107 (L-TLB)
f781df1c 00000046 5a5a5a5a 5a5a5a5a 5a5a5a5a 5a5a5a5a 5a5a5a5a 5a5a5a5a
5a5a5a5a 5a5a5a5a 5a5a5a5a 00000127 7614cb34 000006cd f7ff8c60 fffe0002
de2d3e38 f7ff8b10 f781df4c c03d06a7 de2d3e3c f781df88 f781df40 de2d3e3c
Call Trace:
[<c03d06a7>] rwsem_down_read_failed+0x95/0x18f
[<c0177429>] .text.lock.fs_writeback+0x1b/0x22
[<c017711a>] sync_inodes+0x30/0x74
[<c0157241>] do_sync+0x17/0x5c
[<c013d73e>] __pdflush+0xd6/0x1ee
[<c013d874>] pdflush+0x1e/0x20
[<c0130021>] kthread+0x8a/0xb7
[<c01012b1>] kernel_thread_helper+0x5/0xb
pdflush D F73DBED4 0 204 9 206 203 (L-TLB)
f78eff1c 00000046 c016eb73 f73dbed4 f78eff14 c0176d79 857b3d00 001b3595
656160bf 000006cd f7ff8b10 00000121 65616559 000006cd f78ccc60 ffff0002
de2d3e38 f78ccb10 f78eff4c c03d06a7 de2d3e3c c0119074 00000001 f781df30
Call Trace:
[<c03d06a7>] rwsem_down_read_failed+0x95/0x18f
[<c0177429>] .text.lock.fs_writeback+0x1b/0x22
[<c017711a>] sync_inodes+0x30/0x74 [<c0157241>] do_sync+0x17/0x5c
[<c013d73e>] __pdflush+0xd6/0x1ee
[<c013d874>] pdflush+0x1e/0x20
[<c0130021>] kthread+0x8a/0xb7
[<c01012b1>] kernel_thread_helper+0x5/0xb
khubd S 00000003 0 120 1 205 9 (L-TLB)
f7ffbf90 00000046 f5547ef8 00000003 f7ffbf90 c0322e45 00000000 00000000
e32f5ee0 0000000e f6521b10 00001fe4 e414fff9 0000000e f7fd3c60 f7ffa000
f7ffa000 f7ffbfb4 f7ffbfec c0322f81 c0410966 f7ffa000 00000000 f7fd3b10
Call Trace:
[<c0322f81>] hub_thread+0x83/0xea
[<c01012b1>] kernel_thread_helper+0x5/0xb
kswapd0 S 0000000C 0 205 1 209 120 (L-TLB)
f7901f80 00000046 00000000 0000000c 00000001 00000000 00000000 00000020
bc437ffe 00000090 f7935b10 00009824 bc4735a5 00000090 f78cfc60 c04459bc
00000000 c0445600 f7901fec c01438fd c03f9fdb 00000000 c0445600 f7900000
Call Trace:
[<c01438fd>] kswapd+0xf4/0xff
[<c01012b1>] kernel_thread_helper+0x5/0xb
aio/0 S 5A5A5A5A 0 206 9 207 204 (L-TLB)
f7943f3c 00000046 5a5a5a5a 5a5a5a5a 5a5a5a5a 00010000 00010000 f791cb10
f7942000 f7943f3c c2936b10 0000008e c937271b 0000000a f791cc60 f7942000
c2961f2c f7943f90 f7943fc8 c012c1d9 00000000 c295db10 c295db10 f7942000
Call Trace:
[<c012c1d9>] worker_thread+0x128/0x27c
[<c0130021>] kthread+0x8a/0xb7
[<c01012b1>] kernel_thread_helper+0x5/0xb
xfslogd/0 S F792DF10 0 207 9 208 206 (L-TLB)
f7955f3c 00000046 0002d225 f792df10 00000001 00000003 00000000 00000082
d9123be5 000006cd cebc0b10 0001304a d9123be5 000006cd f792ec60 f71c5f80
00000202 f792df00 f7955fc8 c012c1d9 00000000 c295db10 c295db10 f7954000
Call Trace:
[<c012c1d9>] worker_thread+0x128/0x27c
[<c0130021>] kthread+0x8a/0xb7
[<c01012b1>] kernel_thread_helper+0x5/0xb
xfsdatad/0 S 5A5A5A5A 0 208 9 853 207 (L-TLB)
f7967f3c 00000046 5a5a5a5a 5a5a5a5a 5a5a5a5a 00010000 00010000 f7932b10
f7966000 f7967f3c c2936b10 00000069 ca83ebff 0000000a f7932c60 f7966000
c2961ed0 f7967f90 f7967fc8 c012c1d9 00000000 c295db10 c295db10 f7966000
Call Trace:
[<c012c1d9>] worker_thread+0x128/0x27c
[<c0130021>] kthread+0x8a/0xb7
[<c01012b1>] kernel_thread_helper+0x5/0xb xfsbufd S C29C0F10 0 209 1 804 205 (L-TLB)
f7969f84 00000046 00000000 c29c0f10 00000000 00000001 c34b9f24 f7969f64
00000000 f7969f98 f7969f84 00000045 2419f47b 000006ce f7935c60 006d439f
f7969f98 f7969fd4 f7969fc0 c03d0365 00000000 f7935b10 c0119b0f c0582920
Call Trace:
[<c03d0365>] schedule_timeout+0x57/0xa4
[<c021c6e3>] pagebuf_daemon+0x67/0x1bc
[<c01012b1>] kernel_thread_helper+0x5/0xb
kseriod S 00000000 0 804 1 848 209 (L-TLB)
f798df90 00000046 f798df84 00000000 f798df78 f798c000 f798c000 00000000
c0444d40 f798df78 c294bb10 00000223 1bec32b3 0000000b f7946c60 f798c000
f798c000 f798dfb4 f798dfec c02bd649 c040c116 f798c000 00000000 f7946b10
Call Trace:
[<c02bd649>] serio_thread+0x88/0x100
[<c01012b1>] kernel_thread_helper+0x5/0xb
scsi_eh_0 S F79C9F50 0 848 1 855 804 (L-TLB)
f79c9f74 00000046 00002e59 f79c9f50 c0118e97 00000000 c2936b10 c2936b10
96431630 f79c9f68 c2936b10 0000038b 96431904 0000000b f7991c60 f79c8000
f79c9fd4 00000246 f79c9fb4 c03cf406 f79c9fdc f7991b10 00000000 00000001
Call Trace:
[<c03cf406>] __down_interruptible+0x9e/0x154
[<c03cf4d6>] __down_failed_interruptible+0xa/0x10
[<c0304a1b>] .text.lock.scsi_error+0x39/0x3e
[<c01012b1>] kernel_thread_helper+0x5/0xb
ata/0 S F7736F10 0 853 9 208 (L-TLB)
f76ebf3c 00000046 00000003 f7736f10 00000001 00000003 00000000 00000082
00000001 f76ebf3c c2936b10 00004665 afc17e19 0000000b f76c9c60 f774bf54
00000297 f7736f00 f76ebfc8 c012c1d9 00000000 c295db10 c295db10 f76ea000
Call Trace:
[<c012c1d9>] worker_thread+0x128/0x27c
[<c0130021>] kthread+0x8a/0xb7
[<c01012b1>] kernel_thread_helper+0x5/0xb
scsi_eh_1 S F776DF50 0 855 1 856 848 (L-TLB)
f776df74 00000046 00002e66 f776df50 c0118e97 00000000 c2936b10 c2936b10
99bb36f3 f776df68 c2936b10 0000039b 99bb390e 0000000b f7746c60 f776c000
f776dfd4 00000246 f776dfb4 c03cf406 f776dfdc f7746b10 00000000 00000001
Call Trace:
[<c03cf406>] __down_interruptible+0x9e/0x154
[<c03cf4d6>] __down_failed_interruptible+0xa/0x10
[<c0304a1b>] .text.lock.scsi_error+0x39/0x3e
[<c01012b1>] kernel_thread_helper+0x5/0xb
scsi_eh_2 S F777FF50 0 856 1 919 855 (L-TLB)
f777ff74 00000046 00002e6a f777ff50 c0118e97 00000000 c2936b10 c2936b10 9aaf58db f777ff68 c2936b10 0000039f 9aaf5a51 0000000b f774dc60 f777e000
f777ffd4 00000246 f777ffb4 c03cf406 f777ffdc f774db10 00000000 00000001
Call Trace:
[<c03cf406>] __down_interruptible+0x9e/0x154
[<c03cf4d6>] __down_failed_interruptible+0xa/0x10
[<c0304a1b>] .text.lock.scsi_error+0x39/0x3e
[<c01012b1>] kernel_thread_helper+0x5/0xb
xfssyncd S F71BCEF8 0 919 1 12852 856 (L-TLB)
f7043f80 00000046 f7786bf8 f71bcef8 f7043f60 c01ffe1f 0000235a f71ccf24
00000000 f7043f94 f7043f80 000001ba 778a2c69 000006cb f7019c60 006d87e8
f7043f94 f70c0448 f7043fbc c03d0365 f7043fac c0119bbc 00000000 c0582fd8
Call Trace:
[<c03d0365>] schedule_timeout+0x57/0xa4
[<c02219e1>] xfssyncd+0x7f/0x1dc
[<c01012b1>] kernel_thread_helper+0x5/0xb
afs_rxlistene S 00000011 0 12852 1 12856 919 (L-TLB)
cc513cac 00000046 00000000 00000011 581b591b 00000000 00000000 00000000
dda944dc 000006b0 cd920b10 00000055 dda98c92 000006b0 cebddc60 00000000
7fffffff cc513d18 cc513ce8 c03d03b0 00000000 cc513cd0 c0115bb1 dfd80000
Call Trace:
[<c03d03b0>] schedule_timeout+0xa2/0xa4
[<c0386a00>] wait_for_packet+0xe8/0x12e
[<c0386ad8>] skb_recv_datagram+0x92/0xd5
[<c03babee>] udp_recvmsg+0x9e/0x2d8
[<c0384461>] sock_common_recvmsg+0x46/0x61
[<c0380ec7>] sock_recvmsg+0xbd/0xe1
[<fa692d15>] osi_NetReceive+0x9c/0xef [libafs]
[<fa693680>] rxk_ReadPacket+0x89/0x149 [libafs]
[<fa69379c>] rxk_Listener+0x5c/0x150 [libafs]
[<fa6a24ae>] afsd_thread+0xb1/0x395 [libafs]
[<c01012b1>] kernel_thread_helper+0x5/0xb
afs_rxevent S 00000001 0 12856 1 12866 12852 (L-TLB)
cebedf0c 00000046 cd452e44 00000001 00000003 00000000 00000292 00000001
00000000 cebedf20 cebedf0c 000002a7 506f8e5f 000006ce cb192c60 006d4496
cebedf20 cebec000 cebedf48 c03d0365 fa6923bc cd452df8 00000000 c0582c48
Call Trace:
[<c03d0365>] schedule_timeout+0x57/0xa4
[<fa69f04d>] osi_TimedSleep+0x88/0xee [libafs]
[<fa69ed53>] afs_osi_Wait+0x4a/0x65 [libafs]
[<fa6935a2>] afs_rxevent_daemon+0x1c/0x71 [libafs]
[<fa6a26e1>] afsd_thread+0x2e4/0x395 [libafs]
[<c01012b1>] kernel_thread_helper+0x5/0xb
afs_cachetrim S DE2B5B1D 0 12866 1 17570 12856 (L-TLB) [<c0380ec7>] sock_recvmsg+0xbd/0xe1
[<fa692d15>] osi_NetReceive+0x9c/0xef [libafs]
[<fa693680>] rxk_ReadPacket+0x89/0x149 [libafs]
[<fa69379c>] rxk_Listener+0x5c/0x150 [libafs]
[<fa6a24ae>] afsd_thread+0xb1/0x395 [libafs]
[<c01012b1>] kernel_thread_helper+0x5/0xb
afs_rxevent S 00000001 0 12856 1 12866 12852 (L-TLB)
cebedf0c 00000046 cd452e44 00000001 00000003 00000000 00000292 00000001
00000000 cebedf20 cebedf0c 000002a7 506f8e5f 000006ce cb192c60 006d4496
cebedf20 cebec000 cebedf48 c03d0365 fa6923bc cd452df8 00000000 c0582c48
Call Trace:
[<c03d0365>] schedule_timeout+0x57/0xa4
[<fa69f04d>] osi_TimedSleep+0x88/0xee [libafs]
[<fa69ed53>] afs_osi_Wait+0x4a/0x65 [libafs]
[<fa6935a2>] afs_rxevent_daemon+0x1c/0x71 [libafs]
[<fa6a26e1>] afsd_thread+0x2e4/0x395 [libafs]
[<c01012b1>] kernel_thread_helper+0x5/0xb
afs_cachetrim S DE2B5B1D 0 12866 1 17570 12856 (L-TLB)
cd405f38 00000046 f9e407c0 de2b5b1d 00000000 cd405f1c fa69be23 00000000
00000000 fe996972 de2d4b10 0000079f 388bd731 00000097 de2d7c60 cd404000
cd404000 de2b5b1c cd405f98 fa69eecf de2b5b2c 00000000 00000000 00000000
Call Trace:
[<fa69eecf>] afs_osi_SleepSig+0xc8/0x104 [libafs]
[<fa69ef70>] afs_osi_Sleep+0x65/0xba [libafs]
[<fa65a8b3>] afs_CacheTruncateDaemon+0x2eb/0x421 [libafs]
[<fa6a2656>] afsd_thread+0x259/0x395 [libafs]
[<c01012b1>] kernel_thread_helper+0x5/0xb
umount S B96D4330 0 17570 1 12866 (NOTLB)
f476fe9c 00000086 00011734 b96d4330 001b3769 f476fe80 c0118e97 00000000
de2bfb10 de2bfb10 f4a1ab10 000000a8 da6e7b56 000006cd ce03ec60 f476e000
f476e000 de2b5cd4 f476fefc fa69eecf de2b5ce4 00000000 00000000 00000000
Call Trace:
[<fa69eecf>] afs_osi_SleepSig+0xc8/0x104 [libafs]
[<fa69ef70>] afs_osi_Sleep+0x65/0xba [libafs]
[<fa6a37c0>] afs_shutdown+0x2c2/0x382 [libafs]
[<fa69f554>] afs_put_super+0x26/0x9d [libafs]
[<c015ba09>] generic_shutdown_super+0x122/0x12e
[<c015c2e7>] kill_anon_super+0xc/0x4a
[<c015b7dd>] deactivate_super+0x65/0x84
[<c017097a>] sys_umount+0x37/0x76
[<c01709d2>] sys_oldumount+0x19/0x1b
[<c0102e57>] syscall_call+0x7/0xb
--------------000900050408060703090407--