[OpenAFS] 1.4.2 fileserver keep getting large number of blocked connections

Matthew Cocker cockerm@gmail.com
Mon, 30 Jul 2007 22:06:53 +1200


------=_Part_26362_17648632.1185790013637
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

Tonight we had 10 of our afs fielserver lockup. I had upgraded so to
1.4.4but they dies as well. All run on redhat 3 up6. Only one process
shows in ps
listing and gcores on this process seem to give nothing. A pstack dump is
below. Is it any good. This is now a real disaster and very weird. I have
other fileserver that are setup identically which are not dying. The only
difference is that these are on a different subnet and a different server
room.

Thread 22 (Thread -1218524240 (LWP 27894)):
#0  0x0044cc84 in sigwait () from /lib/tls/libpthread.so.0
#1  0x08073a32 in ?? ()
#2  0xb75ec9f0 in ?? ()
#3  0xb75ec96c in ?? ()
#4  0x00000000 in ?? ()
Thread 21 (Thread -1229263952 (LWP 27895)):
#0  0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()
#1  0x080b3c0e in ?? ()
#2  0x08646828 in ?? ()
#3  0x086467dc in ?? ()
#4  0xb6bae328 in ?? ()
#5  0x080af859 in ?? ()
#6  0x00000001 in ?? ()
#7  0x00000000 in ?? ()
Thread 20 (Thread -1240114256 (LWP 27896)):
#0  0x0044959b in pthread_cond_timedwait@@GLIBC_2.3.2 ()
#1  0x0808e5c0 in ?? ()
#2  0x080f9540 in stderr ()
#3  0x080f94c0 in stderr ()
#4  0xb6155a58 in ?? ()
#5  0x01cfe9b8 in ?? ()
#6  0x00000000 in ?? ()
Thread 19 (Thread -1254962256 (LWP 27897)):
#0  0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()
#1  0x0806fe71 in ?? ()
#2  0xb490bba8 in ?? ()
#3  0xb490bb60 in ?? ()
#4  0xb532c428 in ?? ()
#5  0x08085a21 in ?? ()
#6  0xab1da358 in ?? ()
#7  0x00000000 in ?? ()
Thread 18 (Thread -1265587280 (LWP 27898)):
#0  0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()
#1  0x0806fe71 in ?? ()
#2  0xb490bba8 in ?? ()
#3  0xb490bb60 in ?? ()
#4  0xb490a428 in ?? ()
#5  0x08085a21 in ?? ()
#6  0xab1c93a0 in ?? ()
#7  0x00000000 in ?? ()
Thread 17 (Thread -1276077136 (LWP 27899)):
#0  0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()
#1  0x0806fe71 in ?? ()
#2  0xb490bba8 in ?? ()
#3  0xb490bb60 in ?? ()
#4  0x00000001 in ?? ()
#5  0xb3f093d8 in ?? ()
#6  0x00c650fd in malloc () from /lib/tls/libc.so.6
#7  0x0805ea56 in ?? ()
#8  0xb490bb5c in ?? ()
#9  0x00000002 in ?? ()
#10 0x00000001 in ?? ()
#11 0x00449ed5 in pthread_getspecific () from /lib/tls/libpthread.so.0
#12 0x0805f182 in ?? ()
#13 0xb490bb08 in ?? ()
#14 0x00448b20 in pthread_mutex_unlock () from /lib/tls/libpthread.so.0
#15 0x080604de in ?? ()
#16 0x07ead882 in ?? ()
#17 0x0000591b in ?? ()
#18 0xb3f09474 in ?? ()
#19 0x0000591b in ?? ()
#20 0x0854a3f8 in ?? ()
#21 0x591b5f70 in ?? ()
#22 0x00000000 in ?? ()
Thread 16 (Thread -1286566992 (LWP 27900)):
#0  0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()
#1  0x080a3a82 in ?? ()
#2  0x087244cc in ?? ()
#3  0x080f9758 in stderr ()
#4  0xb3508a18 in ?? ()
#5  0x080a3e85 in ?? ()
#6  0x00000000 in ?? ()
Thread 15 (Thread -1297056848 (LWP 27901)):
#0  0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()
#1  0x0806fe71 in ?? ()
#2  0xb490bba8 in ?? ()
#3  0xb490bb60 in ?? ()
#4  0xb2b07428 in ?? ()
#5  0x08085a21 in ?? ()
#6  0xaabb1b90 in ?? ()
#7  0x00000002 in ?? ()
#8  0xb490bb08 in ?? ()
#9  0xb490bb08 in ?? ()
#10 0xb490bb60 in ?? ()
#11 0x03ead882 in ?? ()
#12 0xb2b073f8 in ?? ()
#13 0x0805ea56 in ?? ()
#14 0xb490bb5c in ?? ()
#15 0x00000002 in ?? ()
#16 0xaabb1b98 in ?? ()
#17 0x00449ed5 in pthread_getspecific () from /lib/tls/libpthread.so.0
Thread 14 (Thread -1307546704 (LWP 27902)):
#0  0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()
#1  0x0806fe71 in ?? ()
#2  0xb490bba8 in ?? ()
#3  0xb490bb60 in ?? ()
#4  0xb2106428 in ?? ()
#5  0x08085a21 in ?? ()
#6  0x08e01618 in ?? ()
#7  0x00000000 in ?? ()
Thread 13 (Thread -1318036560 (LWP 27903)):
#0  0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()
#1  0x0806fe71 in ?? ()
#2  0xb490bba8 in ?? ()
#3  0xb490bb60 in ?? ()
#4  0xb1705428 in ?? ()
#5  0x08085a21 in ?? ()
#6  0xaac696f8 in ?? ()
#7  0x00000002 in ?? ()
#8  0xb490bb08 in ?? ()
#9  0xb490bb08 in ?? ()
#10 0xb490bb60 in ?? ()
#11 0x06ead882 in ?? ()
#12 0xb17053f8 in ?? ()
#13 0x0805ea56 in ?? ()
#14 0xb490bb5c in ?? ()
#15 0x00000002 in ?? ()
#16 0xaac69700 in ?? ()
#17 0x00449ed5 in pthread_getspecific () from /lib/tls/libpthread.so.0
Thread 12 (Thread -1328526416 (LWP 27904)):
#0  0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()
#1  0x0806fe71 in ?? ()
#2  0xb490bba8 in ?? ()
#3  0xb490bb60 in ?? ()
#4  0xb0d04428 in ?? ()
#5  0x08085a21 in ?? ()
#6  0x087335e8 in ?? ()
#7  0x00000002 in ?? ()
#8  0xb490bb08 in ?? ()
#9  0xb490bb08 in ?? ()
#10 0xb490bb60 in ?? ()
#11 0x2bebd882 in ?? ()
#12 0xb0d043f8 in ?? ()
#13 0x0805ea56 in ?? ()
#14 0xb490bb5c in ?? ()
#15 0x00000002 in ?? ()
#16 0x087335f0 in ?? ()
#17 0x00449ed5 in pthread_getspecific () from /lib/tls/libpthread.so.0
Thread 11 (Thread -1339016272 (LWP 27905)):
#0  0x0044bf5e in recvmsg () from /lib/tls/libpthread.so.0
#1  0x080b1a8f in ?? ()
#2  0x00000005 in ?? ()
#3  0xb03039d0 in ?? ()
#4  0x00000000 in ?? ()
Thread 10 (Thread -1349506128 (LWP 27906)):
#0  0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()
#1  0x0806fe71 in ?? ()
#2  0xb490bba8 in ?? ()
#3  0xb490bb60 in ?? ()
#4  0xaf902428 in ?? ()
#5  0x08085a21 in ?? ()
#6  0xaab11f88 in ?? ()
#7  0x00000000 in ?? ()
Thread 9 (Thread -1359995984 (LWP 27907)):
#0  0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()
#1  0x0806fe71 in ?? ()
#2  0xb490bba8 in ?? ()
#3  0xb490bb60 in ?? ()
#4  0xaef01428 in ?? ()
#5  0x08085a21 in ?? ()
#6  0xab1228a0 in ?? ()
#7  0x00000000 in ?? ()
Thread 8 (Thread -1370485840 (LWP 27908)):
#0  0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()
#1  0x0806fe71 in ?? ()
#2  0xb490bba8 in ?? ()
#3  0xb490bb60 in ?? ()
#4  0x00000001 in ?? ()
#5  0xae5003d8 in ?? ()
#6  0x0000004a in ?? ()
#7  0xaab00010 in ?? ()
#8  0xb490bb08 in ?? ()
#9  0xb490bb08 in ?? ()
#10 0xb490bb60 in ?? ()
#11 0x68ead882 in ?? ()
#12 0xae5003f8 in ?? ()
#13 0x0805ea56 in ?? ()
#14 0xb490bb5c in ?? ()
#15 0x00000002 in ?? ()
#16 0xaabd5d30 in ?? ()
#17 0x00449ed5 in pthread_getspecific () from /lib/tls/libpthread.so.0
Thread 7 (Thread -1380975696 (LWP 27909)):
#0  0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()
#1  0x080a3a82 in ?? ()
#2  0x0861c7f4 in ?? ()
#3  0x080f9758 in stderr ()
#4  0xadaffa18 in ?? ()
#5  0x080a3e85 in ?? ()
#6  0x00000000 in ?? ()
Thread 6 (Thread -1391465552 (LWP 27910)):
#0  0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()
#1  0x0806fe71 in ?? ()
#2  0xb490bba8 in ?? ()
#3  0xb490bb60 in ?? ()
#4  0xad0fe428 in ?? ()
#5  0x08085a21 in ?? ()
#6  0x08cd4e80 in ?? ()
#7  0x00000000 in ?? ()
Thread 5 (Thread -1401955408 (LWP 27911)):
#0  0x00cca067 in ___newselect_nocancel () from /lib/tls/libc.so.6
#1  0x0807d767 in ?? ()
#2  0x00000071 in ?? ()
#3  0x080f3280 in stderr ()
#4  0x00000000 in ?? ()
Thread 4 (Thread -1413178448 (LWP 27983)):
#0  0x00c9daec in __nanosleep_nocancel () from /lib/tls/libc.so.6
#1  0x00c9d90f in sleep () from /lib/tls/libc.so.6
#2  0x0804afb2 in ?? ()
#3  0x00000000 in ?? ()
Thread 3 (Thread -1431307344 (LWP 27984)):
#0  0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()
#1  0x080b3c0e in ?? ()
#2  0x086f8768 in ?? ()
#3  0x086f871c in ?? ()
#4  0xaaaff918 in ?? ()
#5  0x080b4df7 in ?? ()
#6  0x086f871c in ?? ()
#7  0xaaaff938 in ?? ()
#8  0x00000004 in ?? ()
#9  0x00000000 in ?? ()
Thread 2 (Thread -1441797200 (LWP 27985)):
#0  0x0044959b in pthread_cond_timedwait@@GLIBC_2.3.2 ()
#1  0x0804b202 in ?? ()
#2  0x080f46c0 in stderr ()
#3  0x080f46f4 in stderr ()
#4  0xaa0fea78 in ?? ()
#5  0x0804b271 in ?? ()
#6  0x00000000 in ?? ()
Thread 1 (Thread -1218523008 (LWP 27891)):
#0  0x00c9daec in __nanosleep_nocancel () from /lib/tls/libc.so.6
#1  0x00c9d90f in sleep () from /lib/tls/libc.so.6
#2  0x0804dda5 in ?? ()
#3  0x00000000 in ?? ()




>

------=_Part_26362_17648632.1185790013637
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

Tonight we had 10 of our afs fielserver lockup. I had upgraded so to 1.4.4 but they dies as well. All run on redhat 3 up6. Only one process shows in ps listing and gcores on this process seem to give nothing. A pstack dump is below. Is it any good. This is now a real disaster and very weird. I have other fileserver that are setup identically which are not dying. The only difference is that these are on a different subnet and a different server room.
<br><br>Thread 22 (Thread -1218524240 (LWP 27894)):<br>#0&nbsp; 0x0044cc84 in sigwait () from /lib/tls/libpthread.so.0<br>#1&nbsp; 0x08073a32 in ?? ()<br>#2&nbsp; 0xb75ec9f0 in ?? ()<br>#3&nbsp; 0xb75ec96c in ?? ()<br>#4&nbsp; 0x00000000 in ?? ()
<br>Thread 21 (Thread -1229263952 (LWP 27895)):<br>#0&nbsp; 0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()<br>#1&nbsp; 0x080b3c0e in ?? ()<br>#2&nbsp; 0x08646828 in ?? ()<br>#3&nbsp; 0x086467dc in ?? ()<br>#4&nbsp; 0xb6bae328 in ?? ()<br>#5&nbsp; 0x080af859 in ?? ()
<br>#6&nbsp; 0x00000001 in ?? ()<br>#7&nbsp; 0x00000000 in ?? ()<br>Thread 20 (Thread -1240114256 (LWP 27896)):<br>#0&nbsp; 0x0044959b in pthread_cond_timedwait@@GLIBC_2.3.2 ()<br>#1&nbsp; 0x0808e5c0 in ?? ()<br>#2&nbsp; 0x080f9540 in stderr ()<br>
#3&nbsp; 0x080f94c0 in stderr ()<br>#4&nbsp; 0xb6155a58 in ?? ()<br>#5&nbsp; 0x01cfe9b8 in ?? ()<br>#6&nbsp; 0x00000000 in ?? ()<br>Thread 19 (Thread -1254962256 (LWP 27897)):<br>#0&nbsp; 0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()<br>#1&nbsp; 0x0806fe71 in ?? ()
<br>#2&nbsp; 0xb490bba8 in ?? ()<br>#3&nbsp; 0xb490bb60 in ?? ()<br>#4&nbsp; 0xb532c428 in ?? ()<br>#5&nbsp; 0x08085a21 in ?? ()<br>#6&nbsp; 0xab1da358 in ?? ()<br>#7&nbsp; 0x00000000 in ?? ()<br>Thread 18 (Thread -1265587280 (LWP 27898)):<br>#0&nbsp; 0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()
<br>#1&nbsp; 0x0806fe71 in ?? ()<br>#2&nbsp; 0xb490bba8 in ?? ()<br>#3&nbsp; 0xb490bb60 in ?? ()<br>#4&nbsp; 0xb490a428 in ?? ()<br>#5&nbsp; 0x08085a21 in ?? ()<br>#6&nbsp; 0xab1c93a0 in ?? ()<br>#7&nbsp; 0x00000000 in ?? ()<br>Thread 17 (Thread -1276077136 (LWP 27899)):
<br>#0&nbsp; 0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()<br>#1&nbsp; 0x0806fe71 in ?? ()<br>#2&nbsp; 0xb490bba8 in ?? ()<br>#3&nbsp; 0xb490bb60 in ?? ()<br>#4&nbsp; 0x00000001 in ?? ()<br>#5&nbsp; 0xb3f093d8 in ?? ()<br>#6&nbsp; 0x00c650fd in malloc () from /lib/tls/libc.so.6
<br>#7&nbsp; 0x0805ea56 in ?? ()<br>#8&nbsp; 0xb490bb5c in ?? ()<br>#9&nbsp; 0x00000002 in ?? ()<br>#10 0x00000001 in ?? ()<br>#11 0x00449ed5 in pthread_getspecific () from /lib/tls/libpthread.so.0<br>#12 0x0805f182 in ?? ()<br>#13 0xb490bb08 in ?? ()
<br>#14 0x00448b20 in pthread_mutex_unlock () from /lib/tls/libpthread.so.0<br>#15 0x080604de in ?? ()<br>#16 0x07ead882 in ?? ()<br>#17 0x0000591b in ?? ()<br>#18 0xb3f09474 in ?? ()<br>#19 0x0000591b in ?? ()<br>#20 0x0854a3f8 in ?? ()
<br>#21 0x591b5f70 in ?? ()<br>#22 0x00000000 in ?? ()<br>Thread 16 (Thread -1286566992 (LWP 27900)):<br>#0&nbsp; 0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()<br>#1&nbsp; 0x080a3a82 in ?? ()<br>#2&nbsp; 0x087244cc in ?? ()<br>#3&nbsp; 0x080f9758 in stderr ()
<br>#4&nbsp; 0xb3508a18 in ?? ()<br>#5&nbsp; 0x080a3e85 in ?? ()<br>#6&nbsp; 0x00000000 in ?? ()<br>Thread 15 (Thread -1297056848 (LWP 27901)):<br>#0&nbsp; 0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()<br>#1&nbsp; 0x0806fe71 in ?? ()<br>#2&nbsp; 0xb490bba8 in ?? ()
<br>#3&nbsp; 0xb490bb60 in ?? ()<br>#4&nbsp; 0xb2b07428 in ?? ()<br>#5&nbsp; 0x08085a21 in ?? ()<br>#6&nbsp; 0xaabb1b90 in ?? ()<br>#7&nbsp; 0x00000002 in ?? ()<br>#8&nbsp; 0xb490bb08 in ?? ()<br>#9&nbsp; 0xb490bb08 in ?? ()<br>#10 0xb490bb60 in ?? ()<br>#11 0x03ead882 in ?? ()
<br>#12 0xb2b073f8 in ?? ()<br>#13 0x0805ea56 in ?? ()<br>#14 0xb490bb5c in ?? ()<br>#15 0x00000002 in ?? ()<br>#16 0xaabb1b98 in ?? ()<br>#17 0x00449ed5 in pthread_getspecific () from /lib/tls/libpthread.so.0<br>Thread 14 (Thread -1307546704 (LWP 27902)):
<br>#0&nbsp; 0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()<br>#1&nbsp; 0x0806fe71 in ?? ()<br>#2&nbsp; 0xb490bba8 in ?? ()<br>#3&nbsp; 0xb490bb60 in ?? ()<br>#4&nbsp; 0xb2106428 in ?? ()<br>#5&nbsp; 0x08085a21 in ?? ()<br>#6&nbsp; 0x08e01618 in ?? ()<br>
#7&nbsp; 0x00000000 in ?? ()<br>Thread 13 (Thread -1318036560 (LWP 27903)):<br>#0&nbsp; 0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()<br>#1&nbsp; 0x0806fe71 in ?? ()<br>#2&nbsp; 0xb490bba8 in ?? ()<br>#3&nbsp; 0xb490bb60 in ?? ()<br>#4&nbsp; 0xb1705428 in ?? ()
<br>#5&nbsp; 0x08085a21 in ?? ()<br>#6&nbsp; 0xaac696f8 in ?? ()<br>#7&nbsp; 0x00000002 in ?? ()<br>#8&nbsp; 0xb490bb08 in ?? ()<br>#9&nbsp; 0xb490bb08 in ?? ()<br>#10 0xb490bb60 in ?? ()<br>#11 0x06ead882 in ?? ()<br>#12 0xb17053f8 in ?? ()<br>#13 0x0805ea56 in ?? ()
<br>#14 0xb490bb5c in ?? ()<br>#15 0x00000002 in ?? ()<br>#16 0xaac69700 in ?? ()<br>#17 0x00449ed5 in pthread_getspecific () from /lib/tls/libpthread.so.0<br>Thread 12 (Thread -1328526416 (LWP 27904)):<br>#0&nbsp; 0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()
<br>#1&nbsp; 0x0806fe71 in ?? ()<br>#2&nbsp; 0xb490bba8 in ?? ()<br>#3&nbsp; 0xb490bb60 in ?? ()<br>#4&nbsp; 0xb0d04428 in ?? ()<br>#5&nbsp; 0x08085a21 in ?? ()<br>#6&nbsp; 0x087335e8 in ?? ()<br>#7&nbsp; 0x00000002 in ?? ()<br>#8&nbsp; 0xb490bb08 in ?? ()<br>#9&nbsp; 0xb490bb08 in ?? ()
<br>#10 0xb490bb60 in ?? ()<br>#11 0x2bebd882 in ?? ()<br>#12 0xb0d043f8 in ?? ()<br>#13 0x0805ea56 in ?? ()<br>#14 0xb490bb5c in ?? ()<br>#15 0x00000002 in ?? ()<br>#16 0x087335f0 in ?? ()<br>#17 0x00449ed5 in pthread_getspecific () from /lib/tls/libpthread.so.0
<br>Thread 11 (Thread -1339016272 (LWP 27905)):<br>#0&nbsp; 0x0044bf5e in recvmsg () from /lib/tls/libpthread.so.0<br>#1&nbsp; 0x080b1a8f in ?? ()<br>#2&nbsp; 0x00000005 in ?? ()<br>#3&nbsp; 0xb03039d0 in ?? ()<br>#4&nbsp; 0x00000000 in ?? ()<br>
Thread 10 (Thread -1349506128 (LWP 27906)):<br>#0&nbsp; 0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()<br>#1&nbsp; 0x0806fe71 in ?? ()<br>#2&nbsp; 0xb490bba8 in ?? ()<br>#3&nbsp; 0xb490bb60 in ?? ()<br>#4&nbsp; 0xaf902428 in ?? ()<br>#5&nbsp; 0x08085a21 in ?? ()
<br>#6&nbsp; 0xaab11f88 in ?? ()<br>#7&nbsp; 0x00000000 in ?? ()<br>Thread 9 (Thread -1359995984 (LWP 27907)):<br>#0&nbsp; 0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()<br>#1&nbsp; 0x0806fe71 in ?? ()<br>#2&nbsp; 0xb490bba8 in ?? ()<br>#3&nbsp; 0xb490bb60 in ?? ()
<br>#4&nbsp; 0xaef01428 in ?? ()<br>#5&nbsp; 0x08085a21 in ?? ()<br>#6&nbsp; 0xab1228a0 in ?? ()<br>#7&nbsp; 0x00000000 in ?? ()<br>Thread 8 (Thread -1370485840 (LWP 27908)):<br>#0&nbsp; 0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()<br>#1&nbsp; 0x0806fe71 in ?? ()
<br>#2&nbsp; 0xb490bba8 in ?? ()<br>#3&nbsp; 0xb490bb60 in ?? ()<br>#4&nbsp; 0x00000001 in ?? ()<br>#5&nbsp; 0xae5003d8 in ?? ()<br>#6&nbsp; 0x0000004a in ?? ()<br>#7&nbsp; 0xaab00010 in ?? ()<br>#8&nbsp; 0xb490bb08 in ?? ()<br>#9&nbsp; 0xb490bb08 in ?? ()<br>#10 0xb490bb60 in ?? ()
<br>#11 0x68ead882 in ?? ()<br>#12 0xae5003f8 in ?? ()<br>#13 0x0805ea56 in ?? ()<br>#14 0xb490bb5c in ?? ()<br>#15 0x00000002 in ?? ()<br>#16 0xaabd5d30 in ?? ()<br>#17 0x00449ed5 in pthread_getspecific () from /lib/tls/libpthread.so.0
<br>Thread 7 (Thread -1380975696 (LWP 27909)):<br>#0&nbsp; 0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()<br>#1&nbsp; 0x080a3a82 in ?? ()<br>#2&nbsp; 0x0861c7f4 in ?? ()<br>#3&nbsp; 0x080f9758 in stderr ()<br>#4&nbsp; 0xadaffa18 in ?? ()<br>#5&nbsp; 0x080a3e85 in ?? ()
<br>#6&nbsp; 0x00000000 in ?? ()<br>Thread 6 (Thread -1391465552 (LWP 27910)):<br>#0&nbsp; 0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()<br>#1&nbsp; 0x0806fe71 in ?? ()<br>#2&nbsp; 0xb490bba8 in ?? ()<br>#3&nbsp; 0xb490bb60 in ?? ()<br>#4&nbsp; 0xad0fe428 in ?? ()
<br>#5&nbsp; 0x08085a21 in ?? ()<br>#6&nbsp; 0x08cd4e80 in ?? ()<br>#7&nbsp; 0x00000000 in ?? ()<br>Thread 5 (Thread -1401955408 (LWP 27911)):<br>#0&nbsp; 0x00cca067 in ___newselect_nocancel () from /lib/tls/libc.so.6<br>#1&nbsp; 0x0807d767 in ?? ()
<br>#2&nbsp; 0x00000071 in ?? ()<br>#3&nbsp; 0x080f3280 in stderr ()<br>#4&nbsp; 0x00000000 in ?? ()<br>Thread 4 (Thread -1413178448 (LWP 27983)):<br>#0&nbsp; 0x00c9daec in __nanosleep_nocancel () from /lib/tls/libc.so.6<br>#1&nbsp; 0x00c9d90f in sleep () from /lib/tls/libc.so.6
<br>#2&nbsp; 0x0804afb2 in ?? ()<br>#3&nbsp; 0x00000000 in ?? ()<br>Thread 3 (Thread -1431307344 (LWP 27984)):<br>#0&nbsp; 0x004493ad in pthread_cond_wait@@GLIBC_2.3.2 ()<br>#1&nbsp; 0x080b3c0e in ?? ()<br>#2&nbsp; 0x086f8768 in ?? ()<br>#3&nbsp; 0x086f871c in ?? ()
<br>#4&nbsp; 0xaaaff918 in ?? ()<br>#5&nbsp; 0x080b4df7 in ?? ()<br>#6&nbsp; 0x086f871c in ?? ()<br>#7&nbsp; 0xaaaff938 in ?? ()<br>#8&nbsp; 0x00000004 in ?? ()<br>#9&nbsp; 0x00000000 in ?? ()<br>Thread 2 (Thread -1441797200 (LWP 27985)):<br>#0&nbsp; 0x0044959b in pthread_cond_timedwait@@GLIBC_2.3.2 ()
<br>#1&nbsp; 0x0804b202 in ?? ()<br>#2&nbsp; 0x080f46c0 in stderr ()<br>#3&nbsp; 0x080f46f4 in stderr ()<br>#4&nbsp; 0xaa0fea78 in ?? ()<br>#5&nbsp; 0x0804b271 in ?? ()<br>#6&nbsp; 0x00000000 in ?? ()<br>Thread 1 (Thread -1218523008 (LWP 27891)):<br>#0&nbsp; 0x00c9daec in __nanosleep_nocancel () from /lib/tls/libc.so.6
<br>#1&nbsp; 0x00c9d90f in sleep () from /lib/tls/libc.so.6<br>#2&nbsp; 0x0804dda5 in ?? ()<br>#3&nbsp; 0x00000000 in ?? ()<br><br><br><br><div><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
<br clear="all"></blockquote></div><br>

------=_Part_26362_17648632.1185790013637--