Hi,<br><br>The problem happened again and I can provide some more info. <br>6 of the UDP worker processes got blocked. By checking the logs I can see that 4 of them, that seem to be related to the same INVITE request, got blocked at the same time. The other 2 got blocked some hours later and not at the same time.<br>

<br>From the 4 first processes, the backtrace of 3 of them is this:<br><br>#0  0xb7f6d410 in ?? ()<br>#1  0xbff60768 in ?? ()<br>#2  0x00000001 in ?? ()<br>#3  0xa7358180 in ?? ()<br>#4  0xb7ec94ac in sched_yield () from /lib/tls/i686/cmov/libc.so.6<br>

#5  0xb7b37463 in lock_hash (i=19819) at ../../mem/../fastlock.h:182<br>#6  0xb7b52587 in t_lookup_request (p_msg=0x82403d0, leave_new_locked=1) at t_lookup.c:468<br>#7  0xb7b534ae in t_newtran (p_msg=0x82403d0) at t_lookup.c:1124<br>

#8  0xb7b4540c in t_relay_to (p_msg=0x82403d0, proxy=0x0, flags=8) at t_funcs.c:212<br>#9  0xb7b58ac7 in w_t_relay (p_msg=0x82403d0, proxy=0x0, flags=0x8 &lt;Address 0x8 out of bounds&gt;) at tm.c:1002<br>#10 0x0805301c in do_action (a=0x818c370, msg=0x82403d0) at action.c:874<br>

#11 0x080557aa in run_action_list (a=0x818c370, msg=0x82403d0) at action.c:145<br>#12 0x0809c304 in eval_expr (e=0x818c3d8, msg=0x82403d0, val=0x0) at route.c:1171<br>#13 0x0809bd80 in eval_expr (e=0x818c400, msg=0x82403d0, val=0x0) at route.c:1488<br>

#14 0x0809bd16 in eval_expr (e=0x818c428, msg=0x82403d0, val=0x0) at route.c:1493<br>#15 0x080527ed in do_action (a=0x818c740, msg=0x82403d0) at action.c:729<br>#16 0x080557aa in run_action_list (a=0x818be08, msg=0x82403d0) at action.c:145<br>

#17 0x08053efb in do_action (a=0x81a12e0, msg=0x82403d0) at action.c:120<br>#18 0x080557aa in run_action_list (a=0x818ee78, msg=0x82403d0) at action.c:145<br>#19 0x08053efb in do_action (a=0x81b3448, msg=0x82403d0) at action.c:120<br>

#20 0x080557aa in run_action_list (a=0x81b0ed0, msg=0x82403d0) at action.c:145<br>#21 0x08054491 in do_action (a=0x81b5f68, msg=0x82403d0) at action.c:746<br>#22 0x080557aa in run_action_list (a=0x81b5f68, msg=0x82403d0) at action.c:145<br>

#23 0x08054f2d in do_action (a=0x81b5fd0, msg=0x82403d0) at action.c:752<br>#24 0x080557aa in run_action_list (a=0x81aefd0, msg=0x82403d0) at action.c:145<br>#25 0x08053efb in do_action (a=0x818bc08, msg=0x82403d0) at action.c:120<br>

#26 0x080557aa in run_action_list (a=0x8187910, msg=0x82403d0) at action.c:145<br>#27 0x08055b43 in run_top_route (a=0x8187910, msg=0x82403d0) at action.c:120<br>#28 0x0808c659 in receive_msg (<br>    buf=0x8158040 &quot;INVITE <a href="mailto:sip%3Axxxxx@xxxxxxxxxx.com">sip:xxxxx@xxxxxxxxxx.com</a> SIP/2.0\r\nRecord-Route: &lt;sip:10.100.29.7;lr=on;ftag=as60035314&gt;\r\nVia: SIP/2.0/UDP 10.100.29.7;branch=z9hG4bKb6d4.a49d7633.0\r\nVia: SIP/2.0/UDP 10.100.29.8:5060;branch=z9hG&quot;..., len=926, rcv_info=0xbff62334) at receive.c:175<br>

#29 0x080c3ea3 in udp_rcv_loop () at udp_server.c:449<br>#30 0x0806e394 in main (argc=9, argv=0xbff62514) at main.c:774<br><br>The backtrace of the other is:<br><br>#0  0xb7f6d410 in ?? ()<br>#1  0xbff60138 in ?? ()<br>#2  0x00000001 in ?? ()<br>

#3  0xa7358180 in ?? ()<br>#4  0xb7ec94ac in sched_yield () from /lib/tls/i686/cmov/libc.so.6<br>#5  0xb7b37463 in lock_hash (i=19819) at ../../mem/../fastlock.h:182<br>#6  0xb7b6ce01 in t_uac (method=0xbff60558, headers=0x81e3108, body=0x81d9afb, dialog=0xa772c6a8, cb=0xb734a622 &lt;publ_cback_func&gt;, cbp=0xa7715158)<br>

    at uac.c:306<br>#7  0xb7b6e311 in request (m=0xbff60558, ruri=0x81d9adc, to=0x81d9adc, from=0x81d9adc, h=0x81e3108, b=0x81d9afb, oburi=0xb73564ac,<br>    cb=0xb734a622 &lt;publ_cback_func&gt;, cbp=0xa7715158) at uac.c:503<br>

#8  0xb7349641 in send_publish (publ=0x81d9aa8) at send_publish.c:552<br>#9  0xb73339bf in dialog_publish (state=0xb7335bb4 &quot;Trying&quot;, entity=0xa7709f34, peer=0xa7709f3c, callid=0xa7709f2c, initiator=1, lifetime=300,<br>

    localtag=0x0, remotetag=0x0, localtarget=0x0, remotetarget=0x0) at dialog_publish.c:347<br>#10 0xb73348ea in __dialog_created (dlg=0xa7709ef0, type=2, _params=0xb7a7cb9c) at pua_dialoginfo.c:343<br>#11 0xb7a586ff in run_create_callbacks (dlg=0xa7709ef0, msg=0x81f18a8) at dlg_cb.c:230<br>

#12 0xb7a60d1f in dlg_new_dialog (msg=0x81f18a8, t=0xa75deeb0) at dlg_handlers.c:494<br>#13 0xb7a61f77 in dlg_onreq (t=0xa75deeb0, type=1, param=0xb7b785a8) at dlg_handlers.c:414<br>#14 0xb7b4a791 in run_reqin_callbacks (trans=0xa75deeb0, req=0x81f18a8, code=1) at t_hooks.c:272<br>

#15 0xb7b376af in build_cell (p_msg=0x81f18a8) at h_table.c:284<br>#16 0xb7b535fa in t_newtran (p_msg=0x81f18a8) at t_lookup.c:1064<br>#17 0xb7b4540c in t_relay_to (p_msg=0x81f18a8, proxy=0x0, flags=8) at t_funcs.c:212<br>

#18 0xb7b58ac7 in w_t_relay (p_msg=0x81f18a8, proxy=0x0, flags=0x8 &lt;Address 0x8 out of bounds&gt;) at tm.c:1002<br>#19 0x0805301c in do_action (a=0x818c370, msg=0x81f18a8) at action.c:874<br>#20 0x080557aa in run_action_list (a=0x818c370, msg=0x81f18a8) at action.c:145<br>

#21 0x0809c304 in eval_expr (e=0x818c3d8, msg=0x81f18a8, val=0x0) at route.c:1171<br>#22 0x0809bd80 in eval_expr (e=0x818c400, msg=0x81f18a8, val=0x0) at route.c:1488<br>#23 0x0809bd16 in eval_expr (e=0x818c428, msg=0x81f18a8, val=0x0) at route.c:1493<br>

#24 0x080527ed in do_action (a=0x818c740, msg=0x81f18a8) at action.c:729<br>#25 0x080557aa in run_action_list (a=0x818be08, msg=0x81f18a8) at action.c:145<br>#26 0x08053efb in do_action (a=0x81a12e0, msg=0x81f18a8) at action.c:120<br>

#27 0x080557aa in run_action_list (a=0x818ee78, msg=0x81f18a8) at action.c:145<br>#28 0x08053efb in do_action (a=0x81b3448, msg=0x81f18a8) at action.c:120<br>#29 0x080557aa in run_action_list (a=0x81b0ed0, msg=0x81f18a8) at action.c:145<br>

#30 0x08054491 in do_action (a=0x81b5f68, msg=0x81f18a8) at action.c:746<br>#31 0x080557aa in run_action_list (a=0x81b5f68, msg=0x81f18a8) at action.c:145<br>#32 0x08054f2d in do_action (a=0x81b5fd0, msg=0x81f18a8) at action.c:752<br>

#33 0x080557aa in run_action_list (a=0x81aefd0, msg=0x81f18a8) at action.c:145<br>#34 0x08053efb in do_action (a=0x818bc08, msg=0x81f18a8) at action.c:120<br>#35 0x080557aa in run_action_list (a=0x8187910, msg=0x81f18a8) at action.c:145<br>

#36 0x08055b43 in run_top_route (a=0x8187910, msg=0x81f18a8) at action.c:120<br>#37 0x0808c659 in receive_msg (<br>    buf=0x8158040 &quot;INVITE <a href="mailto:sip%3Axxxxx@xxxxxxxxxxxxxx.com">sip:xxxxx@xxxxxxxxxxxxxx.com</a> SIP/2.0\r\nRecord-Route: &lt;sip:10.100.29.7;lr=on;ftag=as60035314&gt;\r\nVia: SIP/2.0/UDP 10.100.29.7;branch=z9hG4bKb6d4.a49d7633.0\r\nVia: SIP/2.0/UDP 10.100.29.8:5060;branch=z9hG&quot;..., len=926, rcv_info=0xbff62334) at receive.c:175<br>

#38 0x080c3ea3 in udp_rcv_loop () at udp_server.c:449<br>#39 0x0806e394 in main (argc=9, argv=0xbff62514) at main.c:774,<br><br>And finally the backtraces of the other two:<br><br>#0  0xb7f6d410 in ?? ()<br>#1  0xbff61848 in ?? ()<br>

#2  0x00000001 in ?? ()<br>#3  0xa7358180 in ?? ()<br>#4  0xb7ec94ac in sched_yield () from /lib/tls/i686/cmov/libc.so.6<br>#5  0xb7b37463 in lock_hash (i=19819) at ../../mem/../fastlock.h:182<br>#6  0xb7b6ce01 in t_uac (method=0xbff61c68, headers=0x81e2e20, body=0x81f1ca3, dialog=0xa76e0478, cb=0xb734a622 &lt;publ_cback_func&gt;, cbp=0xa772bbc0)<br>

    at uac.c:306<br>#7  0xb7b6e311 in request (m=0xbff61c68, ruri=0x81f1c84, to=0x81f1c84, from=0x81f1c84, h=0x81e2e20, b=0x81f1ca3, oburi=0xb73564ac,<br>    cb=0xb734a622 &lt;publ_cback_func&gt;, cbp=0xa772bbc0) at uac.c:503<br>

#8  0xb7349641 in send_publish (publ=0x81f1c50) at send_publish.c:552<br>#9  0xb73339bf in dialog_publish (state=0xb7335bc6 &quot;early&quot;, entity=0xbff61ea8, peer=0xa7630458, callid=0xa7630468, initiator=0, lifetime=300,<br>

    localtag=0xbff61eb0, remotetag=0xa7630470, localtarget=0xbff61ea0, remotetarget=0xa7630480) at dialog_publish.c:347<br>#10 0xb7335183 in __dialog_sendpublish (dlg=0xa76d83e0, type=128, _params=0xb7a7cb9c) at pua_dialoginfo.c:256<br>

#11 0xb7a58598 in run_dlg_callbacks (type=128, dlg=0xa76d83e0, msg=0x81d9aa8, dir=2, dlg_data=0x0) at dlg_cb.c:252<br>#12 0xb7a62475 in dlg_onreply (t=0xa75d0f68, type=128, param=0xb7b785a8) at dlg_handlers.c:274<br>#13 0xb7b4a942 in run_trans_callbacks (type=128, trans=0xa75d0f68, req=0xa75feaf8, rpl=0x81d9aa8, code=180) at t_hooks.c:240<br>

#14 0xb7b6680d in relay_reply (t=0xa75d0f68, p_msg=0x81d9aa8, branch=&lt;value optimized out&gt;, msg_status=180, cancel_bitmap=0xbff62200) at t_reply.c:1254<br>#15 0xb7b672d8 in reply_received (p_msg=0x81d9aa8) at t_reply.c:1511<br>

#16 0x0806596b in forward_reply (msg=0x81d9aa8) at forward.c:521<br>#17 0x0808c887 in receive_msg (<br>    buf=0x8158040 &quot;SIP/2.0 180 Ringing\r\nVia: SIP/2.0/UDP 10.100.0.2;branch=z9hG4bK874c.16937ae2.1\r\nVia: SIP/2.0/UDP 10.100.210.252;branch=z9hG4bK874c.3855deb5.0\r\nVia: SIP/2.0/UDP 10.100.210.253:5060;branch=z9hG4bK4489e1&quot;..., len=782, rcv_info=0xbff62334) at receive.c:212<br>

#18 0x080c3ea3 in udp_rcv_loop () at udp_server.c:449<br>#19 0x0806e394 in main (argc=9, argv=0xbff62514) at main.c:774<br><br>and<br><br>#0  0xb7f6d410 in ?? ()<br>#1  0xbff60a88 in ?? ()<br>#2  0x00000001 in ?? ()<br>#3  0xa7358180 in ?? ()<br>

#4  0xb7ec94ac in sched_yield () from /lib/tls/i686/cmov/libc.so.6<br>#5  0xb7b37463 in lock_hash (i=19819) at ../../mem/../fastlock.h:182<br>#6  0xb7b52587 in t_lookup_request (p_msg=0x81f18c0, leave_new_locked=1) at t_lookup.c:468<br>

#7  0xb7b534ae in t_newtran (p_msg=0x81f18c0) at t_lookup.c:1124<br>#8  0xb7b4540c in t_relay_to (p_msg=0x81f18c0, proxy=0x0, flags=1) at t_funcs.c:212<br>#9  0xb7b46f6c in t_replicate (p_msg=0x81f18c0, dst=0x817cdf8, flags=1) at t_fwd.c:763<br>

#10 0xb7b55fce in w_t_replicate (p_msg=0x81f18c0, dst=0x817cdf8 &quot;\230ê\030\b\016&quot;, flags=0x0) at tm.c:957<br>#11 0x0805301c in do_action (a=0x818eb20, msg=0x81f18c0) at action.c:874<br>#12 0x080557aa in run_action_list (a=0x818eb20, msg=0x81f18c0) at action.c:145<br>

#13 0x08054491 in do_action (a=0x818ec78, msg=0x81f18c0) at action.c:746<br>#14 0x080557aa in run_action_list (a=0x818c940, msg=0x81f18c0) at action.c:145<br>#15 0x08053efb in do_action (a=0x81b38e0, msg=0x81f18c0) at action.c:120<br>

#16 0x080557aa in run_action_list (a=0x81b3878, msg=0x81f18c0) at action.c:145<br>#17 0x08054491 in do_action (a=0x81b5f00, msg=0x81f18c0) at action.c:746<br>#18 0x080557aa in run_action_list (a=0x81b5f00, msg=0x81f18c0) at action.c:145<br>

#19 0x08054f2d in do_action (a=0x81b5f68, msg=0x81f18c0) at action.c:752<br>#20 0x080557aa in run_action_list (a=0x81b5f68, msg=0x81f18c0) at action.c:145<br>#21 0x08054f2d in do_action (a=0x81b5fd0, msg=0x81f18c0) at action.c:752<br>

#22 0x080557aa in run_action_list (a=0x81aefd0, msg=0x81f18c0) at action.c:145<br>#23 0x08053efb in do_action (a=0x818bc08, msg=0x81f18c0) at action.c:120<br>#24 0x080557aa in run_action_list (a=0x8187910, msg=0x81f18c0) at action.c:145<br>

#25 0x08055b43 in run_top_route (a=0x8187910, msg=0x81f18c0) at action.c:120<br>#26 0x0808c659 in receive_msg (<br>    buf=0x8158040 &quot;REGISTER sip:<a href="http://xxxxxxxxxxx.com">xxxxxxxxxxx.com</a> SIP/2.0\r\nVia: SIP/2.0/UDP 10.100.210.252;branch=z9hG4bK76cf4c16d55a6407f\r\nVia: SIP/2.0/UDP 10.100.210.197:5060;branch=z9hG4bK76cf4c16d55a6407f\r\nMax-Forwards: 68\r\nFrom: &lt;sip:&quot;..., len=944, rcv_info=0xbff62334) at receive.c:175<br>

#27 0x080c3ea3 in udp_rcv_loop () at udp_server.c:449<br>#28 0x0806e394 in main (argc=9, argv=0xbff62514) at main.c:774<br><br><br>I can provide full backtraces (bt full) of all the processes but they are too large. Should I attach them on a file? Is there any other information that can be helpful to track this down?<br>

<br>Thanks in advance,<br><br>Santi<br><br><br><div class="gmail_quote">2010/5/14 Santiago Gimeno <span dir="ltr">&lt;<a href="mailto:santiago.gimeno@gmail.com">santiago.gimeno@gmail.com</a>&gt;</span><br><blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">

Hi,<br><br><div class="gmail_quote">2010/5/14 marius zbihlei <span dir="ltr">&lt;<a href="mailto:marius.zbihlei@1and1.ro" target="_blank">marius.zbihlei@1and1.ro</a>&gt;</span><div class="im"><br><blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">


<br>
<br>
Hello,<br>
<br>
It also might help if you can do a bt &quot;full&quot;  Also try printing the whole message  x/s 0x8158040 should do the trick.<br></blockquote></div><div><br>I have already restarted the server, I&#39;ll do that the next time it happens.<br>


 </div><div class="im"><blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
<br>
If I recall this correctly you said something about only t_replicating REGISTERs. The message is an INVITE so it also might be that you have a  cfg error somewhere<br></blockquote></div><div><br>Yes, I&#39;m only t_replicating REGISTER&#39;s and this backtrace doesn&#39;t show any call to t_replicate. Am I missing something?<br>


 <br></div><blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
<br>
Cheers<br><font color="#888888">
Marius<br>
</font></blockquote></div><br>Thanks,<br><br>Santi<br>
</blockquote></div><br>