Can you give the output of next commands from gdb?

``` frame 0 p *cell ```

--- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/301#issuecomment-134560580

Now I need more:

``` p *cell->vars

set $p=cell->vars->next while ($p != 0) p *$p set $p=$p->next end ```

--- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/301#issuecomment-134563161

Interesting, it is clear the crash happened because the var pointer is invalid:

``` #0 0x00007f3b4fd779da in update_dialog_vars_dbinfo (cell=0x7f3b3c3aa958, var=0x3433) at dlg_db_handler.c:651 651 SET_STR_VALUE(values+2, var->key); ```

But it is taken from cell->vars, which show good values for each 'next' fields -- code of frame 1 is:

``` for(var=cell->vars ; var ; var=var->next) { if (update_dialog_vars_dbinfo(cell, var) != 0) return -1; } ```

So the core file has some inaccurate info or the stack was corrupted. Did you get error messages in syslog before the crash?

--- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/301#issuecomment-134571571

Was there only one core file? Maybe the core got overwritten.

Get from gdb:

``` p process_no p pt[process_no] ```

--- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/301#issuecomment-134607308

Can you test also the git master version? There are couple of changes that would be good to see if they make any difference.

--- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/301#issuecomment-134949775

Thanks for spotting those errors -- fixed in last master.

--- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/301#issuecomment-135320471

I got a new crash in another small VM. There was some corruption as the linked list got into a loop: ``` Core was generated by `/usr/local/src/git/kamailio-4.3/kamailio -m 256 -M 16 -P /var/run/kamailio.pid'. Program terminated with signal 11, Segmentation fault. #0 0x00007f8f2a2aa9da in update_dialog_vars_dbinfo (cell=0x7f8f1634b738, var=0x3433) at dlg_db_handler.c:651 651 SET_STR_VALUE(values+2, var->key); Missing separate debuginfos, use: debuginfo-install bzip2-libs-1.0.5-7.el6_0.x86_64 db4-4.7.25-19.el6_6.x86_64 elfutils-libelf-0.161-3.el6.x86_64 glibc-2.12-1.166.el6_7.1.x86_64 keyutils-libs-1.4-5.el6.x86_64 krb5-libs-1.10.3-42.el6.x86_64 libacl-2.2.49-6.el6.x86_64 libattr-2.4.44-7.el6.x86_64 libcap-2.16-5.5.el6.x86_64 libcom_err-1.41.12-22.el6.x86_64 libgcc-4.4.7-16.el6.x86_64 libselinux-2.0.94-5.8.el6.x86_64 lm_sensors-libs-3.1.1-17.el6.x86_64 lua-5.1.4-4.1.el6.x86_64 mysql-libs-5.1.73-5.el6_6.x86_64 net-snmp-libs-5.5-54.el6_7.1.x86_64 nspr-4.10.8-1.el6_6.x86_64 nss-3.19.1-3.el6_6.x86_64 nss-softokn-freebl-3.14.3-22.el6_6.x86_64 nss-util-3.19.1-1.el6_6.x86_64 openssl-1.0.1e-42.el6.x86_64 pcre-7.8-7.el6.x86_64 perl-libs-5.10.1-141.el6.x86_64 popt-1.13-7.el6.x86_64 rpm-libs-4.8.0-47.el6.x86_64 tcp_wrappers-libs-7.6-57.el6.x86_64 xz-libs-4.999.9-0.5.beta.20091007git.el6.x86_64 zlib-1.2.3-29.el6.x86_64 (gdb) bt #0 0x00007f8f2a2aa9da in update_dialog_vars_dbinfo (cell=0x7f8f1634b738, var=0x3433) at dlg_db_handler.c:651 #1 0x00007f8f2a2ab511 in update_dialog_dbinfo_unsafe (cell=0x7f8f1634b738) at dlg_db_handler.c:718 #2 0x00007f8f2a2acafc in update_dialog_dbinfo (cell=0x7f8f1634b738) at dlg_db_handler.c:861 #3 0x00007f8f2a2ec3dc in set_dlg_variable (dlg=0x7f8f1634b738, key=0x7f8f2adeb760, val=0x7ffcbe736190) at dlg_var.c:305 #4 0x00007f8f2abc9a9c in set_start_time (dialog=0x7f8f1634b738) at acc_cdr.c:523 #5 0x00007f8f2abcf932 in cdr_on_create (dialog=0x7f8f1634b738, type=2, params=0x7f8f2a50d0a0) at acc_cdr.c:790 #6 0x00007f8f2a29b398 in run_create_callbacks (dlg=0x7f8f1634b738, msg=0x7f8f2d904b48) at dlg_cb.c:230 #7 0x00007f8f2a2b5590 in dlg_new_dialog (req=0x7f8f2d904b48, t=0x7f8f1734ba58, run_initial_cbs=1) at dlg_handlers.c:865 #8 0x00007f8f2a2b4006 in dlg_onreq (t=0x7f8f1734ba58, type=1, param=0x7f8f2d6a9760) at dlg_handlers.c:717 #9 0x00007f8f2d3edc3a in run_reqin_callbacks_internal (hl=0x7f8f162a1480, trans=0x7f8f1734ba58, params=0x7f8f2d6a9760) at t_hooks.c:360 #10 0x00007f8f2d3edd48 in run_reqin_callbacks (trans=0x7f8f1734ba58, req=0x7f8f2d904b48, code=1) at t_hooks.c:385 #11 0x00007f8f2d3aeb58 in build_cell (p_msg=0x7f8f2d904b48) at h_table.c:356 #12 0x00007f8f2d3ff283 in new_t (p_msg=0x7f8f2d904b48) at t_lookup.c:1269 #13 0x00007f8f2d4004b3 in t_newtran (p_msg=0x7f8f2d904b48) at t_lookup.c:1409 #14 0x00007f8f2d3d4e9c in t_relay_to (p_msg=0x7f8f2d904b48, proxy=0x0, proto=0, replicate=0) at t_funcs.c:236 #15 0x00007f8f2d413bbb in _w_t_relay_to (p_msg=0x7f8f2d904b48, proxy=0x0, force_proto=0) at tm.c:1476 #16 0x00007f8f2d414d20 in w_t_relay (p_msg=0x7f8f2d904b48, _foo=0x0, _bar=0x0) at tm.c:1677 #17 0x000000000041ddad in do_action (h=0x7ffcbe736fb0, a=0x7f8f2d7b8f60, msg=0x7f8f2d904b48) at action.c:1053 #18 0x000000000042a4c3 in run_actions (h=0x7ffcbe736fb0, a=0x7f8f2d7b8f60, msg=0x7f8f2d904b48) at action.c:1548 #19 0x000000000042ab28 in run_actions_safe (h=0x7ffcbe737bd0, a=0x7f8f2d7b8f60, msg=0x7f8f2d904b48) at action.c:1613 #20 0x0000000000543c94 in rval_get_int (h=0x7ffcbe737bd0, msg=0x7f8f2d904b48, i=0x7ffcbe737488, rv=0x7f8f2d7b95b0, cache=0x0) at rvalue.c:912 #21 0x0000000000547ecc in rval_expr_eval_int (h=0x7ffcbe737bd0, msg=0x7f8f2d904b48, res=0x7ffcbe737488, rve=0x7f8f2d7b95a8) at rvalue.c:1906 #22 0x00000000005482c2 in rval_expr_eval_int (h=0x7ffcbe737bd0, msg=0x7f8f2d904b48, res=0x7ffcbe737910, rve=0x7f8f2d7b9ca8) at rvalue.c:1914 #23 0x000000000041d897 in do_action (h=0x7ffcbe737bd0, a=0x7f8f2d7b9258, msg=0x7f8f2d904b48) at action.c:1029 #24 0x000000000042a4c3 in run_actions (h=0x7ffcbe737bd0, a=0x7f8f2d6fc308, msg=0x7f8f2d904b48) at action.c:1548 #25 0x000000000042abf0 in run_top_route (a=0x7f8f2d6fc308, msg=0x7f8f2d904b48, c=0x0) at action.c:1634 #26 0x000000000050a938 in receive_msg ( buf=0xa6fee0 "INVITE sip:09011112222@192.168.2.189:5060 SIP/2.0\r\nVia: SIP/2.0/UDP 192.168.0.190:5010;rport;branch=z9hG4bK-21407-8914-4\r\nFrom: "user1" sip:user1@test1.com;tag=21407SIPpTag008914\r\nTo: <sip:090111122"..., len=941, rcv_info=0x7ffcbe737ec0) at receive.c:196 #27 0x000000000060a3ea in udp_rcv_loop () at udp_server.c:495 #28 0x00000000004a7ef7 in main_loop () at main.c:1573 #29 0x00000000004ae2d2 in main (argc=7, argv=0x7ffcbe7382f8) at main.c:2533 (gdb) frame 0 #0 0x00007f8f2a2aa9da in update_dialog_vars_dbinfo (cell=0x7f8f1634b738, var=0x3433) at dlg_db_handler.c:651 651 SET_STR_VALUE(values+2, var->key); (gdb) p *cell $1 = {ref = 1, next = 0x0, prev = 0x0, h_id = 1892, h_entry = 1828, state = 1, lifetime = 10800, init_ts = 1440744243, start_ts = 0, dflags = 0, iflags = 0, sflags = 0, toroute = 0, toroute_name = { s = 0x0, len = 0}, from_rr_nb = 0, tl = {next = 0x0, prev = 0x0, timeout = 0}, callid = { s = 0x7f8f1634b898 "8914-21407@192.168.0.190sip:user1@test1.comsip:09011112222@192.168.2.189:5060sip:09011112222@192.168.2.190:503000", len = 24}, from_uri = { s = 0x7f8f1634b8b0 "sip:user1@test1.comsip:09011112222@192.168.2.189:5060sip:09011112222@192.168.2.190:503000", len = 19}, to_uri = { s = 0x7f8f1634b8c3 "sip:09011112222@192.168.2.189:5060sip:09011112222@192.168.2.190:503000", len = 34}, req_uri = {s = 0x7f8f1634b8e5 "sip:09011112222@192.168.2.190:503000", len = 34}, tag = {{ s = 0x7f8f162ce7e8 "21407SIPpTag008914sip:user1@192.168.2.50:5010\177", len = 18}, {s = 0x0, len = 0}}, cseq = {{s = 0x7f8f16fba118 "802r1\004", len = 3}, {s = 0x0, len = 0}}, route_set = {{ s = 0x0, len = 0}, {s = 0x0, len = 0}}, contact = {{s = 0x7f8f162ce7fa "sip:user1@192.168.2.50:5010\177", len = 27}, {s = 0x0, len = 0}}, bind_addr = {0x7f8f2d6db730, 0x0}, cbs = { first = 0x7f8f16e46230, types = 41172}, profile_links = 0x7f8f163601b0, vars = 0x7f8f1701b1e0} (gdb) p *cell->vars $2 = {key = {s = 0x7f8f171ca438 "answer_time", len = 11}, value = {s = 0x7f8f16379fe0 "1440744243.165", len = 14}, vflags = 0, next = 0x7f8f1638e108} (gdb) $3 = {key = {s = 0x7f8f171ca438 "answer_time", len = 11}, value = {s = 0x7f8f16379fe0 "1440744243.165", len = 14}, vflags = 0, next = 0x7f8f1638e108} (gdb) set $p=cell->vars->next (gdb) while ($p != 0)

p *$p set $p=$p->next end

$4 = {key = {s = 0x7f8f163b06c8 "calling_number", len = 14}, value = {s = 0x7f8f170c3760 "calling_number", len = 10}, vflags = 0, next = 0x7f8f16375c78} $5 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $6 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $7 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $8 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $9 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $10 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $11 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $12 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $13 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $14 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $15 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $16 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $17 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $18 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $19 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $20 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $21 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $22 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $23 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $24 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $25 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $26 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $27 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $28 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $29 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $30 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $31 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $32 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $33 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $34 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $35 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $36 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $37 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $38 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $39 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $40 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $41 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $42 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $43 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $44 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $45 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $46 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $47 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $48 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $49 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $50 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $51 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $52 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $53 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $54 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $55 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $56 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $57 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $58 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} $59 = {key = {s = 0x7f8f16fc1730 "test1.comon", len = 11}, value = {s = 0x7f8f17095908 "caller_username", len = 11}, vflags = 0, next = 0x7f8f16f97908} $60 = {key = {s = 0x7f8f163a4290 "caller_username", len = 11}, value = {s = 0x7f8f163a7bf8 "caller_domain", len = 11}, vflags = 0, next = 0x7f8f16375c78} ---Type <return> to continue, or q <return> to quit--- ```

--- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/301#issuecomment-135664862

Can you give the local variables in frame 1:

``` frame 1 info locals ```

--- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/301#issuecomment-135712527

Can you give the local variables in frame 1:

I assume you are talking about the last crash i mentioned with corruption of linked list:

``` (gdb) frame 1 #1 0x00007f8f2a2ab511 in update_dialog_dbinfo_unsafe (cell=0x7f8f1634b738) at dlg_db_handler.c:718 718 if (update_dialog_vars_dbinfo(cell, var) != 0) (gdb) info locals i = 32764 var = 0x3433 jdoc = {root = 0x0, flags = 1, buf = {s = 0x7ffcbe7360c4 "\001", len = 4283776}, malloc_fn = 0xbe7360e0, free_fn = 0x400} values = {{type = DB1_INT, nul = 32764, free = 764441280, val = {int_val = 762032144, ll_val = 140252919083024, double_val = 6.9294149047874345e-310, time_val = 140252919083024, string_val = 0x7f8f2d6bb010 "\001", str_val = {s = 0x7f8f2d6bb010 "\001", len = 762032584}, blob_val = {s = 0x7f8f2d6bb010 "\001", len = 762032584}, bitmap_val = 762032144}}, {type = 763656408, nul = 7, free = 764441336, val = {int_val = -1099735504, ll_val = 140723503717936, double_val = 6.9526648749445109e-310, time_val = 140723503717936, string_val = 0x7ffcbe735e30 "\220^s\276\374\177", str_val = {s = 0x7ffcbe735e30 "\220^s\276\374\177", len = 6412890}, blob_val = {s = 0x7ffcbe735e30 "\220^s\276\374\177", len = 6412890}, bitmap_val = 3195231792}}, {type = 876032052, nul = 892743988, free = 763656464, val = {int_val = 4283776, ll_val = 4283776, double_val = 2.1164665560792318e-317, time_val = 4283776, string_val = 0x415d80 "1\355I\211\321^H\211\342H\203\344\360PTI\307\300", str_val = {s = 0x415d80 "1\355I\211\321^H\211\342H\203\344\360PTI\307\300", len = -1099726096}, blob_val = { s = 0x415d80 "1\355I\211\321^H\211\342H\203\344\360PTI\307\300", len = -1099726096}, bitmap_val = 4283776}}, {type = DB1_INT, nul = 0, free = 0, val = {int_val = 24, ll_val = 206158430232, double_val = 1.0185579797819065e-312, time_val = 206158430232, string_val = 0x3000000018 <Address 0x3000000018 out of bounds>, str_val = {s = 0x3000000018 <Address 0x3000000018 out of bounds>, len = -1099734784}, blob_val = {s = 0x3000000018 <Address 0x3000000018 out of bounds>, len = -1099734784}, bitmap_val = 24}}, {type = 3195232320, nul = 32764, free = -1, val = { int_val = -1099735360, ll_val = 140723503718080, double_val = 6.9526648749516255e-310, time_val = 140723503718080, string_val = 0x7ffcbe735ec0 "\001\200\255\373\374\177", str_val = { s = 0x7ffcbe735ec0 "\001\200\255\373\374\177", len = 5520532}, blob_val = {s = 0x7ffcbe735ec0 "\001\200\255\373\374\177", len = 5520532}, bitmap_val = 3195231936}}, {type = DB1_BIGINT, nul = 1, free = 762032144, val = {int_val = 764441280, ll_val = 140252921492160, double_val = 6.9294150238145678e-310, time_val = 140252921492160, string_val = 0x7f8f2d9072c0 "8", str_val = { s = 0x7f8f2d9072c0 "8", len = 764441336}, blob_val = {s = 0x7f8f2d9072c0 "8", len = 764441336}, bitmap_val = 764441280}}, {type = DB1_DOUBLE, nul = 0, free = 764441336, val = { int_val = -1099735192, ll_val = 20375101288, double_val = 1.0066637576936534e-313, time_val = 20375101288, string_val = 0x4be735f68 <Address 0x4be735f68 out of bounds>, str_val = { s = 0x4be735f68 <Address 0x4be735f68 out of bounds>, len = 0}, blob_val = {s = 0x4be735f68 <Address 0x4be735f68 out of bounds>, len = 0}, bitmap_val = 3195232104}}, {type = 762988240, nul = 32655, free = -1099733856, val = {int_val = 764431176, ll_val = 43714104136, double_val = 2.1597637092324347e-313, time_val = 43714104136, string_val = 0xa2d904b48 <Address 0xa2d904b48 out of bounds>, str_val = {s = 0xa2d904b48 <Address 0xa2d904b48 out of bounds>, len = -1099727920}, blob_val = { s = 0xa2d904b48 <Address 0xa2d904b48 out of bounds>, len = -1099727920}, bitmap_val = 764431176}}, {type = 3195231888, nul = 32764, free = 741846319, val = {int_val = 763002856, ll_val = 140252920053736, double_val = 6.9294149527469796e-310, time_val = 140252920053736, string_val = 0x7f8f2d7a7fe8 " ", str_val = {s = 0x7f8f2d7a7fe8 " ", len = 0}, blob_val = { s = 0x7f8f2d7a7fe8 " ", len = 0}, bitmap_val = 763002856}}, {type = DB1_INT, nul = 0, free = 746368817, val = {int_val = -1099726096, ll_val = 140723503727344, double_val = 6.9526648754093279e-310, time_val = 140723503727344, string_val = 0x7ffcbe7382f0 "\a", str_val = {s = 0x7ffcbe7382f0 "\a", len = 0}, blob_val = {s = 0x7ffcbe7382f0 "\a", len = 0}, bitmap_val = 3195241200}}, {type = 4283776, nul = 116, free = 707819752, val = {int_val = 707816553, ll_val = 17887685737, double_val = 8.8376910062561592e-314, time_val = 17887685737, string_val = 0x42a306c69 <Address 0x42a306c69 out of bounds>, str_val = {s = 0x42a306c69 <Address 0x42a306c69 out of bounds>, len = 7702785}, blob_val = { s = 0x42a306c69 <Address 0x42a306c69 out of bounds>, len = 7702785}, bitmap_val = 707816553}}, {type = 372744104, nul = 32655, free = 369111040, val = {int_val = 0, ll_val = 0, double_val = 0, time_val = 0, string_val = 0x0, str_val = {s = 0x0, len = 372744104}, blob_val = {s = 0x0, len = 372744104}, bitmap_val = 0}}, {type = 3195232112, nul = 32764, free = 6406847, val = { int_val = -72515583, ll_val = 140724530937857, double_val = 6.9527156263518799e-310, time_val = 140724530937857, string_val = 0x7ffcfbad8001 <Address 0x7ffcfbad8001 out of bounds>, str_val = { s = 0x7ffcfbad8001 <Address 0x7ffcfbad8001 out of bounds>, len = 719313408}, blob_val = {s = 0x7ffcfbad8001 <Address 0x7ffcfbad8001 out of bounds>, len = 719313408}, bitmap_val = 4222451713}}, { type = 719313408, nul = 32655, free = 719313408, val = {int_val = 719313408, ll_val = 140252876364288, double_val = 6.9294127942014453e-310, time_val = 140252876364288, string_val = 0x7f8f2adfda00 "1440744243.165", str_val = {s = 0x7f8f2adfda00 "1440744243.165", len = 719313422}, blob_val = {s = 0x7f8f2adfda00 "1440744243.165", len = 719313422}, bitmap_val = 719313408}}, {type = 719313663, nul = 32655, free = 1, val = {int_val = 369145008, ll_val = 140252526195888, double_val = 6.9293954935837754e-310, time_val = 140252526195888, string_val = 0x7f8f1600b4b0 "", str_val = {s = 0x7f8f1600b4b0 "", len = 0}, blob_val = {s = 0x7f8f1600b4b0 "", len = 0}, bitmap_val = 369145008}}, {type = 707819752, nul = 32655, free = 707816553, val = {int_val = 16, ll_val = 4294967312, double_val = 2.1219957988703226e-314, time_val = 4294967312, string_val = 0x100000010 <Address 0x100000010 out of bounds>, str_val = { s = 0x100000010 <Address 0x100000010 out of bounds>, len = 369145008}, blob_val = {s = 0x100000010 <Address 0x100000010 out of bounds>, len = 369145008}, bitmap_val = 16}}, {type = 3195232112, nul = 32764, free = 707692427, val = {int_val = 2, ll_val = 140252157050882, double_val = 6.9293772553971956e-310, time_val = 140252157050882, string_val = 0x7f8f00000002 <Address 0x7f8f00000002 out of bounds>, str_val = {s = 0x7f8f00000002 <Address 0x7f8f00000002 out of bounds>, len = 369145008}, blob_val = { s = 0x7f8f00000002 <Address 0x7f8f00000002 out of bounds>, len = 369145008}, bitmap_val = 2}}, {type = 3195232528, nul = 32764, free = 369145008, val = {int_val = 4283776, ll_val = 4283776, double_val = 2.1164665560792318e-317, time_val = 4283776, string_val = 0x415d80 "1\355I\211\321^H\211\342H\203\344\360PTI\307\300", str_val = { s = 0x415d80 "1\355I\211\321^H\211\342H\203\344\360PTI\307\300", len = -1099726096}, blob_val = {s = 0x415d80 "1\355I\211\321^H\211\342H\203\344\360PTI\307\300", len = -1099726096}, bitmap_val = 4283776}}, {type = 3195232192, nul = 32764, free = 707692599, val = {int_val = -1, ll_val = 502511173631, double_val = 2.482735075424428e-312, time_val = 502511173631, string_val = 0x74ffffffff <Address 0x74ffffffff out of bounds>, str_val = {s = 0x74ffffffff <Address 0x74ffffffff out of bounds>, len = 707819752}, blob_val = { s = 0x74ffffffff <Address 0x74ffffffff out of bounds>, len = 707819752}, bitmap_val = 4294967295}}, {type = 707816553, nul = 32655, free = -1111960512, val = {int_val = 0, ll_val = 0, double_val = 0, time_val = 0, string_val = 0x0, str_val = {s = 0x0, len = 372744160}, blob_val = {s = 0x0, len = 372744160}, bitmap_val = 0}}, {type = DB1_INT, nul = 0, free = 14, val = { int_val = -1099734992, ll_val = 140723503718448, double_val = 6.9526648749698071e-310, time_val = 140723503718448, string_val = 0x7ffcbe736030 "\340`s\276", str_val = { s = 0x7ffcbe736030 "\340`s\276", len = 707698866}, blob_val = {s = 0x7ffcbe736030 "\340`s\276", len = 707698866}, bitmap_val = 3195232304}}, {type = 168587263, nul = 62914568, free = 373266808, val = {int_val = 0, ll_val = 0, double_val = 0, time_val = 0, string_val = 0x0, str_val = {s = 0x0, len = -1099734992}, blob_val = {s = 0x0, len = -1099734992}, bitmap_val = 0}}, {type = 3195232656, nul = 32764, free = 719239008, val = {int_val = 4283776, ll_val = 4283776, double_val = 2.1164665560792318e-317, time_val = 4283776, string_val = 0x415d80 "1\355I\211\321^H\211\342H\203\344\360PTI\307\300", str_val = {s = 0x415d80 "1\355I\211\321^H\211\342H\203\344\360PTI\307\300", len = 385987040}, blob_val = { s = 0x415d80 "1\355I\211\321^H\211\342H\203\344\360PTI\307\300", len = 385987040}, bitmap_val = 4283776}}} insert_keys = {0x7f8f2a50cdc0, 0x7f8f2a50cdb0, 0x7f8f2a50cd60, 0x7f8f2a50cd70, 0x7f8f2a50cd80, 0x7f8f2a50cd90, 0x7f8f2a50cda0, 0x7f8f2a50ce70, 0x7f8f2a50ce60, 0x7f8f2a50cde0, 0x7f8f2a50cdd0, 0x7f8f2a50cdf0, 0x7f8f2a50ce10, 0x7f8f2a50ce00, 0x7f8f2a50ce30, 0x7f8f2a50ce20, 0x7f8f2a50ce50, 0x7f8f2a50ce40, 0x7f8f2a50ce80, 0x7f8f2a50cea0, 0x7f8f2a50ceb0, 0x7f8f2a50cec0, 0x7f8f2a50ce90} __FUNCTION__ = "update_dialog_dbinfo_unsafe"

```

--- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/301#issuecomment-135744623

Here is the gdb output for crash using commit 2962852bf706692bdbc9b51419dbdc2012f34e1b

``` (gdb) frame 0 #0 0x00007f3a36b4d5ac in update_dialog_vars_dbinfo (cell=0x7f3a23da0df8, var=0x3433) at dlg_db_handler.c:652 652 SET_STR_VALUE(values+2, var->key); (gdb) p *cell $1 = {ref = 1, next = 0x0, prev = 0x0, h_id = 2296, h_entry = 2580, state = 1, lifetime = 10800, init_ts = 1441585434, start_ts = 0, dflags = 0, iflags = 0, sflags = 0, toroute = 0, toroute_name = { s = 0x0, len = 0}, from_rr_nb = 0, tl = {next = 0x0, prev = 0x0, timeout = 0}, callid = { s = 0x7f3a23da0f58 "45-22528@192.168.0.190sip:user1@test1.comsip:09011112222@192.168.2.189:5060sip:09011112222@192.168.2.190:5030030168.2.190:5030:101 0-15\r\na=sendrecv\r\n", len = 22}, from_uri = { s = 0x7f3a23da0f6e "sip:user1@test1.comsip:09011112222@192.168.2.189:5060sip:09011112222@192.168.2.190:5030030168.2.190:5030:101 0-15\r\na=sendrecv\r\n", len = 19}, to_uri = { s = 0x7f3a23da0f81 "sip:09011112222@192.168.2.189:5060sip:09011112222@192.168.2.190:5030030168.2.190:5030:101 0-15\r\na=sendrecv\r\n", len = 34}, req_uri = { s = 0x7f3a23da0fa3 "sip:09011112222@192.168.2.190:5030030168.2.190:5030:101 0-15\r\na=sendrecv\r\n", len = 34}, tag = {{s = 0x7f3a23b63558 "22528SIPpTag0045(", len = 16}, {s = 0x0, len = 0}}, cseq = { {s = 0x7f3a23b88510 "802r1", len = 3}, {s = 0x0, len = 0}}, route_set = {{s = 0x0, len = 0}, {s = 0x0, len = 0}}, contact = {{s = 0x7f3a23b93398 "sip:user1@192.168.2.50:5010", len = 27}, {s = 0x0, len = 0}}, bind_addr = {0x7f3a39c0d730, 0x0}, cbs = {first = 0x7f3a23b6aac8, types = 41172}, profile_links = 0x7f3a23b6d600, vars = 0x7f3a23e27f48} (gdb) p *cell->vars $2 = {key = {s = 0x7f3a239c2d28 "answer_time", len = 11}, value = {s = 0x7f3a23a5fbf0 "1441585434.599", len = 14}, vflags = 0, next = 0x7f3a23efff50} (gdb) set $p=cell->vars->next (gdb) while ($p != 0)

p *$p set $p=$p->next end

$3 = {key = {s = 0x7f3a23a6da10 "calling_number", len = 14}, value = {s = 0x7f3a23d8fd20 "0312341234", len = 10}, vflags = 0, next = 0x7f3a23d6eb88} $4 = {key = {s = 0x7f3a23d9aa08 "destination", len = 11}, value = {s = 0x7f3a23ca6428 "09011112222", len = 11}, vflags = 0, next = 0x7f3a239cb390} $5 = {key = {s = 0x7f3a23aece40 "caller_username", len = 15}, value = {s = 0x7f3a23bbfb70 "user1", len = 5}, vflags = 0, next = 0x7f3a23a9b670} $6 = {key = {s = 0x7f3a23c71d18 "caller_domain", len = 13}, value = {s = 0x7f3a23db6ff0 "test1.com", len = 9}, vflags = 0, next = 0x7f3a23dae4c0} $7 = {key = {s = 0x7f3a23ea1b70 "start_time", len = 10}, value = {s = 0x7f3a23b6d838 "2015-09-07 09:24:00", len = 19}, vflags = 0, next = 0x0} (gdb) frame 1 #1 0x00007f3a36b4e110 in update_dialog_dbinfo_unsafe (cell=0x7f3a23da0df8) at dlg_db_handler.c:720 720 if (update_dialog_vars_dbinfo(cell, var) != 0) (gdb) info locals i = 6 var = 0x3433 jdoc = {root = 0x7ffd1b5c8360, flags = 1, buf = {s = 0x7ffd1b5c5da4 "\001", len = 918097505}, malloc_fn = 0x1b5c5d20, free_fn = 0x400} values = {{type = 968806416, nul = 32570, free = 968806776, val = {int_val = 952365092, ll_val = 139888037195812, double_val = 6.9113873442613175e-310, time_val = 139888037195812, string_val = 0x7f3a38c3f024 "db_free_result", str_val = {s = 0x7f3a38c3f024 "db_free_result", len = -1}, blob_val = {s = 0x7f3a38c3f024 "db_free_result", len = -1}, bitmap_val = 952365092}}, { type = 459037504, nul = 32765, free = 5553258, val = {int_val = 971126424, ll_val = 139888055957144, double_val = 6.9113882711942786e-310, time_val = 139888055957144, string_val = 0x7f3a39e23698 "8", str_val = {s = 0x7f3a39e23698 "8", len = 971126480}, blob_val = {s = 0x7f3a39e23698 "8", len = 971126480}, bitmap_val = 971126424}}, {type = 943010100, nul = 960050485, free = 0, val = { int_val = 459037424, ll_val = 17638906608, double_val = 8.7147777852149514e-314, time_val = 17638906608, string_val = 0x41b5c5af0 <Address 0x41b5c5af0 out of bounds>, str_val = { s = 0x41b5c5af0 <Address 0x41b5c5af0 out of bounds>, len = 971126480}, blob_val = {s = 0x41b5c5af0 <Address 0x41b5c5af0 out of bounds>, len = 971126480}, bitmap_val = 459037424}}, { type = 4284160, nul = 0, free = 0, val = {int_val = 24, ll_val = 206158430232, double_val = 1.0185579797819065e-312, time_val = 206158430232, string_val = 0x3000000018 <Address 0x3000000018 out of bounds>, str_val = {s = 0x3000000018 <Address 0x3000000018 out of bounds>, len = 459038176}, blob_val = { s = 0x3000000018 <Address 0x3000000018 out of bounds>, len = 459038176}, bitmap_val = 24}}, {type = 459037984, nul = 32765, free = 459045808, val = {int_val = 1, ll_val = 4294967297, double_val = 2.121995791459338e-314, time_val = 4294967297, string_val = 0x100000001 <Address 0x100000001 out of bounds>, str_val = {s = 0x100000001 <Address 0x100000001 out of bounds>, len = 968806416}, blob_val = {s = 0x100000001 <Address 0x100000001 out of bounds>, len = 968806416}, bitmap_val = 1}}, {type = 968844264, nul = 32570, free = 0, val = {int_val = 0, ll_val = 0, double_val = 0, time_val = 0, string_val = 0x0, str_val = {s = 0x0, len = 0}, blob_val = {s = 0x0, len = 0}, bitmap_val = 0}}, {type = 459047776, nul = 32765, free = 968844320, val = { int_val = 968844320, ll_val = 139888053675040, double_val = 6.91138815844336e-310, time_val = 139888053675040, string_val = 0x7f3a39bf6420 "\200jb\002", str_val = {s = 0x7f3a39bf6420 "\200jb\002", len = 4284160}, blob_val = {s = 0x7f3a39bf6420 "\200jb\002", len = 4284160}, bitmap_val = 968844320}}, {type = DB1_INT, nul = 10, free = 0, val = {int_val = 0, ll_val = 140724603453440, double_val = 6.9527192090977147e-310, time_val = 140724603453440, string_val = 0x7ffd00000000 <Address 0x7ffd00000000 out of bounds>, str_val = { s = 0x7ffd00000000 <Address 0x7ffd00000000 out of bounds>, len = 956686756}, blob_val = {s = 0x7ffd00000000 <Address 0x7ffd00000000 out of bounds>, len = 956686756}, bitmap_val = 0}}, { type = 598080440, nul = 32570, free = 584531968, val = {int_val = 4284160, ll_val = 498220490496, double_val = 2.4615362840824888e-312, time_val = 498220490496, string_val = 0x7400415f00 <Address 0x7400415f00 out of bounds>, str_val = {s = 0x7400415f00 <Address 0x7400415f00 out of bounds>, len = 918218504}, blob_val = { s = 0x7400415f00 <Address 0x7400415f00 out of bounds>, len = 918218504}, bitmap_val = 4284160}}, {type = 918215305, nul = 4, free = 7783856, val = {int_val = 598080440, ll_val = 139887682911160, double_val = 6.9113698402737773e-310, time_val = 139887682911160, string_val = 0x7f3a23a5fbb8 "\020", str_val = {s = 0x7f3a23a5fbb8 "\020", len = 584531968}, blob_val = {s = 0x7f3a23a5fbb8 "\020", len = 584531968}, bitmap_val = 598080440}}, {type = DB1_INT, nul = 0, free = 598080440, val = {int_val = 459037744, ll_val = 140725062491184, double_val = 6.9527418885756602e-310, time_val = 140725062491184, string_val = 0x7ffd1b5c5c30 "\200\\\033\375\177", str_val = {s = 0x7ffd1b5c5c30 "\200\\\033\375\177", len = 6466558}, blob_val = { s = 0x7ffd1b5c5c30 "\200\\\033\375\177", len = 6466558}, bitmap_val = 459037744}}, {type = 927521223, nul = 32570, free = 459037952, val = {int_val = 255, ll_val = 255, double_val = 1.2598673968951787e-321, time_val = 255, string_val = 0xff <Address 0xff out of bounds>, str_val = {s = 0xff <Address 0xff out of bounds>, len = 0}, blob_val = { s = 0xff <Address 0xff out of bounds>, len = 0}, bitmap_val = 255}}, {type = 929725344, nul = 32570, free = -1115228334, val = {int_val = -72515583, ll_val = 140728825905153, double_val = 6.9529278259309764e-310, time_val = 140728825905153, string_val = 0x7ffdfbad8001 <Address 0x7ffdfbad8001 out of bounds>, str_val = { s = 0x7ffdfbad8001 <Address 0x7ffdfbad8001 out of bounds>, len = 929725344}, blob_val = {s = 0x7ffdfbad8001 <Address 0x7ffdfbad8001 out of bounds>, len = 929725344}, bitmap_val = 4222451713}}, { type = 929725344, nul = 32570, free = 1, val = {int_val = 918218504, ll_val = 139888003049224, double_val = 6.9113856571957121e-310, time_val = 139888003049224, string_val = 0x7f3a36bae708 "new_dlg_var", str_val = {s = 0x7f3a36bae708 "new_dlg_var", len = 918215305}, blob_val = {s = 0x7f3a36bae708 "new_dlg_var", len = 918215305}, bitmap_val = 918218504}}, { type = 16, nul = 0, free = 584531968, val = {int_val = 584532328, ll_val = 4879499624, double_val = 2.4107931331136797e-314, time_val = 4879499624, string_val = 0x122d74168 <Address 0x122d74168 out of bounds>, str_val = {s = 0x122d74168 <Address 0x122d74168 out of bounds>, len = 584565936}, blob_val = { s = 0x122d74168 <Address 0x122d74168 out of bounds>, len = 584565936}, bitmap_val = 584532328}}, {type = 459037744, nul = 32765, free = 918089567, val = {int_val = 0, ll_val = 0, double_val = 0, time_val = 0, string_val = 0x0, str_val = {s = 0x0, len = 15}, blob_val = {s = 0x0, len = 15}, bitmap_val = 0}}, {type = 4284160, nul = 0, free = 584565936, val = {int_val = 0, ll_val = 0, double_val = 0, time_val = 0, string_val = 0x0, str_val = {s = 0x0, len = 0}, blob_val = {s = 0x0, len = 0}, bitmap_val = 0}}, {type = 459037824, nul = 32765, free = 918089739, val = { int_val = 918178514, ll_val = 499134384850, double_val = 2.4660515221248855e-312, time_val = 499134384850, string_val = 0x7436ba4ad2 <Address 0x7436ba4ad2 out of bounds>, str_val = { s = 0x7436ba4ad2 <Address 0x7436ba4ad2 out of bounds>, len = 918218504}, blob_val = {s = 0x7436ba4ad2 <Address 0x7436ba4ad2 out of bounds>, len = 918218504}, bitmap_val = 918178514}}, { type = 918215305, nul = 32570, free = 584531968, val = {int_val = -1, ll_val = 4294967295, double_val = 2.1219957904712067e-314, time_val = 4294967295, string_val = 0xffffffff <Address 0xffffffff out of bounds>, str_val = {s = 0xffffffff <Address 0xffffffff out of bounds>, len = 598080496}, blob_val = { s = 0xffffffff <Address 0xffffffff out of bounds>, len = 598080496}, bitmap_val = 4294967295}}, {type = 459038016, nul = 32765, free = 14, val = {int_val = 459037952, ll_val = 140725062491392, double_val = 6.9527418885859368e-310, time_val = 140725062491392, string_val = 0x7ffd1b5c5d00 "\244]\\033\375\177", str_val = {s = 0x7ffd1b5c5d00 "\244]\\033\375\177", len = 918096116}, blob_val = {s = 0x7ffd1b5c5d00 "\244]\\033\375\177", len = 918096116}, bitmap_val = 459037952}}, {type = 459037968, nul = 32765, free = 6403297, val = {int_val = 459038320, ll_val = 140725062491760, double_val = 6.9527418886041184e-310, time_val = 140725062491760, string_val = 0x7ffd1b5c5e70 "", str_val = {s = 0x7ffd1b5c5e70 "", len = 876528715}, blob_val = { s = 0x7ffd1b5c5e70 "", len = 876528715}, bitmap_val = 459038320}}, {type = 459038336, nul = 32765, free = 929650944, val = {int_val = 599173776, ll_val = 139887684004496, double_val = 6.911369894291753e-310, time_val = 139887684004496, string_val = 0x7f3a23b6aa90 "(", str_val = {s = 0x7f3a23b6aa90 "(", len = 602046280}, blob_val = {s = 0x7f3a23b6aa90 "(", len = 602046280}, bitmap_val = 599173776}}, {type = 599, nul = 0, free = 459038272, val = {int_val = 14, ll_val = 14, double_val = 6.9169190417774516e-323, time_val = 14, string_val = 0xe <Address 0xe out of bounds>, str_val = {s = 0xe <Address 0xe out of bounds>, len = 4284160}, blob_val = {s = 0xe <Address 0xe out of bounds>, len = 4284160}, bitmap_val = 14}}} insert_keys = {0x7f3a36db3dc0, 0x7f3a36db3db0, 0x7f3a36db3d60, 0x7f3a36db3d70, 0x7f3a36db3d80, 0x7f3a36db3d90, 0x7f3a36db3da0, 0x7f3a36db3e70, 0x7f3a36db3e60, 0x7f3a36db3de0, 0x7f3a36db3dd0, 0x7f3a36db3df0, 0x7f3a36db3e10, 0x7f3a36db3e00, 0x7f3a36db3e50, 0x7f3a36db3e40, 0x7f3a36db3e30, 0x7f3a36db3e20, 0x7f3a36db3e80, 0x7f3a36db3ea0, 0x7f3a36db3eb0, 0x7f3a36db3ec0, 0x7f3a36db3e90} __FUNCTION__ = "update_dialog_dbinfo_unsafe" (gdb) ```

About access to the server, I am asking our network/security team if this access can be granted. This might take some time, so meanwhile, I am trying to reproduce this in two VMs at DigitalOcean but no luck so far (in the lab, i am using kvm and vmware hosts and the crash happens easily in both of them.

--- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/301#issuecomment-138813002

OK. I am updating the kamailio commit for the load tests. Also, one of the kamailio instances running commit 2962852bf706692bdbc9b51419dbdc2012f34e1b at DigitalOcean crashed. If you want access to it, just provide me the email address to where I should send the access information.

--- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/301#issuecomment-139209744

I am testing commit cecdd0817052046e634152d6e512165451b5f6d4 in our lab. The crash happened again, but this time, it was when processing "200 OK": ``` (gdb) bt #0 0x00007f060c5ee5fc in update_dialog_vars_dbinfo (cell=0x7f05f919c150, var=0x3433) at dlg_db_handler.c:652 #1 0x00007f060c5ef449 in update_dialog_dbinfo_unsafe (cell=0x7f05f919c150) at dlg_db_handler.c:725 #2 0x00007f060c5f0eb3 in update_dialog_dbinfo (cell=0x7f05f919c150) at dlg_db_handler.c:874 #3 0x00007f060c635549 in pv_set_dlg_variable (msg=0x7f060f8de1f8, param=0x7f060f73ac40, op=254, val=0x7fffc9fbb670) at dlg_var.c:428 #4 0x00000000004a0744 in lval_pvar_assign (h=0x7fffc9fbc8d0, msg=0x7f060f8de1f8, lv=0x7f060f8a8de0, rv=0x7f060f8a9018) at lvalue.c:351 #5 0x00000000004a1149 in lval_assign (h=0x7fffc9fbc8d0, msg=0x7f060f8de1f8, lv=0x7f060f8a8de0, rve=0x7f060f8a9010) at lvalue.c:399 #6 0x00000000004292bb in do_action (h=0x7fffc9fbc8d0, a=0x7f060f8a9710, msg=0x7f060f8de1f8) at action.c:1429 #7 0x000000000042ac60 in run_actions (h=0x7fffc9fbc8d0, a=0x7f060f8a9710, msg=0x7f060f8de1f8) at action.c:1548 #8 0x000000000041e203 in do_action (h=0x7fffc9fbc8d0, a=0x7f060f8b33e8, msg=0x7f060f8de1f8) at action.c:1044 #9 0x000000000042ac60 in run_actions (h=0x7fffc9fbc8d0, a=0x7f060f8b33e8, msg=0x7f060f8de1f8) at action.c:1548 #10 0x000000000042b3ae in run_top_route (a=0x7f060f8b33e8, msg=0x7f060f8de1f8, c=0x7fffc9fbc8d0) at action.c:1634 #11 0x00007f060f419c50 in reply_received (p_msg=0x7f060f8de1f8) at t_reply.c:2315 #12 0x0000000000491a4f in do_forward_reply (msg=0x7f060f8de1f8, mode=0) at forward.c:747 #13 0x0000000000493132 in forward_reply (msg=0x7f060f8de1f8) at forward.c:849 #14 0x0000000000511d8e in receive_msg ( buf=0xa851c0 "SIP/2.0 200 OK\r\nTo: sip:09011112222@192.168.2.103:5060;tag=2793SIPpTag0112907\r\nFrom: 0312341234 sip:0312341234@test1.com;tag=2778SIPpTag0035787\r\nCall-ID: 35787-2778@192.168.0.104\r\nCSeq: 802 INVITE"..., len=810, rcv_info=0x7fffc9fbcea0) at receive.c:255 #15 0x0000000000618278 in udp_rcv_loop () at udp_server.c:495 #16 0x00000000004ac736 in main_loop () at main.c:1573 #17 0x00000000004b2d41 in main (argc=7, argv=0x7fffc9fbd338) at main.c:2533 ```

Also, another instance stopped processing messages. Then I checked dialog stats and got this (absurd value for active_dialogs): ``` [root@lab002185-flip-server ~]# kamctl fifo get_statistics dialog: dialog:active_dialogs = 18446744073709551613 dialog:early_dialogs = 2 dialog:expired_dialogs = 9180 dialog:failed_dialogs = 860123 dialog:processed_dialogs = 4815738 ```

I will prepare the DigitalOcean VMs again to try to reproduce the problem there with commit cecdd0817052046e634152d6e512165451b5f6d4

--- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/301#issuecomment-139923016

Well, I always do full build. So i did: rm -fr kamailio git clone git clone git://git.kamailio.org/kamailio kamailio cd kamailio git checkout cecdd0817052046e634152d6e512165451b5f6d4 Then, since cecdd0817052046e634152d6e512165451b5f6d4 is newer than 7f9194c416e171c2b723430eb98a55a52b7b5e38, I am sure I tested both (I confirmed the changes for 7f9194c416e171c2b723430eb98a55a52b7b5e38 are present). Anyway, I will test with 4.3.

--- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/301#issuecomment-139926320

A fix was pushed for the issue you noticed when processing was stopped. The best will be to test with latest master branch or latest 4.3 branch.

If you test with master branch, then add the command line parameter '-x qm' to kamailio -- qm is the memory manager that does some extra checks to detect buffer overflows.

--- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/301#issuecomment-140039394

Wondering if you had the chance to run some tests since last comment 3 days ago and what are the results.

--- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/301#issuecomment-141104338

The problem of having kamailio stopping processing messages happened again: ``` [root@lab002185-flip-server kamailio-4.4]# kamctl fifo version Server:: kamailio (4.4.0-dev4 (x86_64/linux)) Build:: mi_core.c compiled on 20:23:03 Sep 14 2015 with gcc 4.4.7 Flags:: STATS: Off, USE_TCP, USE_TLS, USE_SCTP, TLS_HOOKS, USE_RAW_SOCKS, DISABLE_NAGLE, USE_MCAST, DNS_IP_HACK, SHM_MEM, SHM_MMAP, PKG_MALLOC, Q_MALLOC, F_MALLOC, DBG_SR_MEMORY, USE_FUTEX, FAST_LOCK-ADAPTIVE_WAIT, USE_DNS_CACHE, USE_DNS_FAILOVER, USE_NAPTR, USE_DST_BLACKLIST, HAVE_RESOLV_RES GIT:: 171553

[root@lab002185-flip-server kamailio-4.4]# kamctl fifo get_statistics dialog: dialog:active_dialogs = 18446744073709551613 dialog:early_dialogs = 1 dialog:expired_dialogs = 2319 dialog:failed_dialogs = 354478 dialog:processed_dialogs = 4891209

[root@lab002185-flip-server kamailio-4.4]# kamctl fifo ps Process:: ID=0 PID=27872 Type=attendant Process:: ID=1 PID=27887 Type=udp receiver child=0 sock=192.168.2.185:5060 Process:: ID=2 PID=27888 Type=udp receiver child=1 sock=192.168.2.185:5060 Process:: ID=3 PID=27889 Type=udp receiver child=2 sock=192.168.2.185:5060 Process:: ID=4 PID=27890 Type=udp receiver child=3 sock=192.168.2.185:5060 Process:: ID=5 PID=27891 Type=slow timer Process:: ID=6 PID=27892 Type=timer Process:: ID=7 PID=27898 Type=MI FIFO Process:: ID=8 PID=27900 Type=Dialog Clean Timer Process:: ID=9 PID=27901 Type=SNMP AgentX Process:: ID=10 PID=27904 Type=MI DATAGRAM Process:: ID=11 PID=27906 Type=ctl handler Process:: ID=12 PID=27907 Type=tcp receiver (generic) child=0 Process:: ID=13 PID=27908 Type=tcp receiver (generic) child=1 Process:: ID=14 PID=27909 Type=tcp receiver (generic) child=2 Process:: ID=15 PID=27914 Type=tcp receiver (generic) child=3 Process:: ID=16 PID=27916 Type=tcp main process ``` I collected the bt of one of the UDP receivers: ``` [root@lab002185-flip-server kamailio-4.4]# gdb attach 27887 GNU gdb (GDB) Red Hat Enterprise Linux (7.2-83.el6) Copyright (C) 2010 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later http://gnu.org/licenses/gpl.html This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: http://www.gnu.org/software/gdb/bugs/... attach: No such file or directory. Attaching to process 27887 Reading symbols from /usr/local/src/git/kamailio-4.4/kamailio...done. Reading symbols from /lib64/libdl.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libdl.so.2 Reading symbols from /lib64/libresolv.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libresolv.so.2 Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done. Loaded symbols for /lib64/libc.so.6 Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/ld-linux-x86-64.so.2 Reading symbols from /usr/local/lib64/kamailio/modules/tm.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/tm.so Reading symbols from /usr/local/lib64/kamailio/modules/tmx.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/tmx.so Reading symbols from /usr/local/lib64/kamailio/libkmi.so.1...done. Loaded symbols for /usr/local/lib64/kamailio/libkmi.so.1 Reading symbols from /usr/local/lib64/kamailio/libkcore.so.1...done. Loaded symbols for /usr/local/lib64/kamailio/libkcore.so.1 Reading symbols from /usr/local/lib64/kamailio/modules/db_mysql.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/db_mysql.so Reading symbols from /usr/lib64/mysql/libmysqlclient.so.16...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/mysql/libmysqlclient.so.16 Reading symbols from /lib64/libz.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libz.so.1 Reading symbols from /lib64/libcrypt.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libcrypt.so.1 Reading symbols from /lib64/libnsl.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libnsl.so.1 Reading symbols from /lib64/libm.so.6...(no debugging symbols found)...done. Loaded symbols for /lib64/libm.so.6 Reading symbols from /usr/lib64/libssl.so.10...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libssl.so.10 Reading symbols from /usr/lib64/libcrypto.so.10...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libcrypto.so.10 Reading symbols from /usr/local/lib64/kamailio/libsrdb2.so.1...done. Loaded symbols for /usr/local/lib64/kamailio/libsrdb2.so.1 Reading symbols from /usr/local/lib64/kamailio/libsrdb1.so.1...done. Loaded symbols for /usr/local/lib64/kamailio/libsrdb1.so.1 Reading symbols from /lib64/libfreebl3.so...(no debugging symbols found)...done. Loaded symbols for /lib64/libfreebl3.so Reading symbols from /lib64/libgssapi_krb5.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libgssapi_krb5.so.2 Reading symbols from /lib64/libkrb5.so.3...(no debugging symbols found)...done. Loaded symbols for /lib64/libkrb5.so.3 Reading symbols from /lib64/libcom_err.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libcom_err.so.2 Reading symbols from /lib64/libk5crypto.so.3...(no debugging symbols found)...done. Loaded symbols for /lib64/libk5crypto.so.3 Reading symbols from /lib64/libkrb5support.so.0...(no debugging symbols found)...done. Loaded symbols for /lib64/libkrb5support.so.0 Reading symbols from /lib64/libkeyutils.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libkeyutils.so.1 Reading symbols from /lib64/libpthread.so.0...(no debugging symbols found)...done. [Thread debugging using libthread_db enabled] Loaded symbols for /lib64/libpthread.so.0 Reading symbols from /lib64/libselinux.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libselinux.so.1 Reading symbols from /usr/local/lib64/kamailio/modules/sl.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/sl.so Reading symbols from /usr/local/lib64/kamailio/modules/rr.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/rr.so Reading symbols from /usr/local/lib64/kamailio/modules/maxfwd.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/maxfwd.so Reading symbols from /usr/local/lib64/kamailio/modules/usrloc.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/usrloc.so Reading symbols from /usr/local/lib64/kamailio/libsrutils.so.1...done. Loaded symbols for /usr/local/lib64/kamailio/libsrutils.so.1 Reading symbols from /usr/local/lib64/kamailio/modules/registrar.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/registrar.so Reading symbols from /usr/local/lib64/kamailio/modules/textops.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/textops.so Reading symbols from /usr/local/lib64/kamailio/modules/mi_fifo.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/mi_fifo.so Reading symbols from /usr/local/lib64/kamailio/modules/uri_db.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/uri_db.so Reading symbols from /usr/local/lib64/kamailio/modules/xlog.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/xlog.so Reading symbols from /usr/local/lib64/kamailio/modules/acc.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/acc.so Reading symbols from /usr/local/lib64/kamailio/modules/carrierroute.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/carrierroute.so Reading symbols from /usr/local/lib64/kamailio/libtrie.so.1...done. Loaded symbols for /usr/local/lib64/kamailio/libtrie.so.1 Reading symbols from /usr/local/lib64/kamailio/modules/nathelper.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/nathelper.so Reading symbols from /usr/local/lib64/kamailio/modules/dialog.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/dialog.so Reading symbols from /usr/local/lib64/kamailio/modules/app_perl.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/app_perl.so Reading symbols from /usr/lib64/perl5/CORE/libperl.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/perl5/CORE/libperl.so Reading symbols from /lib64/libutil.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libutil.so.1 Reading symbols from /usr/local/lib64/kamailio/modules/snmpstats.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/snmpstats.so Reading symbols from /usr/lib64/libnetsnmpagent.so.20...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libnetsnmpagent.so.20 Reading symbols from /usr/lib64/libnetsnmphelpers.so.20...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libnetsnmphelpers.so.20 Reading symbols from /usr/lib64/libnetsnmpmibs.so.20...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libnetsnmpmibs.so.20 Reading symbols from /usr/lib64/libnetsnmp.so.20...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libnetsnmp.so.20 Reading symbols from /lib64/libwrap.so.0...(no debugging symbols found)...done. Loaded symbols for /lib64/libwrap.so.0 Reading symbols from /usr/lib64/libsensors.so.4...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libsensors.so.4 Reading symbols from /usr/lib64/librpm.so.1...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/librpm.so.1 Reading symbols from /usr/lib64/librpmio.so.1...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/librpmio.so.1 Reading symbols from /lib64/libpopt.so.0...(no debugging symbols found)...done. Loaded symbols for /lib64/libpopt.so.0 Reading symbols from /usr/lib64/libnss3.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libnss3.so Reading symbols from /lib64/libbz2.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libbz2.so.1 Reading symbols from /usr/lib64/libelf.so.1...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libelf.so.1 Reading symbols from /usr/lib64/liblzma.so.0...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/liblzma.so.0 Reading symbols from /usr/lib64/liblua-5.1.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/liblua-5.1.so Reading symbols from /lib64/libcap.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libcap.so.2 Reading symbols from /lib64/libacl.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libacl.so.1 Reading symbols from /lib64/libdb-4.7.so...(no debugging symbols found)...done. Loaded symbols for /lib64/libdb-4.7.so Reading symbols from /lib64/librt.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/librt.so.1 Reading symbols from /lib64/libgcc_s.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libgcc_s.so.1 Reading symbols from /usr/lib64/libnssutil3.so...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libnssutil3.so Reading symbols from /lib64/libplc4.so...(no debugging symbols found)...done. Loaded symbols for /lib64/libplc4.so Reading symbols from /lib64/libplds4.so...(no debugging symbols found)...done. Loaded symbols for /lib64/libplds4.so Reading symbols from /lib64/libnspr4.so...(no debugging symbols found)...done. Loaded symbols for /lib64/libnspr4.so Reading symbols from /lib64/libattr.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libattr.so.1 Reading symbols from /usr/local/lib64/kamailio/modules/auth.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/auth.so Reading symbols from /usr/local/lib64/kamailio/modules/auth_db.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/auth_db.so Reading symbols from /usr/local/lib64/kamailio/modules/lcr.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/lcr.so Reading symbols from /lib64/libpcre.so.0...(no debugging symbols found)...done. Loaded symbols for /lib64/libpcre.so.0 Reading symbols from /usr/local/lib64/kamailio/modules/alias_db.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/alias_db.so Reading symbols from /usr/local/lib64/kamailio/modules/domain.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/domain.so Reading symbols from /usr/local/lib64/kamailio/modules/uac.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/uac.so Reading symbols from /usr/local/lib64/kamailio/modules/avpops.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/avpops.so Reading symbols from /usr/local/lib64/kamailio/modules/userblacklist.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/userblacklist.so Reading symbols from /usr/local/lib64/kamailio/modules/mi_datagram.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/mi_datagram.so Reading symbols from /usr/local/lib64/kamailio/modules/cfgutils.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/cfgutils.so Reading symbols from /usr/local/lib64/kamailio/modules/rtpproxy.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/rtpproxy.so Reading symbols from /usr/local/lib64/kamailio/modules/siputils.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/siputils.so Reading symbols from /usr/local/lib64/kamailio/modules/pv.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/pv.so Reading symbols from /usr/local/lib64/kamailio/modules/kex.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/kex.so Reading symbols from /usr/local/lib64/kamailio/modules/corex.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/corex.so Reading symbols from /usr/local/lib64/kamailio/modules/ctl.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/ctl.so Reading symbols from /usr/local/lib64/kamailio/modules/msilo.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/msilo.so Reading symbols from /usr/local/lib64/kamailio/modules/tls.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/tls.so Reading symbols from /usr/local/lib64/kamailio/modules/dispatcher.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/dispatcher.so Reading symbols from /usr/local/lib64/kamailio/modules/sqlops.so...done. Loaded symbols for /usr/local/lib64/kamailio/modules/sqlops.so Reading symbols from /lib64/libnss_files.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libnss_files.so.2 Reading symbols from /lib64/libnss_dns.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libnss_dns.so.2 0x0000003aadce5209 in syscall () from /lib64/libc.so.6 Missing separate debuginfos, use: debuginfo-install bzip2-libs-1.0.5-7.el6_0.x86_64 db4-4.7.25-19.el6_6.x86_64 elfutils-libelf-0.161-3.el6.x86_64 glibc-2.12-1.166.el6_7.1.x86_64 keyutils-libs-1.4-5.el6.x86_64 krb5-libs-1.10.3-42.el6.x86_64 libacl-2.2.49-6.el6.x86_64 libattr-2.4.44-7.el6.x86_64 libcap-2.16-5.5.el6.x86_64 libcom_err-1.41.12-22.el6.x86_64 libgcc-4.4.7-16.el6.x86_64 libselinux-2.0.94-5.8.el6.x86_64 lm_sensors-libs-3.1.1-17.el6.x86_64 lua-5.1.4-4.1.el6.x86_64 mysql-libs-5.1.73-5.el6_6.x86_64 net-snmp-libs-5.5-54.el6_7.1.x86_64 nspr-4.10.8-1.el6_6.x86_64 nss-3.19.1-3.el6_6.x86_64 nss-softokn-freebl-3.14.3-22.el6_6.x86_64 nss-util-3.19.1-1.el6_6.x86_64 openssl-1.0.1e-42.el6.x86_64 pcre-7.8-7.el6.x86_64 perl-libs-5.10.1-141.el6.x86_64 popt-1.13-7.el6.x86_64 rpm-libs-4.8.0-47.el6.x86_64 tcp_wrappers-libs-7.6-57.el6.x86_64 xz-libs-4.999.9-0.5.beta.20091007git.el6.x86_64 zlib-1.2.3-29.el6.x86_64 (gdb) bt #0 0x0000003aadce5209 in syscall () from /lib64/libc.so.6 #1 0x00007fd4fdc3ab2a in futex_get (lock=0x7ffdebebb714) at ../../mem/../futexlock.h:121 #2 0x00007fd4fdc46b6a in update_dialog_dbinfo (cell=0x7fd4ea434738) at dlg_db_handler.c:873 #3 0x00007fd4fdc8a93a in pv_set_dlg_variable (msg=0x7fd500f8a468, param=0x7fd500dc3120, op=254, val=0x7ffdebebb820) at dlg_var.c:428 #4 0x00000000004a092c in lval_pvar_assign (h=0x7ffdebebca80, msg=0x7fd500f8a468, lv=0x7fd500f54d30, rv=0x7fd500f55008) at lvalue.c:351 #5 0x00000000004a1331 in lval_assign (h=0x7ffdebebca80, msg=0x7fd500f8a468, lv=0x7fd500f54d30, rve=0x7fd500f55000) at lvalue.c:399 #6 0x0000000000429a7f in do_action (h=0x7ffdebebca80, a=0x7fd500f55728, msg=0x7fd500f8a468) at action.c:1429 #7 0x000000000042b429 in run_actions (h=0x7ffdebebca80, a=0x7fd500f55728, msg=0x7fd500f8a468) at action.c:1548 #8 0x000000000041e93b in do_action (h=0x7ffdebebca80, a=0x7fd500f5fd10, msg=0x7fd500f8a468) at action.c:1044 #9 0x000000000042b429 in run_actions (h=0x7ffdebebca80, a=0x7fd500f5fd10, msg=0x7fd500f8a468) at action.c:1548 #10 0x000000000042bb77 in run_top_route (a=0x7fd500f5fd10, msg=0x7fd500f8a468, c=0x7ffdebebca80) at action.c:1634 #11 0x00007fd500a67e80 in reply_received (p_msg=0x7fd500f8a468) at t_reply.c:2317 #12 0x0000000000491c1b in do_forward_reply (msg=0x7fd500f8a468, mode=0) at forward.c:747 #13 0x0000000000493308 in forward_reply (msg=0x7fd500f8a468) at forward.c:849 #14 0x00000000005119de in receive_msg ( buf=0xa92340 "SIP/2.0 406 Not Acceptable\r\nTo: sip:09011112222@192.168.2.185:5060;tag=16045SIPpTag014890951\r\nFrom: 0312341234 sip:0312341234@test1.com;tag=16047SIPpTag002445293\r\nCall-ID: 2445293-16047@192.168.0."..., len=488, rcv_info=0x7ffdebebd050) at receive.c:255 #15 0x0000000000617928 in udp_rcv_loop () at udp_server.c:495 #16 0x00000000004ac857 in main_loop () at main.c:1579 #17 0x00000000004b2f11 in main (argc=9, argv=0x7ffdebebd4e8) at main.c:2566 ```

--- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/301#issuecomment-141336345

I think I found and fixed this one, try 4.3.3 version or latest master branch. Re-open if you discover any issue after upgrade.

--- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/301#issuecomment-145242104