11 Jun
2009
11 Jun
'09
11:33 a.m.
I've recently tried to migrate my production environment to kamailio
1.5.1-notls from openser-1.3.4-notls. I have been working through
some issues, and the most recent issues have been that kamailio has
begun to segmentation fault and core dump. Has anyone else
experienced any similar issues, what other information could i provide
that can be helpful in diagnosing my troubles with 1.5.1. I have had
to fall back to 1.3.4 until i can get this sorted out.
Below is my backtrace of the core dump file.
Core was generated by `/sbin/kamailio -m 1024'.
Program terminated with signal 11, Segmentation fault.
[New process 5315]
#0 0x00007f57bb9954e0 in update_dialog_dbinfo (cell=0x7f577e6a17c0)
at dlg_db_handler.c:498
498 SET_STR_VALUE(values+8, cell->bind_addr[DLG_CALLEE_LEG]-
sock_str);
Missing separate debuginfos, use:
debuginfo-install bzip2-
libs-1.0.5-3.fc10.x86_64 compat-db45-4.5.20-5.fc10.x86_64 e2fsprogs-
libs-1.41.4-5.fc10.x86_64 elfutils-libelf-0.141-1.fc10.x86_64 file-
libs-4.26-5.fc10.x86_64 glibc-2.9-3.x86_64 keyutils-
libs-1.2-3.fc9.x86_64 krb5-libs-1.6.3-18.fc10.x86_64
libconfuse-2.6-1.fc9.x86_64 libgcc-4.3.2-7.x86_64
libselinux-2.0.78-1.fc10.x86_64 lm_sensors-3.0.2-1.fc10.x86_64
lua-5.1.4-1.fc10.x86_64 mysql-libs-5.0.77-1.fc10.x86_64 net-snmp-
libs-5.4.2.1-3.fc10.x86_64 nspr-devel-4.7.3-2.fc10.x86_64 nss-
devel-3.12.2.0-5.fc10.x86_64 openssl-0.9.8g-13.fc10.x86_64
pcre-7.8-1.fc10.x86_64 perl-libs-5.10.0-68.fc10.x86_64
popt-1.13-4.fc10.x86_64 radiusclient-ng-0.5.6-3.fc9.x86_64 rpm-
libs-4.6.0-2.fc10.x86_64 tcp_wrappers-libs-7.6-53.fc10.x86_64
zlib-1.2.3-18.fc9.x86_64
(gdb) bt
#0 0x00007f57bb9954e0 in update_dialog_dbinfo (cell=0x7f577e6a17c0)
at dlg_db_handler.c:498
#1 0x00007f57bb998b5e in dlg_onreply (t=0x7f577aaec3b8, type=<value
optimized out>, param=<value optimized out>) at dlg_handlers.c:318
#2 0x00007f57bf59d345 in run_trans_callbacks (type=128,
trans=0x7f577e6a3918, req=0x7f577e6afce8, rpl=0x775710, code=200) at
t_hooks.c:240
#3 0x00007f57bf5ba352 in relay_reply (t=0x7f577e6a3918, p_msg=<value
optimized out>, branch=0, msg_status=200, cancel_bitmap=0x7fffc7c0c098)
at t_reply.c:1229
#4 0x00007f57bf5badce in reply_received (p_msg=0x775710) at t_reply.c:
1485
#5 0x0000000000420382 in forward_reply (msg=0x775710) at forward.c:521
#6 0x00000000004529f9 in receive_msg (
buf=0x71f880 "SIP/2.0 200 OK\r\nVia: SIP/2.0/UDP
8.17.32.37;branch=z9hG4bKd89d.68915ca2.0\r\nVia: SIP/2.0/UDP
8.17.32.166
:5060;received=8.17.32.166;branch=z9hG4bK0615b7d2;rport=5060\r\nFrom:
\"CID Info\" <sip:5551212"..., len=889, rcv_info=0x7fffc7c0c190) at
receive.c:212
#7 0x0000000000487da6 in udp_rcv_loop () at udp_server.c:449
#8 0x00000000004274e4 in main_loop () at main.c:774
#9 main (argc=<value optimized out>, argv=0x7fffc7c0c368) at main.c:
1321
(gdb)
11 Jun
11 Jun
12:59 p.m.
Hello,
there were some recent fixes to dialog, but after 1.5.1 was released.
you have to take the source from svn branch 1.5:
svn co https://openser.svn.sourceforge.net/svnroot/openser/branches/1.5
kamailio-1.5
Install it and try again. Should be fixed, if not, let me know.
Cheers,
Daniel
On 06/11/2009 06:33 PM, Stagg Shelton wrote:
I've recently tried to migrate my production
environment to kamailio
1.5.1-notls from openser-1.3.4-notls. I have been working through
some issues, and the most recent issues have been that kamailio has
begun to segmentation fault and core dump. Has anyone else
experienced any similar issues, what other information could i provide
that can be helpful in diagnosing my troubles with 1.5.1. I have had
to fall back to 1.3.4 until i can get this sorted out.
Below is my backtrace of the core dump file.
Core was generated by `/sbin/kamailio -m 1024'.
Program terminated with signal 11, Segmentation fault.
[New process 5315]
#0 0x00007f57bb9954e0 in update_dialog_dbinfo (cell=0x7f577e6a17c0)
at dlg_db_handler.c:498
498 SET_STR_VALUE(values+8,
cell->bind_addr[DLG_CALLEE_LEG]->sock_str);
Missing separate debuginfos, use: debuginfo-install
bzip2-libs-1.0.5-3.fc10.x86_64 compat-db45-4.5.20-5.fc10.x86_64
e2fsprogs-libs-1.41.4-5.fc10.x86_64
elfutils-libelf-0.141-1.fc10.x86_64 file-libs-4.26-5.fc10.x86_64
glibc-2.9-3.x86_64 keyutils-libs-1.2-3.fc9.x86_64
krb5-libs-1.6.3-18.fc10.x86_64 libconfuse-2.6-1.fc9.x86_64
libgcc-4.3.2-7.x86_64 libselinux-2.0.78-1.fc10.x86_64
lm_sensors-3.0.2-1.fc10.x86_64 lua-5.1.4-1.fc10.x86_64
mysql-libs-5.0.77-1.fc10.x86_64 net-snmp-libs-5.4.2.1-3.fc10.x86_64
nspr-devel-4.7.3-2.fc10.x86_64 nss-devel-3.12.2.0-5.fc10.x86_64
openssl-0.9.8g-13.fc10.x86_64 pcre-7.8-1.fc10.x86_64
perl-libs-5.10.0-68.fc10.x86_64 popt-1.13-4.fc10.x86_64
radiusclient-ng-0.5.6-3.fc9.x86_64 rpm-libs-4.6.0-2.fc10.x86_64
tcp_wrappers-libs-7.6-53.fc10.x86_64 zlib-1.2.3-18.fc9.x86_64
(gdb) bt
#0 0x00007f57bb9954e0 in update_dialog_dbinfo (cell=0x7f577e6a17c0)
at dlg_db_handler.c:498
#1 0x00007f57bb998b5e in dlg_onreply (t=0x7f577aaec3b8, type=<value
optimized out>, param=<value optimized out>) at dlg_handlers.c:318
#2 0x00007f57bf59d345 in run_trans_callbacks (type=128,
trans=0x7f577e6a3918, req=0x7f577e6afce8, rpl=0x775710, code=200) at
t_hooks.c:240
#3 0x00007f57bf5ba352 in relay_reply (t=0x7f577e6a3918, p_msg=<value
optimized out>, branch=0, msg_status=200, cancel_bitmap=0x7fffc7c0c098)
at t_reply.c:1229
#4 0x00007f57bf5badce in reply_received (p_msg=0x775710) at
t_reply.c:1485
#5 0x0000000000420382 in forward_reply (msg=0x775710) at forward.c:521
#6 0x00000000004529f9 in receive_msg (
buf=0x71f880 "SIP/2.0 200 OK\r\nVia: SIP/2.0/UDP
8.17.32.37;branch=z9hG4bKd89d.68915ca2.0\r\nVia: SIP/2.0/UDP
8.17.32.166:5060;received=8.17.32.166;branch=z9hG4bK0615b7d2;rport=5060\r\nFrom:
\"CID Info\" <sip:5551212"..., len=889, rcv_info=0x7fffc7c0c190) at
receive.c:212
#7 0x0000000000487da6 in udp_rcv_loop () at udp_server.c:449
#8 0x00000000004274e4 in main_loop () at main.c:774
#9 main (argc=<value optimized out>, argv=0x7fffc7c0c368) at main.c:1321
(gdb)
_______________________________________________
Kamailio (OpenSER) - Users mailing list
Users(a)lists.kamailio.org
http://lists.kamailio.org/cgi-bin/mailman/listinfo/users
http://lists.openser-project.org/cgi-bin/mailman/listinfo/users
--
Daniel-Constantin Mierla
http://www.asipto.com/
16 Jun
16 Jun
11:50 a.m.
I believe that we have discovered why kamailio was core dumping. We
received a 200 OK with SDP back from an upstream that had a mal
formatted Record-Route: header field.
Record-Route: <sip:8.17.32.37;lr=on;did=87e.7defc835>,SUBSCRIBE,NOTIFY
Each time we received one of these packets with the bad RR header,
openser-1.3.4, kamailio-1.5.1, and SVN kamailio from 6/12 each core
dumped at update_dialog_dbinfo. While I understand that the Record-
Route example is bad, and certainly doesn't conform to the RFC. Would
it be possible to do some kind of sanity check on the header and
handle the garbage data error more gracefully?
Thanks
Stagg
On Jun 11, 2009, at 12:59 PM, Daniel-Constantin Mierla wrote:
Hello,
there were some recent fixes to dialog, but after 1.5.1 was
released. you have to take the source from svn branch 1.5:
svn co https://openser.svn.sourceforge.net/svnroot/openser/branches/1.5
kamailio-1.5
Install it and try again. Should be fixed, if not, let me know.
Cheers,
Daniel
On 06/11/2009 06:33 PM, Stagg Shelton wrote:
I've recently tried to migrate my production
environment to
kamailio 1.5.1-notls from openser-1.3.4-notls. I have been working
through some issues, and the most recent issues have been that
kamailio has begun to segmentation fault and core dump. Has anyone
else experienced any similar issues, what other information could i
provide that can be helpful in diagnosing my troubles with 1.5.1.
I have had to fall back to 1.3.4 until i can get this sorted out.
Below is my backtrace of the core dump file.
Core was generated by `/sbin/kamailio -m 1024'.
Program terminated with signal 11, Segmentation fault.
[New process 5315]
#0 0x00007f57bb9954e0 in update_dialog_dbinfo
(cell=0x7f577e6a17c0) at dlg_db_handler.c:498
498 SET_STR_VALUE(values+8, cell-
--
Daniel-Constantin Mierla
http://www.asipto.com/
bind_addr[DLG_CALLEE_LEG]->sock_str);
Missing separate debuginfos, use: debuginfo-install bzip2-
libs-1.0.5-3.fc10.x86_64 compat-db45-4.5.20-5.fc10.x86_64 e2fsprogs-
libs-1.41.4-5.fc10.x86_64 elfutils-libelf-0.141-1.fc10.x86_64 file-
libs-4.26-5.fc10.x86_64 glibc-2.9-3.x86_64 keyutils-
libs-1.2-3.fc9.x86_64 krb5-libs-1.6.3-18.fc10.x86_64
libconfuse-2.6-1.fc9.x86_64 libgcc-4.3.2-7.x86_64
libselinux-2.0.78-1.fc10.x86_64 lm_sensors-3.0.2-1.fc10.x86_64
lua-5.1.4-1.fc10.x86_64 mysql-libs-5.0.77-1.fc10.x86_64 net-snmp-
libs-5.4.2.1-3.fc10.x86_64 nspr-devel-4.7.3-2.fc10.x86_64 nss-
devel-3.12.2.0-5.fc10.x86_64 openssl-0.9.8g-13.fc10.x86_64
pcre-7.8-1.fc10.x86_64 perl-libs-5.10.0-68.fc10.x86_64
popt-1.13-4.fc10.x86_64 radiusclient-ng-0.5.6-3.fc9.x86_64 rpm-
libs-4.6.0-2.fc10.x86_64 tcp_wrappers-libs-7.6-53.fc10.x86_64
zlib-1.2.3-18.fc9.x86_64
(gdb) bt
#0 0x00007f57bb9954e0 in update_dialog_dbinfo
(cell=0x7f577e6a17c0) at dlg_db_handler.c:498
#1 0x00007f57bb998b5e in dlg_onreply (t=0x7f577aaec3b8,
type=<value optimized out>, param=<value optimized out>) at
dlg_handlers.c:318
#2 0x00007f57bf59d345 in run_trans_callbacks (type=128,
trans=0x7f577e6a3918, req=0x7f577e6afce8, rpl=0x775710, code=200)
at t_hooks.c:240
#3 0x00007f57bf5ba352 in relay_reply (t=0x7f577e6a3918,
p_msg=<value optimized out>, branch=0, msg_status=200,
cancel_bitmap=0x7fffc7c0c098)
at t_reply.c:1229
#4 0x00007f57bf5badce in reply_received (p_msg=0x775710) at
t_reply.c:1485
#5 0x0000000000420382 in forward_reply (msg=0x775710) at forward.c:
521
#6 0x00000000004529f9 in receive_msg (
buf=0x71f880 "SIP/2.0 200 OK\r\nVia: SIP/2.0/UDP
8.17.32.37;branch=z9hG4bKd89d.68915ca2.0\r\nVia: SIP/2.0/UDP
8.17.32.166
:5060;received=8.17.32.166;branch=z9hG4bK0615b7d2;rport=5060\r
\nFrom: \"CID Info\" <sip:5551212"..., len=889,
rcv_info=0x7fffc7c0c190) at receive.c:212
#7 0x0000000000487da6 in udp_rcv_loop () at udp_server.c:449
#8 0x00000000004274e4 in main_loop () at main.c:774
#9 main (argc=<value optimized out>, argv=0x7fffc7c0c368) at
main.c:1321
(gdb)
_______________________________________________
Kamailio (OpenSER) - Users mailing list
Users(a)lists.kamailio.org
http://lists.kamailio.org/cgi-bin/mailman/listinfo/users
http://lists.openser-project.org/cgi-bin/mailman/listinfo/users
17 Jun
17 Jun
5:27 a.m.
Hello Stagg,
On 06/16/2009 05:50 PM, Stagg Shelton wrote:
I believe that we have discovered why kamailio was
core dumping. We
received a 200 OK with SDP back from an upstream that had a mal
formatted Record-Route: header field.
Record-Route: <sip:8.17.32.37;lr=on;did=87e.7defc835>,SUBSCRIBE,NOTIFY
Each time we received one of these packets with the bad RR header,
openser-1.3.4, kamailio-1.5.1, and SVN kamailio from 6/12 each core
dumped at update_dialog_dbinfo. While I understand that the
Record-Route example is bad, and certainly doesn't conform to the
RFC. Would it be possible to do some kind of sanity check on the
header and handle the garbage data error more gracefully?
this has to be definitely
fixed if still applies -- thanks for
troubleshooting. Can you get the latest version of 1.5 branch and test.
There were some sanity checks added to dialog module that might solve
this one as well.
Cheers,
Daniel
Thanks
Stagg
On Jun 11, 2009, at 12:59 PM, Daniel-Constantin Mierla wrote:
--
Daniel-Constantin Mierla
http://www.asipto.com/
Hello,
there were some recent fixes to dialog, but after 1.5.1 was released.
you have to take the source from svn branch 1.5:
svn co
https://openser.svn.sourceforge.net/svnroot/openser/branches/1.5 kamailio-1.5
Install it and try again. Should be fixed, if not, let me know.
Cheers,
Daniel
On 06/11/2009 06:33 PM, Stagg Shelton wrote:
I've recently tried to migrate my production
environment to kamailio
1.5.1-notls from openser-1.3.4-notls. I have been working through
some issues, and the most recent issues have been that kamailio has
begun to segmentation fault and core dump. Has anyone else
experienced any similar issues, what other information could i
provide that can be helpful in diagnosing my troubles with 1.5.1. I
have had to fall back to 1.3.4 until i can get this sorted out.
Below is my backtrace of the core dump file.
Core was generated by `/sbin/kamailio -m 1024'.
Program terminated with signal 11, Segmentation fault.
[New process 5315]
#0 0x00007f57bb9954e0 in update_dialog_dbinfo (cell=0x7f577e6a17c0)
at dlg_db_handler.c:498
498 SET_STR_VALUE(values+8,
cell->bind_addr[DLG_CALLEE_LEG]->sock_str);
Missing separate debuginfos, use: debuginfo-install
bzip2-libs-1.0.5-3.fc10.x86_64 compat-db45-4.5.20-5.fc10.x86_64
e2fsprogs-libs-1.41.4-5.fc10.x86_64
elfutils-libelf-0.141-1.fc10.x86_64 file-libs-4.26-5.fc10.x86_64
glibc-2.9-3.x86_64 keyutils-libs-1.2-3.fc9.x86_64
krb5-libs-1.6.3-18.fc10.x86_64 libconfuse-2.6-1.fc9.x86_64
libgcc-4.3.2-7.x86_64 libselinux-2.0.78-1.fc10.x86_64
lm_sensors-3.0.2-1.fc10.x86_64 lua-5.1.4-1.fc10.x86_64
mysql-libs-5.0.77-1.fc10.x86_64 net-snmp-libs-5.4.2.1-3.fc10.x86_64
nspr-devel-4.7.3-2.fc10.x86_64 nss-devel-3.12.2.0-5.fc10.x86_64
openssl-0.9.8g-13.fc10.x86_64 pcre-7.8-1.fc10.x86_64
perl-libs-5.10.0-68.fc10.x86_64 popt-1.13-4.fc10.x86_64
radiusclient-ng-0.5.6-3.fc9.x86_64 rpm-libs-4.6.0-2.fc10.x86_64
tcp_wrappers-libs-7.6-53.fc10.x86_64 zlib-1.2.3-18.fc9.x86_64
(gdb) bt
#0 0x00007f57bb9954e0 in update_dialog_dbinfo (cell=0x7f577e6a17c0)
at dlg_db_handler.c:498
#1 0x00007f57bb998b5e in dlg_onreply (t=0x7f577aaec3b8, type=<value
optimized out>, param=<value optimized out>) at dlg_handlers.c:318
#2 0x00007f57bf59d345 in run_trans_callbacks (type=128,
trans=0x7f577e6a3918, req=0x7f577e6afce8, rpl=0x775710, code=200) at
t_hooks.c:240
#3 0x00007f57bf5ba352 in relay_reply (t=0x7f577e6a3918,
p_msg=<value optimized out>, branch=0, msg_status=200,
cancel_bitmap=0x7fffc7c0c098)
at t_reply.c:1229
#4 0x00007f57bf5badce in reply_received (p_msg=0x775710) at
t_reply.c:1485
#5 0x0000000000420382 in forward_reply (msg=0x775710) at forward.c:521
#6 0x00000000004529f9 in receive_msg (
buf=0x71f880 "SIP/2.0 200 OK\r\nVia: SIP/2.0/UDP
8.17.32.37;branch=z9hG4bKd89d.68915ca2.0\r\nVia: SIP/2.0/UDP
8.17.32.166:5060;received=8.17.32.166;branch=z9hG4bK0615b7d2;rport=5060\r\nFrom:
\"CID Info\" <sip:5551212"..., len=889, rcv_info=0x7fffc7c0c190) at
receive.c:212
#7 0x0000000000487da6 in udp_rcv_loop () at udp_server.c:449
#8 0x00000000004274e4 in main_loop () at main.c:774
#9 main (argc=<value optimized out>, argv=0x7fffc7c0c368) at
main.c:1321
(gdb)
_______________________________________________
Kamailio (OpenSER) - Users mailing list
Users(a)lists.kamailio.org
http://lists.kamailio.org/cgi-bin/mailman/listinfo/users
http://lists.openser-project.org/cgi-bin/mailman/listinfo/users
--
Daniel-Constantin Mierla
http://www.asipto.com/
5700
days inactive
5706
days old
3 comments
2 participants
participants (2)
-
Daniel-Constantin Mierla -
Stagg Shelton