sr-dev May 2023

sr-dev@lists.kamailio.org

16 participants
324 discussions

[kamailio/kamailio] Dead Lock running on RockyLinux 8.7 on AWS virtual machine (Issue #3438)
by Antonio Couto 08 May '23

08 May '23

### Description I have a script that using dispatcher to 4 destination Asterisk machines, the system have maximum 300 calls, I am using RockyLinux 8.7 on AWS VM, the machine is very powerfull. I am using rtpengine with no trancoding, the works fine per hours but from nowhere Kamailio enter a somekind dead lock state, do not process SIP traffic anymore, I need to restart Kamailio in this case. ### Troubleshooting I removed all thing that i do not need right now, link cdr and dialog modules, but no effect. This the first time in years using Kamailio thats happening to me, sorry if I not send the apropriated information. #### Reproduction The problem happens only on AWS virtual machine, I can´t reproduce on my RockyLinux VM using Virtual Box. The system is on production and I have hard time now... #### Debugging Data trace of the moment of dead lock { "jsonrpc": "2.0", "result": [ { "IDX": 0, "PID": 38052, "DSC": "main process - attendant" }, { "IDX": 1, "PID": 38056, "DSC": "udp receiver child=0 sock=172.28.31.52:5060" }, { "IDX": 2, "PID": 38057, "DSC": "udp receiver child=1 sock=172.28.31.52:5060" }, { "IDX": 3, "PID": 38058, "DSC": "udp receiver child=2 sock=172.28.31.52:5060" }, { "IDX": 4, "PID": 38059, "DSC": "udp receiver child=3 sock=172.28.31.52:5060" }, { "IDX": 5, "PID": 38060, "DSC": "udp receiver child=4 sock=172.28.31.52:5060" }, { "IDX": 6, "PID": 38061, "DSC": "udp receiver child=5 sock=172.28.31.52:5060" }, { "IDX": 7, "PID": 38062, "DSC": "udp receiver child=6 sock=172.28.31.52:5060" }, { "IDX": 8, "PID": 38063, "DSC": "udp receiver child=7 sock=172.28.31.52:5060" }, { "IDX": 9, "PID": 38064, "DSC": "slow timer" }, { "IDX": 10, "PID": 38065, "DSC": "timer" }, { "IDX": 11, "PID": 38066, "DSC": "secondary timer" }, { "IDX": 12, "PID": 38067, "DSC": "JSONRPCS FIFO" }, { "IDX": 13, "PID": 38068, "DSC": "JSONRPCS DATAGRAM" }, { "IDX": 14, "PID": 38069, "DSC": "USRLOC Timer" }, { "IDX": 15, "PID": 38070, "DSC": "ctl handler" }, { "IDX": 16, "PID": 38071, "DSC": "RTIMER EXEC child=0 timer=timer_caps" }, { "IDX": 17, "PID": 38072, "DSC": "TIMER NH" }, { "IDX": 18, "PID": 38073, "DSC": "tcp receiver (generic) child=0" }, { "IDX": 19, "PID": 38074, "DSC": "tcp main process" } ], "id": 54180 } ---start 38052 ----------------------------------------------------- [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". 0x00007fde68852315 in pause () from /lib64/libpthread.so.0 #0 0x00007fde68852315 in pause () from /lib64/libpthread.so.0 No symbol table info available. #1 0x000000000042fbb2 in main_loop () No symbol table info available. #2 0x0000000000438d14 in main () No symbol table info available. [Inferior 1 (process 38052) detached] ---end 38052 ------------------------------------------------------- ---start 38056 ----------------------------------------------------- [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". 0x00007fde68851da8 in recvfrom () from /lib64/libpthread.so.0 #0 0x00007fde68851da8 in recvfrom () from /lib64/libpthread.so.0 No symbol table info available. #1 0x000000000052a25f in udp_rcv_loop () No symbol table info available. #2 0x000000000042cb4b in main_loop () No symbol table info available. #3 0x0000000000438d14 in main () No symbol table info available. [Inferior 1 (process 38056) detached] ---end 38056 ------------------------------------------------------- ---start 38057 ----------------------------------------------------- [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". 0x00007fde68851da8 in recvfrom () from /lib64/libpthread.so.0 #0 0x00007fde68851da8 in recvfrom () from /lib64/libpthread.so.0 No symbol table info available. #1 0x000000000052a25f in udp_rcv_loop () No symbol table info available. #2 0x000000000042cb4b in main_loop () No symbol table info available. #3 0x0000000000438d14 in main () No symbol table info available. [Inferior 1 (process 38057) detached] ---end 38057 ------------------------------------------------------- ---start 38058 ----------------------------------------------------- [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". 0x00007fde68851da8 in recvfrom () from /lib64/libpthread.so.0 #0 0x00007fde68851da8 in recvfrom () from /lib64/libpthread.so.0 No symbol table info available. #1 0x000000000052a25f in udp_rcv_loop () No symbol table info available. #2 0x000000000042cb4b in main_loop () No symbol table info available. #3 0x0000000000438d14 in main () No symbol table info available. [Inferior 1 (process 38058) detached] ---end 38058 ------------------------------------------------------- ---start 38059 ----------------------------------------------------- [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". 0x00007fde68851da8 in recvfrom () from /lib64/libpthread.so.0 #0 0x00007fde68851da8 in recvfrom () from /lib64/libpthread.so.0 No symbol table info available. #1 0x000000000052a25f in udp_rcv_loop () No symbol table info available. #2 0x000000000042cb4b in main_loop () No symbol table info available. #3 0x0000000000438d14 in main () No symbol table info available. [Inferior 1 (process 38059) detached] ---end 38059 ------------------------------------------------------- ---start 38060 ----------------------------------------------------- [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". 0x00007fde68851da8 in recvfrom () from /lib64/libpthread.so.0 #0 0x00007fde68851da8 in recvfrom () from /lib64/libpthread.so.0 No symbol table info available. #1 0x000000000052a25f in udp_rcv_loop () No symbol table info available. #2 0x000000000042cb4b in main_loop () No symbol table info available. #3 0x0000000000438d14 in main () No symbol table info available. [Inferior 1 (process 38060) detached] ---end 38060 ------------------------------------------------------- ---start 38061 ----------------------------------------------------- [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". 0x00007fde68851da8 in recvfrom () from /lib64/libpthread.so.0 #0 0x00007fde68851da8 in recvfrom () from /lib64/libpthread.so.0 No symbol table info available. #1 0x000000000052a25f in udp_rcv_loop () No symbol table info available. #2 0x000000000042cb4b in main_loop () No symbol table info available. #3 0x0000000000438d14 in main () No symbol table info available. [Inferior 1 (process 38061) detached] ---end 38061 ------------------------------------------------------- ---start 38062 ----------------------------------------------------- [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". 0x00007fde68851da8 in recvfrom () from /lib64/libpthread.so.0 #0 0x00007fde68851da8 in recvfrom () from /lib64/libpthread.so.0 No symbol table info available. #1 0x000000000052a25f in udp_rcv_loop () No symbol table info available. #2 0x000000000042cb4b in main_loop () No symbol table info available. #3 0x0000000000438d14 in main () No symbol table info available. [Inferior 1 (process 38062) detached] ---end 38062 ------------------------------------------------------- ---start 38063 ----------------------------------------------------- [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". 0x00007fde68851da8 in recvfrom () from /lib64/libpthread.so.0 #0 0x00007fde68851da8 in recvfrom () from /lib64/libpthread.so.0 No symbol table info available. #1 0x000000000052a25f in udp_rcv_loop () No symbol table info available. #2 0x000000000042cb4b in main_loop () No symbol table info available. #3 0x0000000000438d14 in main () No symbol table info available. [Inferior 1 (process 38063) detached] ---end 38063 ------------------------------------------------------- ---start 38064 ----------------------------------------------------- [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". 0x00007fde684c986f in sigtimedwait () from /lib64/libc.so.6 #0 0x00007fde684c986f in sigtimedwait () from /lib64/libc.so.6 No symbol table info available. #1 0x000000000055b7a6 in slow_timer_main () No symbol table info available. #2 0x000000000042e3e1 in main_loop () No symbol table info available. #3 0x0000000000438d14 in main () No symbol table info available. [Inferior 1 (process 38064) detached] ---end 38064 ------------------------------------------------------- ---start 38065 ----------------------------------------------------- [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". 0x00007fde68852315 in pause () from /lib64/libpthread.so.0 #0 0x00007fde68852315 in pause () from /lib64/libpthread.so.0 No symbol table info available. #1 0x000000000055b07c in timer_main () No symbol table info available. #2 0x000000000042e74e in main_loop () No symbol table info available. #3 0x0000000000438d14 in main () No symbol table info available. [Inferior 1 (process 38065) detached] ---end 38065 ------------------------------------------------------- ---start 38066 ----------------------------------------------------- [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". 0x00007fde685a17db in select () from /lib64/libc.so.6 #0 0x00007fde685a17db in select () from /lib64/libc.so.6 No symbol table info available. #1 0x000000000069ce04 in sleep_us () No symbol table info available. #2 0x000000000069d30d in fork_sync_timer () No symbol table info available. #3 0x000000000069e64d in sr_wtimer_start () No symbol table info available. #4 0x000000000042e753 in main_loop () No symbol table info available. #5 0x0000000000438d14 in main () No symbol table info available. [Inferior 1 (process 38066) detached] ---end 38066 ------------------------------------------------------- ---start 38067 ----------------------------------------------------- [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". 0x00007fde6859ab25 in read () from /lib64/libc.so.6 #0 0x00007fde6859ab25 in read () from /lib64/libc.so.6 No symbol table info available. #1 0x00007fde6850dfc8 in __GI__IO_file_underflow () from /lib64/libc.so.6 No symbol table info available. #2 0x00007fde6850d0d8 in __GI__IO_file_xsgetn () from /lib64/libc.so.6 No symbol table info available. #3 0x00007fde685020db in fread () from /lib64/libc.so.6 No symbol table info available. #4 0x00007fde629ec512 in jsonrpc_read_stream () from /usr/lib64/kamailio/modules/jsonrpcs.so No symbol table info available. #5 0x00007fde629f06c1 in jsonrpc_fifo_server () from /usr/lib64/kamailio/modules/jsonrpcs.so No symbol table info available. #6 0x00007fde629f256c in jsonrpc_fifo_process () from /usr/lib64/kamailio/modules/jsonrpcs.so No symbol table info available. #7 0x00007fde629f3bd7 in jsonrpc_fifo_child_init () from /usr/lib64/kamailio/modules/jsonrpcs.so No symbol table info available. #8 0x00007fde62a11d3f in child_init () from /usr/lib64/kamailio/modules/jsonrpcs.so No symbol table info available. #9 0x00000000006085d5 in init_mod_child () No symbol table info available. #10 0x000000000060822a in init_mod_child () No symbol table info available. #11 0x000000000060822a in init_mod_child () No symbol table info available. #12 0x000000000060822a in init_mod_child () No symbol table info available. #13 0x000000000060822a in init_mod_child () No symbol table info available. #14 0x000000000060822a in init_mod_child () No symbol table info available. #15 0x000000000060822a in init_mod_child () No symbol table info available. #16 0x000000000060822a in init_mod_child () No symbol table info available. #17 0x000000000060822a in init_mod_child () No symbol table info available. #18 0x000000000060822a in init_mod_child () No symbol table info available. #19 0x000000000060822a in init_mod_child () No symbol table info available. #20 0x000000000060822a in init_mod_child () No symbol table info available. #21 0x000000000060822a in init_mod_child () No symbol table info available. #22 0x000000000060822a in init_mod_child () No symbol table info available. #23 0x000000000060822a in init_mod_child () No symbol table info available. #24 0x000000000060822a in init_mod_child () No symbol table info available. #25 0x000000000060822a in init_mod_child () No symbol table info available. #26 0x000000000060822a in init_mod_child () No symbol table info available. #27 0x000000000060822a in init_mod_child () No symbol table info available. #28 0x000000000060822a in init_mod_child () No symbol table info available. #29 0x000000000060822a in init_mod_child () No symbol table info available. #30 0x000000000060822a in init_mod_child () No symbol table info available. #31 0x000000000060822a in init_mod_child () No symbol table info available. #32 0x000000000060822a in init_mod_child () No symbol table info available. #33 0x000000000060822a in init_mod_child () No symbol table info available. #34 0x000000000060822a in init_mod_child () No symbol table info available. #35 0x000000000060822a in init_mod_child () No symbol table info available. #36 0x000000000060822a in init_mod_child () No symbol table info available. #37 0x0000000000608de7 in init_child () No symbol table info available. #38 0x000000000042ea6c in main_loop () No symbol table info available. #39 0x0000000000438d14 in main () No symbol table info available. [Inferior 1 (process 38067) detached] ---end 38067 ------------------------------------------------------- ---start 38068 ----------------------------------------------------- [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". 0x00007fde685a17db in select () from /lib64/libc.so.6 #0 0x00007fde685a17db in select () from /lib64/libc.so.6 No symbol table info available. #1 0x00007fde62a01472 in jsonrpc_dgram_server () from /usr/lib64/kamailio/modules/jsonrpcs.so No symbol table info available. #2 0x00007fde629ffaea in jsonrpc_dgram_process () from /usr/lib64/kamailio/modules/jsonrpcs.so No symbol table info available. #3 0x00007fde629ffb6d in jsonrpc_dgram_child_init () from /usr/lib64/kamailio/modules/jsonrpcs.so No symbol table info available. #4 0x00007fde62a120b8 in child_init () from /usr/lib64/kamailio/modules/jsonrpcs.so No symbol table info available. #5 0x00000000006085d5 in init_mod_child () No symbol table info available. #6 0x000000000060822a in init_mod_child () No symbol table info available. #7 0x000000000060822a in init_mod_child () No symbol table info available. #8 0x000000000060822a in init_mod_child () No symbol table info available. #9 0x000000000060822a in init_mod_child () No symbol table info available. #10 0x000000000060822a in init_mod_child () No symbol table info available. #11 0x000000000060822a in init_mod_child () No symbol table info available. #12 0x000000000060822a in init_mod_child () No symbol table info available. #13 0x000000000060822a in init_mod_child () No symbol table info available. #14 0x000000000060822a in init_mod_child () No symbol table info available. #15 0x000000000060822a in init_mod_child () No symbol table info available. #16 0x000000000060822a in init_mod_child () No symbol table info available. #17 0x000000000060822a in init_mod_child () No symbol table info available. #18 0x000000000060822a in init_mod_child () No symbol table info available. #19 0x000000000060822a in init_mod_child () No symbol table info available. #20 0x000000000060822a in init_mod_child () No symbol table info available. #21 0x000000000060822a in init_mod_child () No symbol table info available. #22 0x000000000060822a in init_mod_child () No symbol table info available. #23 0x000000000060822a in init_mod_child () No symbol table info available. #24 0x000000000060822a in init_mod_child () No symbol table info available. #25 0x000000000060822a in init_mod_child () No symbol table info available. #26 0x000000000060822a in init_mod_child () No symbol table info available. #27 0x000000000060822a in init_mod_child () No symbol table info available. #28 0x000000000060822a in init_mod_child () No symbol table info available. #29 0x000000000060822a in init_mod_child () No symbol table info available. #30 0x000000000060822a in init_mod_child () No symbol table info available. #31 0x000000000060822a in init_mod_child () No symbol table info available. #32 0x000000000060822a in init_mod_child () No symbol table info available. #33 0x0000000000608de7 in init_child () No symbol table info available. #34 0x000000000042ea6c in main_loop () No symbol table info available. #35 0x0000000000438d14 in main () No symbol table info available. [Inferior 1 (process 38068) detached] ---end 38068 ------------------------------------------------------- ---start 38069 ----------------------------------------------------- [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". 0x00007fde685a17db in select () from /lib64/libc.so.6 #0 0x00007fde685a17db in select () from /lib64/libc.so.6 No symbol table info available. #1 0x000000000069ce04 in sleep_us () No symbol table info available. #2 0x000000000069d30d in fork_sync_timer () No symbol table info available. #3 0x00007fde61049eee in child_init () from /usr/lib64/kamailio/modules/usrloc.so No symbol table info available. #4 0x00000000006085d5 in init_mod_child () No symbol table info available. #5 0x000000000060822a in init_mod_child () No symbol table info available. #6 0x000000000060822a in init_mod_child () No symbol table info available. #7 0x000000000060822a in init_mod_child () No symbol table info available. #8 0x000000000060822a in init_mod_child () No symbol table info available. #9 0x000000000060822a in init_mod_child () No symbol table info available. #10 0x000000000060822a in init_mod_child () No symbol table info available. #11 0x000000000060822a in init_mod_child () No symbol table info available. #12 0x000000000060822a in init_mod_child () No symbol table info available. #13 0x000000000060822a in init_mod_child () No symbol table info available. #14 0x000000000060822a in init_mod_child () No symbol table info available. #15 0x000000000060822a in init_mod_child () No symbol table info available. #16 0x000000000060822a in init_mod_child () No symbol table info available. #17 0x000000000060822a in init_mod_child () No symbol table info available. #18 0x000000000060822a in init_mod_child () No symbol table info available. #19 0x000000000060822a in init_mod_child () No symbol table info available. #20 0x000000000060822a in init_mod_child () No symbol table info available. #21 0x000000000060822a in init_mod_child () No symbol table info available. #22 0x0000000000608de7 in init_child () No symbol table info available. #23 0x000000000042ea6c in main_loop () No symbol table info available. #24 0x0000000000438d14 in main () No symbol table info available. [Inferior 1 (process 38069) detached] ---end 38069 ------------------------------------------------------- ---start 38070 ----------------------------------------------------- [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". 0x00007fde685a9feb in epoll_wait () from /lib64/libc.so.6 #0 0x00007fde685a9feb in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x00007fde5fe2a38b in io_wait_loop_epoll () from /usr/lib64/kamailio/modules/ctl.so No symbol table info available. #2 0x00007fde5fe2ee60 in io_listen_loop () from /usr/lib64/kamailio/modules/ctl.so No symbol table info available. #3 0x00007fde5fe4e90e in mod_child () from /usr/lib64/kamailio/modules/ctl.so No symbol table info available. #4 0x00000000006085d5 in init_mod_child () No symbol table info available. #5 0x000000000060822a in init_mod_child () No symbol table info available. #6 0x000000000060822a in init_mod_child () No symbol table info available. #7 0x000000000060822a in init_mod_child () No symbol table info available. #8 0x000000000060822a in init_mod_child () No symbol table info available. #9 0x000000000060822a in init_mod_child () No symbol table info available. #10 0x000000000060822a in init_mod_child () No symbol table info available. #11 0x000000000060822a in init_mod_child () No symbol table info available. #12 0x000000000060822a in init_mod_child () No symbol table info available. #13 0x000000000060822a in init_mod_child () No symbol table info available. #14 0x000000000060822a in init_mod_child () No symbol table info available. #15 0x0000000000608de7 in init_child () No symbol table info available. #16 0x000000000042ea6c in main_loop () No symbol table info available. #17 0x0000000000438d14 in main () No symbol table info available. [Inferior 1 (process 38070) detached] ---end 38070 ------------------------------------------------------- ---start 38071 ----------------------------------------------------- [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". 0x00007fde68574988 in nanosleep () from /lib64/libc.so.6 #0 0x00007fde68574988 in nanosleep () from /lib64/libc.so.6 No symbol table info available. #1 0x00007fde685748be in sleep () from /lib64/libc.so.6 No symbol table info available. #2 0x000000000069cf5a in fork_basic_timer_w () No symbol table info available. #3 0x00007fde5f58d1e1 in child_init () from /usr/lib64/kamailio/modules/rtimer.so No symbol table info available. #4 0x00000000006085d5 in init_mod_child () No symbol table info available. #5 0x000000000060822a in init_mod_child () No symbol table info available. #6 0x000000000060822a in init_mod_child () No symbol table info available. #7 0x000000000060822a in init_mod_child () No symbol table info available. #8 0x000000000060822a in init_mod_child () No symbol table info available. #9 0x000000000060822a in init_mod_child () No symbol table info available. #10 0x000000000060822a in init_mod_child () No symbol table info available. #11 0x0000000000608de7 in init_child () No symbol table info available. #12 0x000000000042ea6c in main_loop () No symbol table info available. #13 0x0000000000438d14 in main () No symbol table info available. [Inferior 1 (process 38071) detached] ---end 38071 ------------------------------------------------------- ---start 38072 ----------------------------------------------------- [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". 0x00007fde68574988 in nanosleep () from /lib64/libc.so.6 #0 0x00007fde68574988 in nanosleep () from /lib64/libc.so.6 No symbol table info available. #1 0x00007fde685748be in sleep () from /lib64/libc.so.6 No symbol table info available. #2 0x000000000069ce9a in fork_basic_timer () No symbol table info available. #3 0x00007fde5e80b672 in child_init () from /usr/lib64/kamailio/modules/nathelper.so No symbol table info available. #4 0x00000000006085d5 in init_mod_child () No symbol table info available. #5 0x000000000060822a in init_mod_child () No symbol table info available. #6 0x0000000000608de7 in init_child () No symbol table info available. #7 0x000000000042ea6c in main_loop () No symbol table info available. #8 0x0000000000438d14 in main () No symbol table info available. [Inferior 1 (process 38072) detached] ---end 38072 ------------------------------------------------------- ---start 38073 ----------------------------------------------------- [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". 0x00007fde685a9feb in epoll_wait () from /lib64/libc.so.6 #0 0x00007fde685a9feb in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x0000000000441419 in io_wait_loop_epoll () No symbol table info available. #2 0x0000000000456b20 in tcp_receive_loop () No symbol table info available. #3 0x00000000005b026b in tcp_init_children () No symbol table info available. #4 0x000000000042ed98 in main_loop () No symbol table info available. #5 0x0000000000438d14 in main () No symbol table info available. [Inferior 1 (process 38073) detached] ---end 38073 ------------------------------------------------------- ---start 38074 ----------------------------------------------------- [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". 0x00007fde685a9feb in epoll_wait () from /lib64/libc.so.6 #0 0x00007fde685a9feb in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x000000000056efc4 in io_wait_loop_epoll () No symbol table info available. #2 0x00000000005ab8e5 in tcp_main_loop () No symbol table info available. #3 0x000000000042f11a in main_loop () No symbol table info available. #4 0x0000000000438d14 in main () No symbol table info available. [Inferior 1 (process 38074) detached] ---end 38074 ------------------------------------------------------- Kamailio log ======== The importante thing here is that all dispatcher destination are offline, but there is no such thing, because the network was fine in the moment, i suspect the Kamailio process that waiting for SIP OPTIONS reply just log the erro because i have a callback for this type of situation on my script. Sorry the log in the moment of problem is too low. Line 11371: May 5 06:00:02 ip-172-28-31-52 systemd[1]: Started Kamailio - the Open Source SIP Server. Line 11373: May 5 06:00:02 ip-172-28-31-52 kamailio[38052]: INFO: rtimer [rtimer_mod.c:313]: stm_t_param(): created rtimer name=timer_caps interval=1 mode=1 Line 11374: May 5 06:00:02 ip-172-28-31-52 kamailio[38052]: INFO: <core> [core/tcp_main.c:5073]: init_tcp(): using epoll_lt as the io watch method (auto detected) Line 11375: May 5 06:00:02 ip-172-28-31-52 kamailio[38052]: Listening on Line 11376: May 5 06:00:02 ip-172-28-31-52 kamailio[38052]: udp: 172.28.31.52:5060 Line 11377: May 5 06:00:02 ip-172-28-31-52 kamailio[38052]: tcp: 172.28.31.52:8181 Line 11378: May 5 06:00:02 ip-172-28-31-52 kamailio[38052]: Aliases: Line 11379: May 5 06:00:02 ip-172-28-31-52 kamailio[38052]: tcp: ip-172-28-31-52.sa-east-1.compute.internal:8181 Line 11380: May 5 06:00:02 ip-172-28-31-52 kamailio[38052]: udp: ip-172-28-31-52.sa-east-1.compute.internal:5060 Line 11381: May 5 06:00:02 ip-172-28-31-52 /usr/sbin/kamailio[38052]: INFO: rr [../outbound/api.h:52]: ob_load_api(): unable to import bind_ob - maybe module is not loaded Line 11382: May 5 06:00:02 ip-172-28-31-52 /usr/sbin/kamailio[38052]: INFO: rr [rr_mod.c:188]: mod_init(): outbound module not available Line 11383: May 5 06:00:02 ip-172-28-31-52 /usr/sbin/kamailio[38052]: INFO: db_text [dbt_lib.c:146]: dbt_cache_get_db(): using database at: /etc/kamailio/sipproxy Line 11383: May 5 06:00:02 ip-172-28-31-52 /usr/sbin/kamailio[38052]: INFO: db_text [dbt_lib.c:146]: dbt_cache_get_db(): using database at: /etc/kamailio/sipproxy Line 11384: May 5 06:00:02 ip-172-28-31-52 /usr/sbin/kamailio[38052]: INFO: <core> [main.c:3055]: main(): processes (at least): 20 - shm size: 1073741824 - pkg size: 67108864 Line 11385: May 5 06:00:02 ip-172-28-31-52 /usr/sbin/kamailio[38052]: INFO: <core> [core/udp_server.c:154]: probe_max_receive_buffer(): SO_RCVBUF is initially 212992 for fd 9 Line 11386: May 5 06:00:02 ip-172-28-31-52 /usr/sbin/kamailio[38052]: INFO: <core> [core/udp_server.c:207]: probe_max_receive_buffer(): SO_RCVBUF is finally 425984 on fd 9 Line 11387: May 5 06:00:02 ip-172-28-31-52 /usr/sbin/kamailio[38056]: INFO: rtpengine [rtpengine.c:2929]: rtpp_test(): rtpengine instance <udp:127.0.0.1:2223> found, support for it enabled Line 11388: May 5 06:00:02 ip-172-28-31-52 /usr/sbin/kamailio[38068]: INFO: jsonrpcs [jsonrpcs_sock.c:443]: jsonrpc_dgram_process(): a new child 0/38068 Line 11389: May 5 06:00:02 ip-172-28-31-52 /usr/sbin/kamailio[38070]: INFO: ctl [io_listener.c:214]: io_listen_loop(): io_listen_loop: using epoll_lt io watch method (config) Line 11460: May 5 06:08:41 ip-172-28-31-52 /usr/sbin/kamailio[38060]: INFO: {1 12348 CANCEL c5188ed9-d22d-49b6-8bfb-26155ac739aa} tm [t_reply.c:486]: _reply_light(): can't generate 487 reply when a final 200 was sent out Line 11506: May 5 06:12:32 ip-172-28-31-52 dnf[38761]: Kamailio - x86_64 359 kB/s | 2.9 kB 00:00 Line 13191: May 5 08:40:45 ip-172-28-31-52 /usr/sbin/kamailio[38056]: ERROR: {2 26558 INVITE a35326f0-40a9-4d4b-abff-76ffcd526e77} rtpengine [rtpengine.c:2767]: rtpp_function_call(): proxy replied with error: Unknown call-id Line 16923: May 5 10:40:20 ip-172-28-31-52 /usr/sbin/kamailio[38064]: ERROR: <script>: Destination down: OPTIONS sip:172.28.31.143:5060;transport=udp Line 16924: May 5 10:40:20 ip-172-28-31-52 /usr/sbin/kamailio[38064]: ERROR: <script>: Destination down: OPTIONS sip:172.28.31.142:5060;transport=udp Line 16925: May 5 10:40:20 ip-172-28-31-52 /usr/sbin/kamailio[38064]: ERROR: <script>: Destination down: OPTIONS sip:172.28.31.141:5060;transport=udp Line 16926: May 5 10:40:20 ip-172-28-31-52 /usr/sbin/kamailio[38064]: ERROR: <script>: Destination down: OPTIONS sip:172.28.31.140:5060;transport=udp Line 16979: May 5 10:42:48 ip-172-28-31-52 /usr/sbin/kamailio[38065]: ERROR: {1 282370177 INVITE )1eV6483910050tybeGhEfDrDgD0g(a)BC00.ZRJO08.TIM} <script>: there are no routes Line 17064: May 5 10:49:43 ip-172-28-31-52 dnf[53925]: Kamailio - x86_64 310 kB/s | 2.9 kB 00:00 Line 17111: May 5 10:53:32 ip-172-28-31-52 /usr/sbin/kamailio[38056]: INFO: {2 10 OPTIONS 5b065ede75adeb22-38066(a)172.28.31.52} <script>: Destination up: OPTIONS sip:172.28.31.143:5060;transport=udp Line 17112: May 5 10:53:32 ip-172-28-31-52 /usr/sbin/kamailio[38060]: INFO: {2 10 OPTIONS 5b065ede75adeb24-38066(a)172.28.31.52} <script>: Destination up: OPTIONS sip:172.28.31.141:5060;transport=udp Line 17113: May 5 10:53:32 ip-172-28-31-52 /usr/sbin/kamailio[38058]: INFO: {2 10 OPTIONS 5b065ede75adeb23-38066(a)172.28.31.52} <script>: Destination up: OPTIONS sip:172.28.31.142:5060;transport=udp Line 17114: May 5 10:53:32 ip-172-28-31-52 /usr/sbin/kamailio[38057]: INFO: {2 10 OPTIONS 5b065ede75adeb25-38066(a)172.28.31.52} <script>: Destination up: OPTIONS sip:172.28.31.140:5060;transport=udp Line 17115: May 5 10:53:32 ip-172-28-31-52 /usr/sbin/kamailio[38056]: ERROR: {1 16583 INVITE b61320ad-4588-4fcc-8548-c082d2afd12b} rtpengine [rtpengine.c:3070]: send_rtpp_command(): can't send command "offer" to RTPEngine <udp:127.0.0.1:2223> Line 17116: May 5 10:53:32 ip-172-28-31-52 /usr/sbin/kamailio[38056]: ERROR: {1 16583 INVITE b61320ad-4588-4fcc-8548-c082d2afd12b} rtpengine [rtpengine.c:3353]: select_rtpp_node(): rtpengine node for callid=b61320ad-4588-4fcc-8548-c082d2afd12b is known (udp:127.0.0.1:2223) but it has already been queried, therefore not returning it Line 17117: May 5 10:53:32 ip-172-28-31-52 /usr/sbin/kamailio[38056]: ERROR: {1 16583 INVITE b61320ad-4588-4fcc-8548-c082d2afd12b} rtpengine [rtpengine.c:2706]: rtpp_function_call(): no available proxies Line 17118: May 5 10:53:32 ip-172-28-31-52 /usr/sbin/kamailio[38059]: ERROR: {1 16583 INVITE b61320ad-4588-4fcc-8548-c082d2afd12b} rtpengine [rtpengine.c:2706]: rtpp_function_call(): no available proxies Line 17119: May 5 10:53:32 ip-172-28-31-52 /usr/sbin/kamailio[38058]: ERROR: {1 9086 INVITE 25d5140d-b097-4577-9ccb-709818eed73a} rtpengine [rtpengine.c:2706]: rtpp_function_call(): no available proxies Line 17120: May 5 10:53:32 ip-172-28-31-52 /usr/sbin/kamailio[38061]: ERROR: {1 9086 INVITE 25d5140d-b097-4577-9ccb-709818eed73a} rtpengine [rtpengine.c:2706]: rtpp_function_call(): no available proxies Line 17121: May 5 10:53:32 ip-172-28-31-52 /usr/sbin/kamailio[38057]: ERROR: {1 16584 BYE b61320ad-4588-4fcc-8548-c082d2afd12b} rtpengine [rtpengine.c:2706]: rtpp_function_call(): no available proxies Line 17122: May 5 10:53:32 ip-172-28-31-52 /usr/sbin/kamailio[38057]: ERROR: {1 16584 BYE b61320ad-4588-4fcc-8548-c082d2afd12b} rtpengine [rtpengine.c:2706]: rtpp_function_call(): no available proxies Line 17123: May 5 10:53:32 ip-172-28-31-52 /usr/sbin/kamailio[38063]: ERROR: {2 16584 BYE b61320ad-4588-4fcc-8548-c082d2afd12b} rtpengine [rtpengine.c:2706]: rtpp_function_call(): no available proxies Line 17124: May 5 10:53:32 ip-172-28-31-52 /usr/sbin/kamailio[38056]: ERROR: {1 9087 BYE 25d5140d-b097-4577-9ccb-709818eed73a} rtpengine [rtpengine.c:2706]: rtpp_function_call(): no available proxies Line 17125: May 5 10:53:32 ip-172-28-31-52 /usr/sbin/kamailio[38056]: ERROR: {1 9087 BYE 25d5140d-b097-4577-9ccb-709818eed73a} rtpengine [rtpengine.c:2706]: rtpp_function_call(): no available proxies Line 17126: May 5 10:53:32 ip-172-28-31-52 /usr/sbin/kamailio[38059]: ERROR: {2 9087 BYE 25d5140d-b097-4577-9ccb-709818eed73a} rtpengine [rtpengine.c:2706]: rtpp_function_call(): no available proxies Line 17127: May 5 10:53:33 ip-172-28-31-52 /usr/sbin/kamailio[38058]: ERROR: {1 9236 INVITE 90ba24c7-7390-42b0-8795-3415dce47281} rtpengine [rtpengine.c:2706]: rtpp_function_call(): no available proxies Line 17128: May 5 10:53:33 ip-172-28-31-52 /usr/sbin/kamailio[38061]: ERROR: {1 9236 INVITE 90ba24c7-7390-42b0-8795-3415dce47281} rtpengine [rtpengine.c:2706]: rtpp_function_call(): no available proxies Line 17129: May 5 10:53:33 ip-172-28-31-52 /usr/sbin/kamailio[38057]: ERROR: {1 9237 BYE 90ba24c7-7390-42b0-8795-3415dce47281} rtpengine [rtpengine.c:2706]: rtpp_function_call(): no available proxies Line 17130: May 5 10:53:33 ip-172-28-31-52 /usr/sbin/kamailio[38057]: ERROR: {1 9237 BYE 90ba24c7-7390-42b0-8795-3415dce47281} rtpengine [rtpengine.c:2706]: rtpp_function_call(): no available proxies Line 17131: May 5 10:53:33 ip-172-28-31-52 /usr/sbin/kamailio[38063]: ERROR: {2 9237 BYE 90ba24c7-7390-42b0-8795-3415dce47281} rtpengine [rtpengine.c:2706]: rtpp_function_call(): no available proxies Line 17134: May 5 10:53:35 ip-172-28-31-52 /usr/sbin/kamailio[38063]: ERROR: {1 102 INVITE 18d25c19-1042-426b-b810-7411f61b0467} rtpengine [rtpengine.c:2706]: rtpp_function_call(): no available proxies Line 17135: May 5 10:53:35 ip-172-28-31-52 /usr/sbin/kamailio[38061]: ERROR: {2 102 INVITE 18d25c19-1042-426b-b810-7411f61b0467} rtpengine [rtpengine.c:2706]: rtpp_function_call(): no available proxies Line 17136: May 5 10:53:36 ip-172-28-31-52 /usr/sbin/kamailio[38062]: ERROR: {1 26715 INVITE 12eac28a-ec67-4c0d-994c-fefabe1ea817} rtpengine [rtpengine.c:3070]: send_rtpp_command(): can't send command "ping" to RTPEngine <udp:127.0.0.1:2223> Line 17137: May 5 10:53:36 ip-172-28-31-52 /usr/sbin/kamailio[38062]: ERROR: {1 26715 INVITE 12eac28a-ec67-4c0d-994c-fefabe1ea817} rtpengine [rtpengine.c:2919]: rtpp_test(): proxy did not respond to ping Line 17138: May 5 10:53:36 ip-172-28-31-52 /usr/sbin/kamailio[38062]: ERROR: {1 26715 INVITE 12eac28a-ec67-4c0d-994c-fefabe1ea817} rtpengine [rtpengine.c:3365]: select_rtpp_node(): rtpengine failed to select new for calllen=36 callid=12eac28a-ec67-4c0d-994c-fefabe1ea817 Line 17139: May 5 10:53:36 ip-172-28-31-52 /usr/sbin/kamailio[38062]: ERROR: {1 26715 INVITE 12eac28a-ec67-4c0d-994c-fefabe1ea817} rtpengine [rtpengine.c:2706]: rtpp_function_call(): no available proxies Line 17140: May 5 10:53:36 ip-172-28-31-52 /usr/sbin/kamailio[38056]: ERROR: {1 5085 INVITE 43585607-620b-4a77-a755-250eefc74e9e} rtpengine [rtpengine.c:3070]: send_rtpp_command(): can't send command "ping" to RTPEngine <udp:127.0.0.1:2223> Line 17141: May 5 10:53:36 ip-172-28-31-52 /usr/sbin/kamailio[38056]: ERROR: {1 5085 INVITE 43585607-620b-4a77-a755-250eefc74e9e} rtpengine [rtpengine.c:2919]: rtpp_test(): proxy did not respond to ping Line 17142: May 5 10:53:36 ip-172-28-31-52 /usr/sbin/kamailio[38056]: ERROR: {1 5085 INVITE 43585607-620b-4a77-a755-250eefc74e9e} rtpengine [rtpengine.c:3365]: select_rtpp_node(): rtpengine failed to select new for calllen=36 callid=43585607-620b-4a77-a755-250eefc74e9e Line 17143: May 5 10:53:36 ip-172-28-31-52 /usr/sbin/kamailio[38056]: ERROR: {1 5085 INVITE 43585607-620b-4a77-a755-250eefc74e9e} rtpengine [rtpengine.c:2706]: rtpp_function_call(): no available proxies Line 17144: May 5 10:53:36 ip-172-28-31-52 /usr/sbin/kamailio[38063]: ERROR: {2 26715 INVITE 12eac28a-ec67-4c0d-994c-fefabe1ea817} rtpengine [rtpengine.c:3070]: send_rtpp_command(): can't send command "ping" to RTPEngine <udp:127.0.0.1:2223> Line 17145: May 5 10:53:36 ip-172-28-31-52 /usr/sbin/kamailio[38063]: ERROR: {2 26715 INVITE 12eac28a-ec67-4c0d-994c-fefabe1ea817} rtpengine [rtpengine.c:2919]: rtpp_test(): proxy did not respond to ping Line 17146: May 5 10:53:36 ip-172-28-31-52 /usr/sbin/kamailio[38063]: ERROR: {2 26715 INVITE 12eac28a-ec67-4c0d-994c-fefabe1ea817} rtpengine [rtpengine.c:3365]: select_rtpp_node(): rtpengine failed to select new for calllen=36 callid=12eac28a-ec67-4c0d-994c-fefabe1ea817 Line 17147: May 5 10:53:36 ip-172-28-31-52 /usr/sbin/kamailio[38063]: ERROR: {2 26715 INVITE 12eac28a-ec67-4c0d-994c-fefabe1ea817} rtpengine [rtpengine.c:2706]: rtpp_function_call(): no available proxies Line 17148: May 5 10:53:36 ip-172-28-31-52 /usr/sbin/kamailio[38060]: ERROR: {1 26716 INVITE 12eac28a-ec67-4c0d-994c-fefabe1ea817} rtpengine [rtpengine.c:3070]: send_rtpp_command(): can't send command "ping" to RTPEngine <udp:127.0.0.1:2223> Line 17149: May 5 10:53:36 ip-172-28-31-52 /usr/sbin/kamailio[38060]: ERROR: {1 26716 INVITE 12eac28a-ec67-4c0d-994c-fefabe1ea817} rtpengine [rtpengine.c:2919]: rtpp_test(): proxy did not respond to ping Line 17150: May 5 10:53:36 ip-172-28-31-52 /usr/sbin/kamailio[38060]: ERROR: {1 26716 INVITE 12eac28a-ec67-4c0d-994c-fefabe1ea817} rtpengine [rtpengine.c:3365]: select_rtpp_node(): rtpengine failed to select new for calllen=36 callid=12eac28a-ec67-4c0d-994c-fefabe1ea817 Line 17151: May 5 10:53:36 ip-172-28-31-52 /usr/sbin/kamailio[38060]: ERROR: {1 26716 INVITE 12eac28a-ec67-4c0d-994c-fefabe1ea817} rtpengine [rtpengine.c:2706]: rtpp_function_call(): no available proxies Line 17152: May 5 10:53:36 ip-172-28-31-52 /usr/sbin/kamailio[38062]: ERROR: {2 26716 INVITE 12eac28a-ec67-4c0d-994c-fefabe1ea817} rtpengine [rtpengine.c:3070]: send_rtpp_command(): can't send command "ping" to RTPEngine <udp:127.0.0.1:2223> Line 17153: May 5 10:53:36 ip-172-28-31-52 /usr/sbin/kamailio[38062]: ERROR: {2 26716 INVITE 12eac28a-ec67-4c0d-994c-fefabe1ea817} rtpengine [rtpengine.c:2919]: rtpp_test(): proxy did not respond to ping Line 17154: May 5 10:53:36 ip-172-28-31-52 /usr/sbin/kamailio[38062]: ERROR: {2 26716 INVITE 12eac28a-ec67-4c0d-994c-fefabe1ea817} rtpengine [rtpengine.c:3365]: select_rtpp_node(): rtpengine failed to select new for calllen=36 callid=12eac28a-ec67-4c0d-994c-fefabe1ea817 Line 17155: May 5 10:53:36 ip-172-28-31-52 /usr/sbin/kamailio[38062]: ERROR: {2 26716 INVITE 12eac28a-ec67-4c0d-994c-fefabe1ea817} rtpengine [rtpengine.c:2706]: rtpp_function_call(): no available proxies Line 17156: May 5 10:53:36 ip-172-28-31-52 /usr/sbin/kamailio[38058]: ERROR: {2 5085 INVITE 43585607-620b-4a77-a755-250eefc74e9e} rtpengine [rtpengine.c:3070]: send_rtpp_command(): can't send command "ping" to RTPEngine <udp:127.0.0.1:2223> Line 17157: May 5 10:53:36 ip-172-28-31-52 /usr/sbin/kamailio[38058]: ERROR: {2 5085 INVITE 43585607-620b-4a77-a755-250eefc74e9e} rtpengine [rtpengine.c:2919]: rtpp_test(): proxy did not respond to ping Line 17158: May 5 10:53:36 ip-172-28-31-52 /usr/sbin/kamailio[38058]: ERROR: {2 5085 INVITE 43585607-620b-4a77-a755-250eefc74e9e} rtpengine [rtpengine.c:3365]: select_rtpp_node(): rtpengine failed to select new for calllen=36 callid=43585607-620b-4a77-a755-250eefc74e9e Line 17159: May 5 10:53:36 ip-172-28-31-52 /usr/sbin/kamailio[38058]: ERROR: {2 5085 INVITE 43585607-620b-4a77-a755-250eefc74e9e} rtpengine [rtpengine.c:2706]: rtpp_function_call(): no available proxies Line 17160: May 5 10:53:37 ip-172-28-31-52 /usr/sbin/kamailio[38063]: ERROR: {1 5086 INVITE 43585607-620b-4a77-a755-250eefc74e9e} rtpengine [rtpengine.c:3070]: send_rtpp_command(): can't send command "ping" to RTPEngine <udp:127.0.0.1:2223> Line 17161: May 5 10:53:37 ip-172-28-31-52 /usr/sbin/kamailio[38063]: ERROR: {1 5086 INVITE 43585607-620b-4a77-a755-250eefc74e9e} rtpengine [rtpengine.c:2919]: rtpp_test(): proxy did not respond to ping Line 17162: May 5 10:53:37 ip-172-28-31-52 /usr/sbin/kamailio[38063]: ERROR: {1 5086 INVITE 43585607-620b-4a77-a755-250eefc74e9e} rtpengine [rtpengine.c:3365]: select_rtpp_node(): rtpengine failed to select new for calllen=36 callid=43585607-620b-4a77-a755-250eefc74e9e Line 17163: May 5 10:53:37 ip-172-28-31-52 /usr/sbin/kamailio[38063]: ERROR: {1 5086 INVITE 43585607-620b-4a77-a755-250eefc74e9e} rtpengine [rtpengine.c:2706]: rtpp_function_call(): no available proxies Line 17164: May 5 10:53:37 ip-172-28-31-52 /usr/sbin/kamailio[38060]: ERROR: {2 5086 INVITE 43585607-620b-4a77-a755-250eefc74e9e} rtpengine [rtpengine.c:3070]: send_rtpp_command(): can't send command "ping" to RTPEngine <udp:127.0.0.1:2223> Line 17165: May 5 10:53:37 ip-172-28-31-52 /usr/sbin/kamailio[38060]: ERROR: {2 5086 INVITE 43585607-620b-4a77-a755-250eefc74e9e} rtpengine [rtpengine.c:2919]: rtpp_test(): proxy did not respond to ping Line 17166: May 5 10:53:37 ip-172-28-31-52 /usr/sbin/kamailio[38060]: ERROR: {2 5086 INVITE 43585607-620b-4a77-a755-250eefc74e9e} rtpengine [rtpengine.c:3365]: select_rtpp_node(): rtpengine failed to select new for calllen=36 callid=43585607-620b-4a77-a755-250eefc74e9e Line 17167: May 5 10:53:37 ip-172-28-31-52 /usr/sbin/kamailio[38060]: ERROR: {2 5086 INVITE 43585607-620b-4a77-a755-250eefc74e9e} rtpengine [rtpengine.c:2706]: rtpp_function_call(): no available proxies Line 17168: May 5 10:53:37 ip-172-28-31-52 /usr/sbin/kamailio[38056]: INFO: <core> [main.c:854]: sig_usr(): signal 15 received Line 17169: May 5 10:53:37 ip-172-28-31-52 systemd[1]: Stopping Kamailio - the Open Source SIP Server... Line 17170: May 5 10:53:37 ip-172-28-31-52 /usr/sbin/kamailio[38057]: INFO: <core> [main.c:854]: sig_usr(): signal 15 received Line 17171: May 5 10:53:37 ip-172-28-31-52 /usr/sbin/kamailio[38058]: INFO: <core> [main.c:854]: sig_usr(): signal 15 received Line 17172: May 5 10:53:37 ip-172-28-31-52 /usr/sbin/kamailio[38059]: INFO: <core> [main.c:854]: sig_usr(): signal 15 received Line 17173: May 5 10:53:37 ip-172-28-31-52 /usr/sbin/kamailio[38063]: INFO: <core> [main.c:854]: sig_usr(): signal 15 received Line 17174: May 5 10:53:37 ip-172-28-31-52 /usr/sbin/kamailio[38052]: NOTICE: <core> [main.c:733]: handle_sigs(): Thank you for flying kamailio!!!  #### SIP Traffic  ``` (paste your sip traffic here) ``` Sorry I do not have the sip traffic this time. ### Possible Solutions Only restart Kamailio for now. ### Additional Information version: kamailio 5.6.4 (x86_64/linux) a004cf flags: USE_TCP, USE_TLS, USE_SCTP, TLS_HOOKS, USE_RAW_SOCKS, DISABLE_NAGLE, USE_MCAST, DNS_IP_HACK, SHM_MMAP, PKG_MALLOC, Q_MALLOC, F_MALLOC, TLSF_MALLOC, DBG_SR_MEMORY, USE_FUTEX, FAST_LOCK-ADAPTIVE_WAIT, USE_DNS_CACHE, USE_DNS_FAILOVER, USE_NAPTR, USE_DST_BLOCKLIST, HAVE_RESOLV_RES, TLS_PTHREAD_MUTEX_SHARED ADAPTIVE_WAIT_LOOPS 1024, MAX_RECV_BUFFER_SIZE 262144, MAX_URI_SIZE 1024, BUF_SIZE 65535, DEFAULT PKG_SIZE 8MB poll method support: poll, epoll_lt, epoll_et, sigio_rt, select. id: a004cf compiled on 12:47:38 Feb 27 2023 with gcc 8.5.0 * **Operating System**: RockyLinux 8.7 4.18.0-425.19.2.el8_7.x86_64 #1 SMP Tue Apr 4 22:38:11 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux -- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/3438 You are receiving this because you are subscribed to this thread. Message ID: <kamailio/kamailio/issues/3438(a)github.com>

2 3

[kamailio/kamailio] Invoking jwt_verify causing TLS termination (Issue #3434)
by obarash 08 May '23

08 May '23

### Description When invoking jwt_verify with an expired JWT, it causes TLS termination with log print from the tls_server and tls_util. While trying to debug the issue, I tried to give the method an invalid key path. I got the following log (as expected): ``` failed to read key file ``` Then the flow continued just fine (fallback to proxy_authorization). When I gave it a correct file path, but the content is wrong, the problem still occurred. This makes me think the problem is in the method : ``` static int ki_jwt_verify_key(sip_msg_t* msg, str *key, str *alg, str *claims, str *jwtval) ``` ### Troubleshooting #### Reproduction Use an expired JWT #### Log Messages ``` May 4 12:52:37 kamailio01 /usr/sbin/kamailio[21921]: INFO: {1 13605 INVITE 71a5d88a-b485-43c0-bac4-a2723333efeb} <script>: request_route: method [INVITE] from [sip:1234@barash.com] to [sip:pre-arranged-conf-factory@barash.com] May 4 12:52:37 kamailio01 /usr/sbin/kamailio[21921]: ERROR: {1 13605 INVITE 71a5d88a-b485-43c0-bac4-a2723333efeb} jwt [jwt_mod.c:514]: ki_jwt_verify(): failed to decode jwt value May 4 12:52:37 kamailio01 /usr/sbin/kamailio[21921]: INFO: {1 13605 INVITE 71a5d88a-b485-43c0-bac4-a2723333efeb} <script>: route[AUTH] failed to verify jwt token. May 4 12:52:37 kamailio01 /usr/sbin/kamailio[21921]: ERROR: tls [tls_server.c:1330]: tls_h_read_f(): protocol level error May 4 12:52:37 kamailio01 /usr/sbin/kamailio[21921]: ERROR: tls [tls_util.h:51]: tls_err_ret(): TLS read:error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding (sni: dev-proxy.barash.com) May 4 12:52:37 kamailio01 /usr/sbin/kamailio[21921]: ERROR: tls [tls_util.h:51]: tls_err_ret(): TLS read:error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed (sni: dev-proxy.barash.com) May 4 12:52:37 kamailio01 /usr/sbin/kamailio[21921]: ERROR: tls [tls_server.c:1334]: tls_h_read_f(): src addr: 172.19.140.11:37188 May 4 12:52:37 kamailio01 /usr/sbin/kamailio[21921]: ERROR: tls [tls_server.c:1337]: tls_h_read_f(): dst addr: 172.19.140.70:5061 May 4 12:52:37 kamailio01 /usr/sbin/kamailio[21921]: ERROR: <core> [core/tcp_read.c:1478]: tcp_read_req(): ERROR: tcp_read_req: error reading - c: 0x7f731ec677f8 r: 0x7f731ec67920 (-1) ``` ### Additional Information * **Kamailio Version** - output of `kamailio -v` ``` version: kamailio 5.6.4 (x86_64/linux) a004cf flags: USE_TCP, USE_TLS, USE_SCTP, TLS_HOOKS, USE_RAW_SOCKS, DISABLE_NAGLE, USE_MCAST, DNS_IP_HACK, SHM_MMAP, PKG_MALLOC, Q_MALLOC, F_MALLOC, TLSF_MALLOC, DBG_SR_MEMORY, USE_FUTEX, FAST_LOCK-ADAPTIVE_WAIT, USE_DNS_CACHE, USE_DNS_FAILOVER, USE_NAPTR, USE_DST_BLOCKLIST, HAVE_RESOLV_RES, TLS_PTHREAD_MUTEX_SHARED ADAPTIVE_WAIT_LOOPS 1024, MAX_RECV_BUFFER_SIZE 262144, MAX_URI_SIZE 1024, BUF_SIZE 65535, DEFAULT PKG_SIZE 8MB poll method support: poll, epoll_lt, epoll_et, sigio_rt, select. id: a004cf compiled on 09:56:56 Mar 22 2023 with gcc 8.3.0 ``` * **Operating System**: ``` No LSB modules are available. Distributor ID: Debian Description: Debian GNU/Linux 10 (buster) Release: 10 Codename: buster Linux kamailio01.dev.wb.internal 4.19.0-23-amd64 #1 SMP Debian 4.19.269-1 (2022-12-20) x86_64 GNU/Linux ``` -- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/3434 You are receiving this because you are subscribed to this thread. Message ID: <kamailio/kamailio/issues/3434(a)github.com>

2 2

git:master:5ec8c403: siptrace: reworked sip_trace_msg() to specify source and target addresses
by Daniel-Constantin Mierla 08 May '23

08 May '23

Module: kamailio Branch: master Commit: 5ec8c403e0a49ec752d5b10f330f53a97d625822 URL: https://github.com/kamailio/kamailio/commit/5ec8c403e0a49ec752d5b10f330f53a… Author: Daniel-Constantin Mierla <miconda(a)gmail.com> Committer: Daniel-Constantin Mierla <miconda(a)gmail.com> Date: 2023-05-08T14:11:08+02:00 siptrace: reworked sip_trace_msg() to specify source and target addresses - implemented for hep mirroring only - prototype: sip_trace_msg(data, saddr, taddr, duri, corrid) --- Modified: src/modules/siptrace/siptrace.c --- Diff: https://github.com/kamailio/kamailio/commit/5ec8c403e0a49ec752d5b10f330f53a… Patch: https://github.com/kamailio/kamailio/commit/5ec8c403e0a49ec752d5b10f330f53a…

1 0

git:master:43e76ead: siptrace: sip_trace_msg() exported with 3 parameters
by Daniel-Constantin Mierla 08 May '23

08 May '23

Module: kamailio Branch: master Commit: 43e76ead36e9d09d462ebc0ba2fc88d06c4d9ac4 URL: https://github.com/kamailio/kamailio/commit/43e76ead36e9d09d462ebc0ba2fc88d… Author: Daniel-Constantin Mierla <miconda(a)gmail.com> Committer: Daniel-Constantin Mierla <miconda(a)gmail.com> Date: 2023-05-08T14:11:08+02:00 siptrace: sip_trace_msg() exported with 3 parameters --- Modified: src/modules/siptrace/siptrace.c --- Diff: https://github.com/kamailio/kamailio/commit/43e76ead36e9d09d462ebc0ba2fc88d… Patch: https://github.com/kamailio/kamailio/commit/43e76ead36e9d09d462ebc0ba2fc88d… --- diff --git a/src/modules/siptrace/siptrace.c b/src/modules/siptrace/siptrace.c index 0401f304b8..1519d49a7a 100644 --- a/src/modules/siptrace/siptrace.c +++ b/src/modules/siptrace/siptrace.c @@ -217,7 +217,7 @@ static cmd_export_t cmds[] = { ANY_ROUTE}, {"sip_trace", (cmd_function)w_sip_trace3, 3, fixup_siptrace, fixup_free_siptrace, ANY_ROUTE}, - {"sip_trace_msg", (cmd_function)w_sip_trace_msg, 4, fixup_spve_all, fixup_free_spve_all, + {"sip_trace_msg", (cmd_function)w_sip_trace_msg, 3, fixup_spve_all, fixup_free_spve_all, ANY_ROUTE}, {"hlog", (cmd_function)w_hlog1, 1, fixup_spve_null, 0, ANY_ROUTE},

1 0

git:master:7532e92b: siptrace; fix parameter inside sip_trace_msg()
by Daniel-Constantin Mierla 08 May '23

08 May '23

Module: kamailio Branch: master Commit: 7532e92bc45f35348a34f9e7bd39fc00db4118dd URL: https://github.com/kamailio/kamailio/commit/7532e92bc45f35348a34f9e7bd39fc0… Author: Daniel-Constantin Mierla <miconda(a)gmail.com> Committer: Daniel-Constantin Mierla <miconda(a)gmail.com> Date: 2023-05-08T14:11:08+02:00 siptrace; fix parameter inside sip_trace_msg() --- Modified: src/modules/siptrace/siptrace.c --- Diff: https://github.com/kamailio/kamailio/commit/7532e92bc45f35348a34f9e7bd39fc0… Patch: https://github.com/kamailio/kamailio/commit/7532e92bc45f35348a34f9e7bd39fc0… --- diff --git a/src/modules/siptrace/siptrace.c b/src/modules/siptrace/siptrace.c index b2638137c4d..0401f304b89 100644 --- a/src/modules/siptrace/siptrace.c +++ b/src/modules/siptrace/siptrace.c @@ -1214,7 +1214,7 @@ static int w_sip_trace_msg(sip_msg_t *msg, char *dest, char *correlation_id, cha nmsg = msg; } - ret = w_sip_trace3(msg, dest, correlation_id, NULL); + ret = w_sip_trace3(nmsg, dest, correlation_id, NULL); if(nmsg != msg) { free_sip_msg(&tmsg);

1 0

git:master:b6d03564: siptrace: added sip_trace_msg(dst, corlid, vmsg)
by Daniel-Constantin Mierla 08 May '23

08 May '23

Module: kamailio Branch: master Commit: b6d03564570839553bd0eeed28c06102bfa9fc46 URL: https://github.com/kamailio/kamailio/commit/b6d03564570839553bd0eeed28c0610… Author: Daniel-Constantin Mierla <miconda(a)gmail.com> Committer: Daniel-Constantin Mierla <miconda(a)gmail.com> Date: 2023-05-08T14:11:08+02:00 siptrace: added sip_trace_msg(dst, corlid, vmsg) - send sip trace with the message provided as parmameter --- Modified: src/modules/siptrace/siptrace.c --- Diff: https://github.com/kamailio/kamailio/commit/b6d03564570839553bd0eeed28c0610… Patch: https://github.com/kamailio/kamailio/commit/b6d03564570839553bd0eeed28c0610… --- diff --git a/src/modules/siptrace/siptrace.c b/src/modules/siptrace/siptrace.c index 81926cc1ba..b2638137c4 100644 --- a/src/modules/siptrace/siptrace.c +++ b/src/modules/siptrace/siptrace.c @@ -90,6 +90,7 @@ static int w_sip_trace0(struct sip_msg *, char *p1, char *p2); static int w_sip_trace1(struct sip_msg *, char *dest, char *p2); static int w_sip_trace2(struct sip_msg *, char *dest, char *correlation_id); static int w_sip_trace3(struct sip_msg *, char *dest, char *correlation_id, char *trace_type); +static int w_sip_trace_msg(sip_msg_t *msg, char *dest, char *correlation_id, char *vmsg); static int fixup_siptrace(void **param, int param_no); static int fixup_free_siptrace(void **param, int param_no); static int w_sip_trace_mode(sip_msg_t *msg, char *pmode, char *p2); @@ -216,6 +217,8 @@ static cmd_export_t cmds[] = { ANY_ROUTE}, {"sip_trace", (cmd_function)w_sip_trace3, 3, fixup_siptrace, fixup_free_siptrace, ANY_ROUTE}, + {"sip_trace_msg", (cmd_function)w_sip_trace_msg, 4, fixup_spve_all, fixup_free_spve_all, + ANY_ROUTE}, {"hlog", (cmd_function)w_hlog1, 1, fixup_spve_null, 0, ANY_ROUTE}, {"hlog", (cmd_function)w_hlog2, 2, fixup_spve_spve, 0, @@ -774,12 +777,12 @@ static int fixup_siptrace(void **param, int param_no) str sflags; enum siptrace_type_t trace_type; - if(param_no < 1 || param_no > 3) { + if(param_no < 1 || param_no > 4) { LM_DBG("params:%s\n", (char *)*param); return 0; } - if (param_no == 1 || param_no == 2) { + if (param_no == 1 || param_no == 2 || param_no == 4) { /* correlation id */ return fixup_spve_all(param, param_no); } else if (param_no == 3) { @@ -806,7 +809,7 @@ static int fixup_siptrace(void **param, int param_no) static int fixup_free_siptrace(void **param, int param_no) { - if (param_no == 1 || param_no == 2) { + if (param_no == 1 || param_no == 2 || param_no == 4) { /* correlation id */ return fixup_free_spve_all(param, param_no); } if (param_no == 3) { @@ -1163,6 +1166,67 @@ static int w_sip_trace3(sip_msg_t *msg, char *dest, char *correlation_id, char * (correlation_id)?&correlation_id_str:NULL, NULL, trace_type); } +/** + * + */ +static int w_sip_trace_msg(sip_msg_t *msg, char *dest, char *correlation_id, char *vmsg) +{ + str vmsg_str = {0, 0}; + sip_msg_t *nmsg = NULL; + sip_msg_t tmsg; + char tbuf[BUF_SIZE]; + int ret; + + if (vmsg) { + if(fixup_get_svalue(msg, (gparam_t*)vmsg, &vmsg_str) != 0) { + LM_ERR("unable to parse the msg data parameter\n"); + return -1; + } + memset(&tmsg, 0, sizeof(sip_msg_t)); + memcpy(tbuf, vmsg_str.s, vmsg_str.len); + tbuf[vmsg_str.len] = 0; + tmsg.buf = tbuf; + tmsg.len = vmsg_str.len; + if (parse_msg(tmsg.buf, tmsg.len, &tmsg)!=0) { + LM_ERR("parse msg failed\n"); + return -1; + } + if (parse_headers(msg, HDR_EOH_F, 0)==-1) { + LM_DBG("parsing headers failed [[%.*s]]\n", + msg->len, msg->buf); + goto error; + } + + if(parse_from_header(msg)<0) { + LM_ERR("cannot parse FROM header\n"); + goto error; + } + + if(parse_to_header(msg)<0 || msg->to==NULL) { + LM_ERR("cannot parse TO header\n"); + goto error; + } + tmsg.id = msg->id; + tmsg.pid = msg->pid; + tmsg.rcv = msg->rcv; + nmsg = &tmsg; + } else { + nmsg = msg; + } + + ret = w_sip_trace3(msg, dest, correlation_id, NULL); + + if(nmsg != msg) { + free_sip_msg(&tmsg); + } + + return ret; + +error: + free_sip_msg(&tmsg); + return -1; +} + /** * link call-id, method, from-tag and to-tag */

1 0

[kamailio/kamailio] siptrace - custom sip message hep replication (PR #3442)
by Daniel-Constantin Mierla 08 May '23

08 May '23

#### Pre-Submission Checklist    - [x] Commit message has the format required by CONTRIBUTING guide - [x] Commits are split per component (core, individual modules, libs, utils, ...) - [ ] Each component has a single commit (if not, squash them into one commit) - [ ] No commits to README files for modules (changes must be done to docbook files in `doc/` subfolder, the README file is autogenerated) #### Type Of Change - [ ] Small bug fix (non-breaking change which fixes an issue) - [x] New feature (non-breaking change which adds new functionality) - [ ] Breaking change (fix or feature that would change existing functionality) #### Checklist:  - [ ] PR should be backported to stable branches - [ ] Tested changes locally - [ ] Related to issue #XXXX (replace XXXX with an open issue number) #### Description Enhancements to siptrace module to allow HEP replication of custom sip message given as parameter. You can view, comment on, or merge this pull request online at: https://github.com/kamailio/kamailio/pull/3442 -- Commit Summary -- * siptrace: added sip_trace_msg(dst, corlid, vmsg) * siptrace; fix parameter inside sip_trace_msg() * siptrace: sip_trace_msg() exported with 3 parameters * siptrace: reworked sip_trace_msg() to specify source and target addresses -- File Changes -- M src/modules/siptrace/siptrace.c (68) -- Patch Links -- https://github.com/kamailio/kamailio/pull/3442.patch https://github.com/kamailio/kamailio/pull/3442.diff -- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/pull/3442 You are receiving this because you are subscribed to this thread. Message ID: <kamailio/kamailio/pull/3442(a)github.com>

1 1

git:master:f9cbe7ad: pkg/kamailio/deb: version set 5.8.0~dev0 [skip ci]
by Victor Seva 04 May '23

04 May '23

Module: kamailio Branch: master Commit: f9cbe7ad01331e97852872c29b612409bf571c8d URL: https://github.com/kamailio/kamailio/commit/f9cbe7ad01331e97852872c29b61240… Author: Victor Seva <linuxmaniac(a)torreviejawireless.org> Committer: Victor Seva <linuxmaniac(a)torreviejawireless.org> Date: 2023-05-04T21:46:22+02:00 pkg/kamailio/deb: version set 5.8.0~dev0 [skip ci] --- Modified: pkg/kamailio/deb/bionic/changelog Modified: pkg/kamailio/deb/bookworm/changelog Modified: pkg/kamailio/deb/bullseye/changelog Modified: pkg/kamailio/deb/buster/changelog Modified: pkg/kamailio/deb/debian/changelog Modified: pkg/kamailio/deb/focal/changelog Modified: pkg/kamailio/deb/jammy/changelog Modified: pkg/kamailio/deb/jessie/changelog Modified: pkg/kamailio/deb/precise/changelog Modified: pkg/kamailio/deb/sid/changelog Modified: pkg/kamailio/deb/stretch/changelog Modified: pkg/kamailio/deb/trusty/changelog Modified: pkg/kamailio/deb/wheezy/changelog Modified: pkg/kamailio/deb/xenial/changelog --- Diff: https://github.com/kamailio/kamailio/commit/f9cbe7ad01331e97852872c29b61240… Patch: https://github.com/kamailio/kamailio/commit/f9cbe7ad01331e97852872c29b61240…

1 0

git:5.7:14cb08ed: pkg/kamailio/deb: version set 5.7.0~rc0 [skip ci]
by Victor Seva 04 May '23

04 May '23

Module: kamailio Branch: 5.7 Commit: 14cb08ed98740bd286b89edb2b0555aebd7d69c2 URL: https://github.com/kamailio/kamailio/commit/14cb08ed98740bd286b89edb2b0555a… Author: Victor Seva <linuxmaniac(a)torreviejawireless.org> Committer: Victor Seva <linuxmaniac(a)torreviejawireless.org> Date: 2023-05-04T21:44:23+02:00 pkg/kamailio/deb: version set 5.7.0~rc0 [skip ci] --- Modified: pkg/kamailio/deb/bionic/changelog Modified: pkg/kamailio/deb/bookworm/changelog Modified: pkg/kamailio/deb/bullseye/changelog Modified: pkg/kamailio/deb/buster/changelog Modified: pkg/kamailio/deb/debian/changelog Modified: pkg/kamailio/deb/focal/changelog Modified: pkg/kamailio/deb/jammy/changelog Modified: pkg/kamailio/deb/jessie/changelog Modified: pkg/kamailio/deb/precise/changelog Modified: pkg/kamailio/deb/sid/changelog Modified: pkg/kamailio/deb/stretch/changelog Modified: pkg/kamailio/deb/trusty/changelog Modified: pkg/kamailio/deb/wheezy/changelog Modified: pkg/kamailio/deb/xenial/changelog --- Diff: https://github.com/kamailio/kamailio/commit/14cb08ed98740bd286b89edb2b0555a… Patch: https://github.com/kamailio/kamailio/commit/14cb08ed98740bd286b89edb2b0555a…

1 0

[kamailio/kamailio] lcr: crash on ki_load_gws*() if called via KEMI (Issue #3435)
by Victor Seva 04 May '23

04 May '23

### Description crash happens if `lcr_id` passed to any of the functions ``KSR.lcr.load_gws*()`` is not defined in the lcr_gw table. ### Debugging Data ``` Core was generated by `/usr/sbin/kamailio -P /run/kamailio/kamailio.pid -f /etc/kamailio/kamailio.cfg'. Program terminated with signal SIGSEGV, Segmentation fault. (gdb) bt #0 ki_load_gws_furi (_m=0x7f1e66521100, lcr_id=3, ruri_user=0x7ffe1f856360, from_uri=0x7ffe1f856370) at lcr_mod.c:2312 #1 0x00007f1e65d8ca35 in sr_apy_kemi_exec_func_ex (ket=0x7f1e655c27f0 <sr_kemi_lcr_exports+144>, self=0x7f1e60ecd090, args=0x7f1e60dd07c0, idx=544) at apy_kemi.c:1354 #2 0x00007f1e65d90477 in sr_apy_kemi_exec_func (self=0x7f1e60ecd090, args=0x7f1e60dd07c0, idx=544) at apy_kemi.c:1829 #3 0x00007f1e65d9b6ff in sr_apy_kemi_exec_func_544 (self=0x7f1e60ecd090, args=0x7f1e60dd07c0) at apy_kemi_export.c:4395 #4 0x00007f1e658d4c74 in ?? () from /lib/x86_64-linux-gnu/libpython3.9.so.1.0 #5 0x00007f1e6588ea50 in _PyObject_MakeTpCall () from /lib/x86_64-linux-gnu/libpython3.9.so.1.0 #6 0x00007f1e658402f2 in _PyEval_EvalFrameDefault () from /lib/x86_64-linux-gnu/libpython3.9.so.1.0 #7 0x00007f1e65837033 in ?? () from /lib/x86_64-linux-gnu/libpython3.9.so.1.0 #8 0x00007f1e6583f4b7 in _PyEval_EvalFrameDefault () from /lib/x86_64-linux-gnu/libpython3.9.so.1.0 #9 0x00007f1e65837033 in ?? () from /lib/x86_64-linux-gnu/libpython3.9.so.1.0 #10 0x00007f1e6583f4b7 in _PyEval_EvalFrameDefault () from /lib/x86_64-linux-gnu/libpython3.9.so.1.0 #11 0x00007f1e65837033 in ?? () from /lib/x86_64-linux-gnu/libpython3.9.so.1.0 #12 0x00007f1e658916a4 in ?? () from /lib/x86_64-linux-gnu/libpython3.9.so.1.0 #13 0x00007f1e65da52fc in apy_exec (_msg=0x7f1e66521100, fname=0x7f1e65dae11d "ksr_request_route", fparam=0x0, emode=1) at python_exec.c:139 #14 0x00007f1e65d62cae in sr_kemi_config_engine_python (msg=0x7f1e66521100, rtype=1, rname=0x0, rparam=0x0) at apy_kemi.c:66 #15 0x000056247fc0a6e4 in sr_kemi_route (keng=0x562480066420 <_sr_kemi_eng_list>, msg=0x7f1e66521100, rtype=1, ename=0x0, edata=0x0) at core/kemi.c:3784 #16 0x000056247fc9da66 in receive_msg (buf=0x562480105280 <buf> "INVITE sip:0031686807515@34.91.122.173 SIP/2.0\r\nRecord-Route: <sip:94.247.7.211;lr;ftag=tj0p4Q1r8H5ap>\r\nVia: SIP/2.0/UDP 94.247.7.211;TH=div;branch=z9hG4bKdc26.e6a724746d6ff0bf5231906a5f1c8734.0\r\nVia:"..., len=1202, rcv_info=0x7ffe1f857090) at core/receive.c:502 #17 0x000056247fe01a5d in udp_rcv_loop () at core/udp_server.c:544 #18 0x000056247fb1a09b in main_loop () at main.c:1722 #19 0x000056247fb2720c in main (argc=10, argv=0x7ffe1f857ab8) at main.c:3078 (gdb) p lcr_count_param $1 = 1 (gdb) p lcr_id $2 = 3 ``` -- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/3435 You are receiving this because you are subscribed to this thread. Message ID: <kamailio/kamailio/issues/3435(a)github.com>

4 7

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

sr-dev May 2023