<!-- Kamailio Project uses GitHub Issues only for bugs in the code or feature requests. Please use this template only for bug reports.
If you have questions about using Kamailio or related to its configuration file, ask on sr-users mailing list:
* http://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users
If you have questions about developing extensions to Kamailio or its existing C code, ask on sr-dev mailing list:
* http://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-dev
Please try to fill this template as much as possible for any issue. It helps the developers to troubleshoot the issue.
If there is no content to be filled in a section, the entire section can be removed.
You can delete the comments from the template sections when filling.
You can delete next line and everything above before submitting (it is a comment). -->
### Description
<!-- Explain what you did, what you expected to happen, and what actually happened. --> I tested kamailio's topoh+topos modules. udp worker's private memory is leaking when i enable both. after a couple of hour kamailio stops and spams error messages.
### Troubleshooting kamcmd pkg.stats shows lots of real_used memory(only udp workers are leaking).
#### Reproduction Enable both modules. <!-- If the issue can be reproduced, describe how it can be done. -->
#### Debugging Data
<!-- If you got a core dump, use gdb to extract troubleshooting data - full backtrace, local variables and the list of the code at the issue location.
gdb /path/to/kamailio /path/to/corefile bt full info locals list
If you are familiar with gdb, feel free to attach more of what you consider to be relevant. -->
#### Log Messages
<!-- Check the syslog file and if there are relevant log messages printed by Kamailio, add them next, or attach to issue, or provide a link to download them (e.g., to a pastebin site). -->
``` Oct 18 17:00:55 /usr/sbin/kamailio[20801]: ERROR: <core> [core/receive.c:162]: receive_msg(): no mem for sip_msg Oct 18 17:00:55 /usr/sbin/kamailio[20802]: ERROR: <core> [core/mem/q_malloc.c:291]: qm_find_free(): qm_find_free(0x7fe6f5bee010, 1776); Free fragment not found! Oct 18 17:00:55 /usr/sbin/kamailio[20802]: ERROR: <core> [core/mem/q_malloc.c:425]: qm_malloc(): qm_malloc(0x7fe6f5bee010, 1776) called from core: core/receive.c: receive_msg(160), module: core; Free fragment not found! ```
<!-- If the issue is exposed by processing specific SIP messages, grab them with ngrep or save in a pcap file, then add them next, or attach to issue, or provide a link to download them (e.g., to a pastebin site). -->
### Possible Solutions
<!-- If you found a solution or workaround for the issue, describe it. Ideally, provide a pull request with a fix. --> disable one of modules ### Additional Information * **/etc/default/kamailio** ``` SHM_MEMORY=512 PKG_MEMORY=64 ``` Number of children = 8
* **Parameters**: ``` loadmodule "topoh.so" modparam("topoh", "mask_key", "N2hkVvBTxJ6Y") modparam("topoh", "mask_callid", 0) modparam("topoh", "sanity_checks", 1) modparam("topoh", "uri_prefix_checks", 1) modparam("topoh", "mask_ip", MY_IP_ADDR) loadmodule "topos.so" loadmodule "topos_redis.so" modparam("topos", "storage", "redis") modparam("topos", "branch_expire", 300) modparam("topos", "dialog_expire", 10800) modparam("topos", "clean_interval", 30) modparam("topos_redis", "serverid", "topo") ``` * **Kamailio Version** - output of `kamailio -v`
``` # kamailio -v version: kamailio 5.1.6 (x86_64/linux) flags: STATS: Off, USE_TCP, USE_TLS, USE_SCTP, TLS_HOOKS, USE_RAW_SOCKS, DISABLE_NAGLE, USE_MCAST, DNS_IP_HACK, SHM_MEM, SHM_MMAP, PKG_MALLOC, Q_MALLOC, F_MALLOC, TLSF_MALLOC, DBG_SR_MEMORY, USE_FUTEX, FAST_LOCK-ADAPTIVE_WAIT, USE_DNS_CACHE, USE_DNS_FAILOVER, USE_NAPTR, USE_DST_BLACKLIST, HAVE_RESOLV_RES ADAPTIVE_WAIT_LOOPS=1024, MAX_RECV_BUFFER_SIZE 262144 MAX_URI_SIZE 1024, BUF_SIZE 65535, DEFAULT PKG_SIZE 8MB poll method support: poll, epoll_lt, epoll_et, sigio_rt, select. id: unknown compiled with gcc 4.9.2 ```
* **Operating System**:
<!-- Details about the operating system, the type: Linux (e.g.,: Debian 8.4, Ubuntu 16.04, CentOS 7.1, ...), MacOS, xBSD, Solaris, ...; Kernel details (output of `uname -a`) -->
``` Debian 8.10 ```
The modules were designed to be used one or the other, they are using same callback hooks and internal mechanism to replace old message buffer, using one after the other, likely to leak in stage in the middle of the message buffer.
I can look and see if there is anything that can be done. As a safety option when nothing else can be done or is too complex to consider, I can add a check in each module so that if the other one is loaded to stop starting kamailio...
I want to use only topos module. i was confused when i read topoS documentation. have it sanity_check parameter? config modparam("topoh", "sanity_checks", 1) contains topoH module instead of topos. this is why i enable both.
is it typo? modparam("topos", "sanity_checks", 1)
https://www.kamailio.org/docs/modules/5.1.x/modules/topos.html thank you in advance
That's a typo, being couple of mod params with the same purpose in the two modules, I did some copy&paste from topoh (older module) and topos. I will fix the docs, thanks for pointing it out.
thanks a lot
Closing this one, given the solution above and not expecting to use the two modules at the same time. That could be an enhancement in the future, for now it is not a bug.
Closed #1682.