This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
tutorials:troubleshooting:memory [2015/01/16 16:57] miconda [Using GDB] |
tutorials:troubleshooting:memory [2015/05/14 13:55] miconda [PKG With System Malloc] |
||
---|---|---|---|
Line 63: | Line 63: | ||
* if the number of subscribers, | * if the number of subscribers, | ||
- | ===== Troubleshooting ===== | ||
===== Memory Manager Debugging ===== | ===== Memory Manager Debugging ===== | ||
Line 148: | Line 147: | ||
if($i> | if($i> | ||
if($a-> | if($a-> | ||
+ | printf " | ||
+ | p $a | ||
+ | p (void*)((char*)($a)+sizeof(struct qm_frag)) | ||
+ | printf " | ||
p *$a | p *$a | ||
end | end | ||
+ | end | ||
+ | set $a = ((struct qm_frag*)((char*)($a)+sizeof(struct qm_frag)+((struct qm_frag*)$a)-> | ||
+ | set $i = $i + 1 | ||
+ | end | ||
+ | </ | ||
+ | |||
+ | An alternative is to print all used chunks, but be aware that it may take some time: | ||
+ | |||
+ | |||
+ | <code c> | ||
+ | set $i=0 | ||
+ | set $a = mem_block-> | ||
+ | while($a < mem_block-> | ||
+ | if($a-> | ||
+ | printf " | ||
+ | p $a | ||
+ | p (void*)((char*)($a)+sizeof(struct qm_frag)) | ||
+ | printf " | ||
+ | p *$a | ||
end | end | ||
set $a = ((struct qm_frag*)((char*)($a)+sizeof(struct qm_frag)+((struct qm_frag*)$a)-> | set $a = ((struct qm_frag*)((char*)($a)+sizeof(struct qm_frag)+((struct qm_frag*)$a)-> | ||
Line 167: | Line 189: | ||
gdb --batch --command=/ | gdb --batch --command=/ | ||
</ | </ | ||
+ | |||
+ | ===== PKG With System Malloc ===== | ||
+ | |||
+ | Kamailio can be compiled to use system malloc and free for PKG needs. You have to remove the PKG_MALLOC define from Makefile.defs and can add DBG_SYS_MALLOC to get more verbosity with memory operations in debug mode. | ||
+ | |||
+ | Next is a diff showing the changes in Makefile.defs, | ||
+ | |||
+ | <code c> | ||
+ | diff --git a/ | ||
+ | index 3890668..12ca37a 100644 | ||
+ | --- a/ | ||
+ | +++ b/ | ||
+ | @@ -621,7 +621,7 @@ C_DEFS= $(extra_defs) \ | ||
+ | | ||
+ | | ||
+ | | ||
+ | - -DPKG_MALLOC \ | ||
+ | + -DDBG_SYS_MALLOC \ | ||
+ | | ||
+ | | ||
+ | | ||
+ | </ | ||
+ | |||
+ | After updating Makefile.defs recompile and reinstall. | ||
+ | |||
+ | Other tools available out there (e.g., valgrind) can be then used to track the PKG memory operations done by Kamailio. | ||
===== OS Memory Reports ===== | ===== OS Memory Reports ===== | ||
Line 172: | Line 220: | ||
It may happen that various tools report memory usage increase on the server. That could be due to a leak issue or due to caching done by kernel. The memory for cache can be reclaimed and it is better to verify whether the increase is due to it or not, before going ahead to investigate other applications. | It may happen that various tools report memory usage increase on the server. That could be due to a leak issue or due to caching done by kernel. The memory for cache can be reclaimed and it is better to verify whether the increase is due to it or not, before going ahead to investigate other applications. | ||
- | Kamailio itself uses in very few components extra memory directly from the system. Most of the operations are done in the memory zone reserved at startup and when that is filled, it starts printing out of memory errors. | + | Kamailio itself uses in very few components extra memory directly from the system |
Here is the article that presents better the situation: | Here is the article that presents better the situation: | ||
* http:// | * http:// | ||
+ | |||
+ | An relevant excerpt from the blog article: | ||
+ | |||
+ | < | ||
+ | Looking at the contents of / | ||
+ | |||
+ | Slab: 4126212 kB | ||
+ | SReclaimable: | ||
+ | |||
+ | So – almost 4G of memory was in use by the kernel slab memory structures – but | ||
+ | | ||
+ | |||
+ | So reclaimable slab space is yet another way that Linux memory can be in | ||
+ | | ||
+ | |||
+ | </ | ||
The respective memory can be reclaimed with command: | The respective memory can be reclaimed with command: |