If TCP children are busy, Please correct me if I am wrong if the remote IP is not responding via TCP protocol, this leads to a timeout and this child is busy. If many remote endpoints are not reachable via TCP this can lead to the case when half or more children are by timeout operations.
I think required to monitor how many children are busy. Is it possible to get such info using kamcmd utility, statistics module, or xprom module.
Sergey
It's hard for children to introspect on and report their own busy status, and there's no distributor/supervisor process that has that kind of awareness about the children[1].
`ss -nl` (or `netstat` equivalent) will show you, in the RecvQ column, the number of packets (UDP) or connections (TCP) that are stacked up and going unreplied by any child. This figure should be 0 or substantially 0 if things are going well.
-- Alex
[1] Notwithstanding the recent 6.x change that optionally adds such a process.
On Jan 4, 2025, at 2:31 am, Sergey Safarov via sr-users sr-users@lists.kamailio.org wrote:
If TCP children are busy, Please correct me if I am wrong if the remote IP is not responding via TCP protocol, this leads to a timeout and this child is busy. If many remote endpoints are not reachable via TCP this can lead to the case when half or more children are by timeout operations.
I think required to monitor how many children are busy. Is it possible to get such info using kamcmd utility, statistics module, or xprom module.
Sergey __________________________________________________________ Kamailio - Users Mailing List - Non Commercial Discussions -- sr-users@lists.kamailio.org To unsubscribe send an email to sr-users-leave@lists.kamailio.org Important: keep the mailing list in the recipients, do not reply only to the sender!
Hello Alex,
indeed, this is easier to analyse with the usual system management tools.
Small addition, for TCP and TLS there is actually a distributor or main process inside Kamailio:
$ kamcmd ps |grep tcp |grep main 18439 tcp main process
$ netstat -nap |grep 5060 | grep 18439 tcp 0 0 116.203.XXX.XXX:5060 0.0.0.0:* LISTEN 18439/kamailio tcp 0 0 116.203.XXX.XXX:5060 0.0.0.0:* LISTEN 18439/kamailio tcp 0 0 127.0.0.1:5060 0.0.0.0:* LISTEN 18439/kamailio tcp6 0 0 2a01:4f8:XXXX:XXXX::5060 :::* LISTEN 18439/kamailio
Cheers,
Henning
-----Original Message----- From: Alex Balashov via sr-users sr-users@lists.kamailio.org Sent: Samstag, 4. Januar 2025 18:01 To: Kamailio (SER) - Users Mailing List sr-users@lists.kamailio.org Cc: Alex Balashov abalashov@evaristesys.com Subject: [SR-Users] Re: children monitoring
It's hard for children to introspect on and report their own busy status, and there's no distributor/supervisor process that has that kind of awareness about the children[1].
`ss -nl` (or `netstat` equivalent) will show you, in the RecvQ column, the number of packets (UDP) or connections (TCP) that are stacked up and going unreplied by any child. This figure should be 0 or substantially 0 if things are going well.
-- Alex
[1] Notwithstanding the recent 6.x change that optionally adds such a process.
On Jan 4, 2025, at 2:31 am, Sergey Safarov via sr-users <sr-
users@lists.kamailio.org> wrote:
If TCP children are busy, Please correct me if I am wrong if the remote IP is not responding via TCP
protocol, this leads to a timeout and this child is busy.
If many remote endpoints are not reachable via TCP this can lead to the case
when half or more children are by timeout operations.
I think required to monitor how many children are busy. Is it possible to get such info using kamcmd utility, statistics module, or
xprom module.
Sergey __________________________________________________________ Kamailio - Users Mailing List - Non Commercial Discussions -- sr-users@lists.kamailio.org To unsubscribe send an email to sr-users-leave@lists.kamailio.org Important: keep the mailing list in the recipients, do not reply only to the
sender!
-- Alex Balashov Principal Consultant Evariste Systems LLC Web: https://evaristesys.com Tel: +1-706-510-6800
Kamailio - Users Mailing List - Non Commercial Discussions -- sr- users@lists.kamailio.org To unsubscribe send an email to sr-users- leave@lists.kamailio.org Important: keep the mailing list in the recipients, do not reply only to the sender!
Hello,
I am just curious what is a scenario or configuration which can cause that and therefore need for such monitoring.
The remote endpoints are not SIP endpoints? Are you monitoring async_workers?
Arsen
On Sat, Jan 4, 2025 at 7:55 PM Henning Westerholt via sr-users < sr-users@lists.kamailio.org> wrote:
Hello Alex,
indeed, this is easier to analyse with the usual system management tools.
Small addition, for TCP and TLS there is actually a distributor or main process inside Kamailio:
$ kamcmd ps |grep tcp |grep main 18439 tcp main process
$ netstat -nap |grep 5060 | grep 18439 tcp 0 0 116.203.XXX.XXX:5060 0.0.0.0:* LISTEN 18439/kamailio tcp 0 0 116.203.XXX.XXX:5060 0.0.0.0:* LISTEN 18439/kamailio tcp 0 0 127.0.0.1:5060 0.0.0.0:* LISTEN 18439/kamailio tcp6 0 0 2a01:4f8:XXXX:XXXX::5060 :::* LISTEN 18439/kamailio
Cheers,
Henning
-----Original Message----- From: Alex Balashov via sr-users sr-users@lists.kamailio.org Sent: Samstag, 4. Januar 2025 18:01 To: Kamailio (SER) - Users Mailing List sr-users@lists.kamailio.org Cc: Alex Balashov abalashov@evaristesys.com Subject: [SR-Users] Re: children monitoring
It's hard for children to introspect on and report their own busy
status, and
there's no distributor/supervisor process that has that kind of awareness about the children[1].
`ss -nl` (or `netstat` equivalent) will show you, in the RecvQ column,
the
number of packets (UDP) or connections (TCP) that are stacked up and
going
unreplied by any child. This figure should be 0 or substantially 0 if
things are
going well.
-- Alex
[1] Notwithstanding the recent 6.x change that optionally adds such a process.
On Jan 4, 2025, at 2:31 am, Sergey Safarov via sr-users <sr-
users@lists.kamailio.org> wrote:
If TCP children are busy, Please correct me if I am wrong if the remote IP is not responding via
TCP
protocol, this leads to a timeout and this child is busy.
If many remote endpoints are not reachable via TCP this can lead to
the case
when half or more children are by timeout operations.
I think required to monitor how many children are busy. Is it possible to get such info using kamcmd utility, statistics
module, or
xprom module.
Sergey __________________________________________________________ Kamailio - Users Mailing List - Non Commercial Discussions -- sr-users@lists.kamailio.org To unsubscribe send an email to sr-users-leave@lists.kamailio.org Important: keep the mailing list in the recipients, do not reply only
to the
sender!
-- Alex Balashov Principal Consultant Evariste Systems LLC Web: https://evaristesys.com Tel: +1-706-510-6800
Kamailio - Users Mailing List - Non Commercial Discussions -- sr- users@lists.kamailio.org To unsubscribe send an email to sr-users- leave@lists.kamailio.org Important: keep the mailing list in the recipients, do not reply only to
the
sender!
Kamailio - Users Mailing List - Non Commercial Discussions -- sr-users@lists.kamailio.org To unsubscribe send an email to sr-users-leave@lists.kamailio.org Important: keep the mailing list in the recipients, do not reply only to the sender!
yes, we need to check the remote SIP server's status using OPTIONS messages and TCP protocol. The children's message processing is delayed if the remote server is not reachable. For UDP children sent OPTIONS messages and forgot. But for TCP, it is required to establish a TCP connection first and then children send OPTIONS. If the remote server is not reachable the TCP connection cannot be established and OPTIONS cannot be sent and children are waiting.
On Sat, Jan 4, 2025 at 10:40 PM Arsen Semenov via sr-users < sr-users@lists.kamailio.org> wrote:
Hello,
I am just curious what is a scenario or configuration which can cause that and therefore need for such monitoring.
The remote endpoints are not SIP endpoints? Are you monitoring async_workers?
Arsen
On Sat, Jan 4, 2025 at 7:55 PM Henning Westerholt via sr-users < sr-users@lists.kamailio.org> wrote:
Hello Alex,
indeed, this is easier to analyse with the usual system management tools.
Small addition, for TCP and TLS there is actually a distributor or main process inside Kamailio:
$ kamcmd ps |grep tcp |grep main 18439 tcp main process
$ netstat -nap |grep 5060 | grep 18439 tcp 0 0 116.203.XXX.XXX:5060 0.0.0.0:* LISTEN 18439/kamailio tcp 0 0 116.203.XXX.XXX:5060 0.0.0.0:* LISTEN 18439/kamailio tcp 0 0 127.0.0.1:5060 0.0.0.0:* LISTEN 18439/kamailio tcp6 0 0 2a01:4f8:XXXX:XXXX::5060 :::* LISTEN 18439/kamailio
Cheers,
Henning
-----Original Message----- From: Alex Balashov via sr-users sr-users@lists.kamailio.org Sent: Samstag, 4. Januar 2025 18:01 To: Kamailio (SER) - Users Mailing List sr-users@lists.kamailio.org Cc: Alex Balashov abalashov@evaristesys.com Subject: [SR-Users] Re: children monitoring
It's hard for children to introspect on and report their own busy
status, and
there's no distributor/supervisor process that has that kind of
awareness
about the children[1].
`ss -nl` (or `netstat` equivalent) will show you, in the RecvQ column,
the
number of packets (UDP) or connections (TCP) that are stacked up and
going
unreplied by any child. This figure should be 0 or substantially 0 if
things are
going well.
-- Alex
[1] Notwithstanding the recent 6.x change that optionally adds such a process.
On Jan 4, 2025, at 2:31 am, Sergey Safarov via sr-users <sr-
users@lists.kamailio.org> wrote:
If TCP children are busy, Please correct me if I am wrong if the remote IP is not responding
via TCP
protocol, this leads to a timeout and this child is busy.
If many remote endpoints are not reachable via TCP this can lead to
the case
when half or more children are by timeout operations.
I think required to monitor how many children are busy. Is it possible to get such info using kamcmd utility, statistics
module, or
xprom module.
Sergey __________________________________________________________ Kamailio - Users Mailing List - Non Commercial Discussions -- sr-users@lists.kamailio.org To unsubscribe send an email to sr-users-leave@lists.kamailio.org Important: keep the mailing list in the recipients, do not reply only
to the
sender!
-- Alex Balashov Principal Consultant Evariste Systems LLC Web: https://evaristesys.com Tel: +1-706-510-6800
Kamailio - Users Mailing List - Non Commercial Discussions -- sr- users@lists.kamailio.org To unsubscribe send an email to sr-users- leave@lists.kamailio.org Important: keep the mailing list in the recipients, do not reply only
to the
sender!
Kamailio - Users Mailing List - Non Commercial Discussions -- sr-users@lists.kamailio.org To unsubscribe send an email to sr-users-leave@lists.kamailio.org Important: keep the mailing list in the recipients, do not reply only to the sender!
-- Arsenii Semenov
Kamailio - Users Mailing List - Non Commercial Discussions -- sr-users@lists.kamailio.org To unsubscribe send an email to sr-users-leave@lists.kamailio.org Important: keep the mailing list in the recipients, do not reply only to the sender!
I have modified the command and for my case, it will be like
ss -n 'dport 5060 or dport 5061 or sport 5060 or sport 5061' ss -o -n state syn-sent 'dport 5060 or dport 5061 or sport 5060 or sport 5061'
For the second command, the output will be like
[root@bcf-e-0 ~]# ss -o -n state syn-sent 'dport 5060 or dport 5061 or sport 5060 or sport 5061' Netid Recv-Q Send-Q Local Address:Port Peer Address:Port Process tcp 0 1 100.85.64.198:48542 8.8.8.8:5060 timer:(on,9.980ms,4) [root@test ~]# ss -o -n state syn-sent 'dport 5060 or dport 5061 or sport 5060 or sport 5061' Netid Recv-Q Send-Q Local Address:Port Peer Address:Port Process tcp 0 1 100.85.64.198:48542 8.8.8.8:5060 timer:(on,8.690ms,4) [root@test ~]# ss -o -n state syn-sent 'dport 5060 or dport 5061 or sport 5060 or sport 5061' Netid Recv-Q Send-Q Local Address:Port Peer Address:Port Process tcp 0 1 100.85.64.198:48542 8.8.8.8:5060 timer:(on,7.230ms,4) [root@test ~]# ss -o -n state syn-sent 'dport 5060 or dport 5061 or sport 5060 or sport 5061' Netid Recv-Q Send-Q Local Address:Port Peer Address:Port Process tcp 0 1 100.85.64.198:48542 8.8.8.8:5060 timer:(on,6.140ms,4) [root@test ~]# ss -o -n state syn-sent 'dport 5060 or dport 5061 or sport 5060 or sport 5061' Netid Recv-Q Send-Q Local Address:Port Peer Address:Port Process tcp 0 1 100.85.64.198:48542 8.8.8.8:5060 timer:(on,5.050ms,4) [root@test ~]# ss -o -n state syn-sent 'dport 5060 or dport 5061 or sport 5060 or sport 5061' Netid Recv-Q Send-Q Local Address:Port Peer Address:Port Process tcp 0 1 100.85.64.198:48542 8.8.8.8:5060 timer:(on,3.860ms,4)
On Sat, Jan 4, 2025 at 8:55 PM Henning Westerholt via sr-users < sr-users@lists.kamailio.org> wrote:
Hello Alex,
indeed, this is easier to analyse with the usual system management tools.
Small addition, for TCP and TLS there is actually a distributor or main process inside Kamailio:
$ kamcmd ps |grep tcp |grep main 18439 tcp main process
$ netstat -nap |grep 5060 | grep 18439 tcp 0 0 116.203.XXX.XXX:5060 0.0.0.0:* LISTEN 18439/kamailio tcp 0 0 116.203.XXX.XXX:5060 0.0.0.0:* LISTEN 18439/kamailio tcp 0 0 127.0.0.1:5060 0.0.0.0:* LISTEN 18439/kamailio tcp6 0 0 2a01:4f8:XXXX:XXXX::5060 :::* LISTEN 18439/kamailio
Cheers,
Henning
-----Original Message----- From: Alex Balashov via sr-users sr-users@lists.kamailio.org Sent: Samstag, 4. Januar 2025 18:01 To: Kamailio (SER) - Users Mailing List sr-users@lists.kamailio.org Cc: Alex Balashov abalashov@evaristesys.com Subject: [SR-Users] Re: children monitoring
It's hard for children to introspect on and report their own busy
status, and
there's no distributor/supervisor process that has that kind of awareness about the children[1].
`ss -nl` (or `netstat` equivalent) will show you, in the RecvQ column,
the
number of packets (UDP) or connections (TCP) that are stacked up and
going
unreplied by any child. This figure should be 0 or substantially 0 if
things are
going well.
-- Alex
[1] Notwithstanding the recent 6.x change that optionally adds such a process.
On Jan 4, 2025, at 2:31 am, Sergey Safarov via sr-users <sr-
users@lists.kamailio.org> wrote:
If TCP children are busy, Please correct me if I am wrong if the remote IP is not responding via
TCP
protocol, this leads to a timeout and this child is busy.
If many remote endpoints are not reachable via TCP this can lead to
the case
when half or more children are by timeout operations.
I think required to monitor how many children are busy. Is it possible to get such info using kamcmd utility, statistics
module, or
xprom module.
Sergey __________________________________________________________ Kamailio - Users Mailing List - Non Commercial Discussions -- sr-users@lists.kamailio.org To unsubscribe send an email to sr-users-leave@lists.kamailio.org Important: keep the mailing list in the recipients, do not reply only
to the
sender!
-- Alex Balashov Principal Consultant Evariste Systems LLC Web: https://evaristesys.com Tel: +1-706-510-6800
Kamailio - Users Mailing List - Non Commercial Discussions -- sr- users@lists.kamailio.org To unsubscribe send an email to sr-users- leave@lists.kamailio.org Important: keep the mailing list in the recipients, do not reply only to
the
sender!
Kamailio - Users Mailing List - Non Commercial Discussions -- sr-users@lists.kamailio.org To unsubscribe send an email to sr-users-leave@lists.kamailio.org Important: keep the mailing list in the recipients, do not reply only to the sender!
do you have tcp_async = yes (it should be enabled by default) ? What OS do you use? can you please print kamailio -v
On Mon, Jan 6, 2025 at 1:02 AM Sergey Safarov via sr-users < sr-users@lists.kamailio.org> wrote:
I have modified the command and for my case, it will be like
ss -n 'dport 5060 or dport 5061 or sport 5060 or sport 5061' ss -o -n state syn-sent 'dport 5060 or dport 5061 or sport 5060 or sport 5061'
For the second command, the output will be like
[root@bcf-e-0 ~]# ss -o -n state syn-sent 'dport 5060 or dport 5061 or sport 5060 or sport 5061' Netid Recv-Q Send-Q Local Address:Port Peer Address:Port Process tcp 0 1 100.85.64.198:48542 8.8.8.8:5060 timer:(on,9.980ms,4) [root@test ~]# ss -o -n state syn-sent 'dport 5060 or dport 5061 or sport 5060 or sport 5061' Netid Recv-Q Send-Q Local Address:Port Peer Address:Port Process tcp 0 1 100.85.64.198:48542 8.8.8.8:5060 timer:(on,8.690ms,4) [root@test ~]# ss -o -n state syn-sent 'dport 5060 or dport 5061 or sport 5060 or sport 5061' Netid Recv-Q Send-Q Local Address:Port Peer Address:Port Process tcp 0 1 100.85.64.198:48542 8.8.8.8:5060 timer:(on,7.230ms,4) [root@test ~]# ss -o -n state syn-sent 'dport 5060 or dport 5061 or sport 5060 or sport 5061' Netid Recv-Q Send-Q Local Address:Port Peer Address:Port Process tcp 0 1 100.85.64.198:48542 8.8.8.8:5060 timer:(on,6.140ms,4) [root@test ~]# ss -o -n state syn-sent 'dport 5060 or dport 5061 or sport 5060 or sport 5061' Netid Recv-Q Send-Q Local Address:Port Peer Address:Port Process tcp 0 1 100.85.64.198:48542 8.8.8.8:5060 timer:(on,5.050ms,4) [root@test ~]# ss -o -n state syn-sent 'dport 5060 or dport 5061 or sport 5060 or sport 5061' Netid Recv-Q Send-Q Local Address:Port Peer Address:Port Process tcp 0 1 100.85.64.198:48542 8.8.8.8:5060 timer:(on,3.860ms,4)
On Sat, Jan 4, 2025 at 8:55 PM Henning Westerholt via sr-users < sr-users@lists.kamailio.org> wrote:
Hello Alex,
indeed, this is easier to analyse with the usual system management tools.
Small addition, for TCP and TLS there is actually a distributor or main process inside Kamailio:
$ kamcmd ps |grep tcp |grep main 18439 tcp main process
$ netstat -nap |grep 5060 | grep 18439 tcp 0 0 116.203.XXX.XXX:5060 0.0.0.0:* LISTEN 18439/kamailio tcp 0 0 116.203.XXX.XXX:5060 0.0.0.0:* LISTEN 18439/kamailio tcp 0 0 127.0.0.1:5060 0.0.0.0:* LISTEN 18439/kamailio tcp6 0 0 2a01:4f8:XXXX:XXXX::5060 :::* LISTEN 18439/kamailio
Cheers,
Henning
-----Original Message----- From: Alex Balashov via sr-users sr-users@lists.kamailio.org Sent: Samstag, 4. Januar 2025 18:01 To: Kamailio (SER) - Users Mailing List sr-users@lists.kamailio.org Cc: Alex Balashov abalashov@evaristesys.com Subject: [SR-Users] Re: children monitoring
It's hard for children to introspect on and report their own busy
status, and
there's no distributor/supervisor process that has that kind of
awareness
about the children[1].
`ss -nl` (or `netstat` equivalent) will show you, in the RecvQ column,
the
number of packets (UDP) or connections (TCP) that are stacked up and
going
unreplied by any child. This figure should be 0 or substantially 0 if
things are
going well.
-- Alex
[1] Notwithstanding the recent 6.x change that optionally adds such a process.
On Jan 4, 2025, at 2:31 am, Sergey Safarov via sr-users <sr-
users@lists.kamailio.org> wrote:
If TCP children are busy, Please correct me if I am wrong if the remote IP is not responding
via TCP
protocol, this leads to a timeout and this child is busy.
If many remote endpoints are not reachable via TCP this can lead to
the case
when half or more children are by timeout operations.
I think required to monitor how many children are busy. Is it possible to get such info using kamcmd utility, statistics
module, or
xprom module.
Sergey __________________________________________________________ Kamailio - Users Mailing List - Non Commercial Discussions -- sr-users@lists.kamailio.org To unsubscribe send an email to sr-users-leave@lists.kamailio.org Important: keep the mailing list in the recipients, do not reply only
to the
sender!
-- Alex Balashov Principal Consultant Evariste Systems LLC Web: https://evaristesys.com Tel: +1-706-510-6800
Kamailio - Users Mailing List - Non Commercial Discussions -- sr- users@lists.kamailio.org To unsubscribe send an email to sr-users- leave@lists.kamailio.org Important: keep the mailing list in the recipients, do not reply only
to the
sender!
Kamailio - Users Mailing List - Non Commercial Discussions -- sr-users@lists.kamailio.org To unsubscribe send an email to sr-users-leave@lists.kamailio.org Important: keep the mailing list in the recipients, do not reply only to the sender!
Kamailio - Users Mailing List - Non Commercial Discussions -- sr-users@lists.kamailio.org To unsubscribe send an email to sr-users-leave@lists.kamailio.org Important: keep the mailing list in the recipients, do not reply only to the sender!
tcp_async is not used (not enabled) in the Kamailio configuration, but looks like this setting is enabled by default.
https://www.kamailio.org/wiki/cookbooks/5.4.x/core#tcp_async OS
[root@host ~]# cat /etc/os-release NAME="CentOS Stream" VERSION="8" ID="centos" ID_LIKE="rhel fedora" VERSION_ID="8" PLATFORM_ID="platform:el8" PRETTY_NAME="CentOS Stream 8" ANSI_COLOR="0;31" CPE_NAME="cpe:/o:centos:centos:8" HOME_URL="https://centos.org/" BUG_REPORT_URL="https://bugzilla.redhat.com/" REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
Kamailio version Here is 5.8.2 release with small customisation
[root@host ~]# kamailio -v version: kamailio 5.8.2 (aarch64/linux) 6c8b8b flags: USE_TCP, USE_TLS, USE_SCTP, TLS_HOOKS, USE_RAW_SOCKS, DISABLE_NAGLE, USE_MCAST, DNS_IP_HACK, SHM_MMAP, PKG_MALLOC, MEM_JOIN_FREE, Q_MALLOC, F_MALLOC, TLSF_MALLOC, DBG_SR_MEMORY, USE_FUTEX, FAST_LOCK-ADAPTIVE_WAIT-NOSMP, USE_DNS_CACHE, USE_DNS_FAILOVER, USE_NAPTR, USE_DST_BLOCKLIST, HAVE_RESOLV_RES, TLS_PTHREAD_MUTEX_SHARED ADAPTIVE_WAIT_LOOPS 1024, MAX_RECV_BUFFER_SIZE 262144, MAX_SEND_BUFFER_SIZE 262144, MAX_URI_SIZE 1024, BUF_SIZE 65535, DEFAULT PKG_SIZE 8MB poll method support: poll, epoll_lt, epoll_et, sigio_rt, select. id: 6c8b8b compiled on 09:10:30 Sep 12 2024 with gcc 8.5.0
On Mon, Jan 6, 2025 at 9:38 AM Arsen Semenov arsperger@gmail.com wrote:
do you have tcp_async = yes (it should be enabled by default) ? What OS do you use? can you please print kamailio -v
On Mon, Jan 6, 2025 at 1:02 AM Sergey Safarov via sr-users < sr-users@lists.kamailio.org> wrote:
I have modified the command and for my case, it will be like
ss -n 'dport 5060 or dport 5061 or sport 5060 or sport 5061' ss -o -n state syn-sent 'dport 5060 or dport 5061 or sport 5060 or sport 5061'
For the second command, the output will be like
[root@bcf-e-0 ~]# ss -o -n state syn-sent 'dport 5060 or dport 5061 or sport 5060 or sport 5061' Netid Recv-Q Send-Q Local Address:Port Peer Address:Port Process tcp 0 1 100.85.64.198:48542 8.8.8.8:5060 timer:(on,9.980ms,4) [root@test ~]# ss -o -n state syn-sent 'dport 5060 or dport 5061 or sport 5060 or sport 5061' Netid Recv-Q Send-Q Local Address:Port Peer Address:Port Process tcp 0 1 100.85.64.198:48542 8.8.8.8:5060 timer:(on,8.690ms,4) [root@test ~]# ss -o -n state syn-sent 'dport 5060 or dport 5061 or sport 5060 or sport 5061' Netid Recv-Q Send-Q Local Address:Port Peer Address:Port Process tcp 0 1 100.85.64.198:48542 8.8.8.8:5060 timer:(on,7.230ms,4) [root@test ~]# ss -o -n state syn-sent 'dport 5060 or dport 5061 or sport 5060 or sport 5061' Netid Recv-Q Send-Q Local Address:Port Peer Address:Port Process tcp 0 1 100.85.64.198:48542 8.8.8.8:5060 timer:(on,6.140ms,4) [root@test ~]# ss -o -n state syn-sent 'dport 5060 or dport 5061 or sport 5060 or sport 5061' Netid Recv-Q Send-Q Local Address:Port Peer Address:Port Process tcp 0 1 100.85.64.198:48542 8.8.8.8:5060 timer:(on,5.050ms,4) [root@test ~]# ss -o -n state syn-sent 'dport 5060 or dport 5061 or sport 5060 or sport 5061' Netid Recv-Q Send-Q Local Address:Port Peer Address:Port Process tcp 0 1 100.85.64.198:48542 8.8.8.8:5060 timer:(on,3.860ms,4)
On Sat, Jan 4, 2025 at 8:55 PM Henning Westerholt via sr-users < sr-users@lists.kamailio.org> wrote:
Hello Alex,
indeed, this is easier to analyse with the usual system management tools.
Small addition, for TCP and TLS there is actually a distributor or main process inside Kamailio:
$ kamcmd ps |grep tcp |grep main 18439 tcp main process
$ netstat -nap |grep 5060 | grep 18439 tcp 0 0 116.203.XXX.XXX:5060 0.0.0.0:* LISTEN 18439/kamailio tcp 0 0 116.203.XXX.XXX:5060 0.0.0.0:* LISTEN 18439/kamailio tcp 0 0 127.0.0.1:5060 0.0.0.0:* LISTEN 18439/kamailio tcp6 0 0 2a01:4f8:XXXX:XXXX::5060 :::* LISTEN 18439/kamailio
Cheers,
Henning
-----Original Message----- From: Alex Balashov via sr-users sr-users@lists.kamailio.org Sent: Samstag, 4. Januar 2025 18:01 To: Kamailio (SER) - Users Mailing List sr-users@lists.kamailio.org Cc: Alex Balashov abalashov@evaristesys.com Subject: [SR-Users] Re: children monitoring
It's hard for children to introspect on and report their own busy
status, and
there's no distributor/supervisor process that has that kind of
awareness
about the children[1].
`ss -nl` (or `netstat` equivalent) will show you, in the RecvQ column,
the
number of packets (UDP) or connections (TCP) that are stacked up and
going
unreplied by any child. This figure should be 0 or substantially 0 if
things are
going well.
-- Alex
[1] Notwithstanding the recent 6.x change that optionally adds such a process.
On Jan 4, 2025, at 2:31 am, Sergey Safarov via sr-users <sr-
users@lists.kamailio.org> wrote:
If TCP children are busy, Please correct me if I am wrong if the remote IP is not responding
via TCP
protocol, this leads to a timeout and this child is busy.
If many remote endpoints are not reachable via TCP this can lead to
the case
when half or more children are by timeout operations.
I think required to monitor how many children are busy. Is it possible to get such info using kamcmd utility, statistics
module, or
xprom module.
Sergey __________________________________________________________ Kamailio - Users Mailing List - Non Commercial Discussions -- sr-users@lists.kamailio.org To unsubscribe send an email to sr-users-leave@lists.kamailio.org Important: keep the mailing list in the recipients, do not reply
only to the
sender!
-- Alex Balashov Principal Consultant Evariste Systems LLC Web: https://evaristesys.com Tel: +1-706-510-6800
Kamailio - Users Mailing List - Non Commercial Discussions -- sr- users@lists.kamailio.org To unsubscribe send an email to sr-users- leave@lists.kamailio.org Important: keep the mailing list in the recipients, do not reply only
to the
sender!
Kamailio - Users Mailing List - Non Commercial Discussions -- sr-users@lists.kamailio.org To unsubscribe send an email to sr-users-leave@lists.kamailio.org Important: keep the mailing list in the recipients, do not reply only to the sender!
Kamailio - Users Mailing List - Non Commercial Discussions -- sr-users@lists.kamailio.org To unsubscribe send an email to sr-users-leave@lists.kamailio.org Important: keep the mailing list in the recipients, do not reply only to the sender!
-- Arsenii Semenov
-
Alex Balashov -
Arsen Semenov -
Henning Westerholt -
Sergey Safarov