Hi,
I am tasked to make use of blacklist module for about 4 to 6 million numbers. I am thinking of using Cassandra for the purpose but reading through the documentatiom of module and recent mailing list discussion made me a bit hesitant.
I am looking for advise on this whether this is going to perform as expected or is not even going to work with the BlackListing module !
I am using Cassandra 33x and Kamailio 4.4 over Ubuntu 14.04.
Looking for suggestions here.
Regards, Sammy
Hello,
the userblacklist module does caching in kamailio memory, so actually it doesn't seem to help much the type of the backend (apart of data distribution and loading from it).
If you want to interact with cassandra records always, maybe ndb_cassandra module can help -- iirc, it also uses newer versions of cassandra libs that db_cassandra.
I don't have experience with cassandra at all, most of the deployments I dealt with use redis for matching white/black listed numbers. Also mongdb should have some operations allowing matching by key or prefix.
Cheers, Daniel
On 11/05/16 15:22, SamyGo wrote:
Hi,
I am tasked to make use of blacklist module for about 4 to 6 million numbers. I am thinking of using Cassandra for the purpose but reading through the documentatiom of module and recent mailing list discussion made me a bit hesitant.
I am looking for advise on this whether this is going to perform as expected or is not even going to work with the BlackListing module !
I am using Cassandra 33x and Kamailio 4.4 over Ubuntu 14.04.
Looking for suggestions here.
Regards, Sammy
SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list sr-users@lists.sip-router.org http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users
Hi Daniel,
I highly appreciate your share on this, I can make use of the ndb_cassandra too, or for the matter mongodb, or redis as well.
May I ask how huge whitelists in redis is manageable, I'm looking for about 5~10 million records.
Best Regards, Sammy
On Thu, May 12, 2016 at 4:48 PM, Daniel-Constantin Mierla <miconda@gmail.com
wrote:
Hello,
the userblacklist module does caching in kamailio memory, so actually it doesn't seem to help much the type of the backend (apart of data distribution and loading from it).
If you want to interact with cassandra records always, maybe ndb_cassandra module can help -- iirc, it also uses newer versions of cassandra libs that db_cassandra. I don't have experience with cassandra at all, most of the deployments I dealt with use redis for matching white/black listed numbers. Also mongdb should have some operations allowing matching by key or prefix.
Cheers, Daniel
On 11/05/16 15:22, SamyGo wrote:
Hi,
I am tasked to make use of blacklist module for about 4 to 6 million numbers. I am thinking of using Cassandra for the purpose but reading through the documentatiom of module and recent mailing list discussion made me a bit hesitant.
I am looking for advise on this whether this is going to perform as expected or is not even going to work with the BlackListing module !
I am using Cassandra 33x and Kamailio 4.4 over Ubuntu 14.04.
Looking for suggestions here.
Regards, Sammy
SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing listsr-users@lists.sip-router.orghttp://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users
-- Daniel-Constantin Mierlahttp://www.asipto.comhttp://twitter.com/#!/miconda - http://www.linkedin.com/in/miconda Kamailio World Conference, Berlin, May 18-20, 2016 - http://www.kamailioworld.com
SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list sr-users@lists.sip-router.org http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users
Hello,
redis is capable for sure of handling that size of records. If you just keep (key, value) pairs, redis is probably the best to choose because is know to be very fast for looking up on a key.
Cheers, Daniel
On 12/05/16 22:54, SamyGo wrote:
Hi Daniel,
I highly appreciate your share on this, I can make use of the ndb_cassandra too, or for the matter mongodb, or redis as well.
May I ask how huge whitelists in redis is manageable, I'm looking for about 5~10 million records.
Best Regards, Sammy
On Thu, May 12, 2016 at 4:48 PM, Daniel-Constantin Mierla <miconda@gmail.com mailto:miconda@gmail.com> wrote:
Hello, the userblacklist module does caching in kamailio memory, so actually it doesn't seem to help much the type of the backend (apart of data distribution and loading from it). If you want to interact with cassandra records always, maybe ndb_cassandra module can help -- iirc, it also uses newer versions of cassandra libs that db_cassandra. I don't have experience with cassandra at all, most of the deployments I dealt with use redis for matching white/black listed numbers. Also mongdb should have some operations allowing matching by key or prefix. Cheers, Daniel On 11/05/16 15:22, SamyGo wrote:Hi, I am tasked to make use of blacklist module for about 4 to 6 million numbers. I am thinking of using Cassandra for the purpose but reading through the documentatiom of module and recent mailing list discussion made me a bit hesitant. I am looking for advise on this whether this is going to perform as expected or is not even going to work with the BlackListing module ! I am using Cassandra 33x and Kamailio 4.4 over Ubuntu 14.04. Looking for suggestions here. Regards, Sammy _______________________________________________ SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list sr-users@lists.sip-router.org <mailto:sr-users@lists.sip-router.org> http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users-- Daniel-Constantin Mierla http://www.asipto.com http://twitter.com/#!/miconda <http://twitter.com/#%21/miconda> - http://www.linkedin.com/in/miconda Kamailio World Conference, Berlin, May 18-20, 2016 - http://www.kamailioworld.com _______________________________________________ SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list sr-users@lists.sip-router.org <mailto:sr-users@lists.sip-router.org> http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users
Thanks again, I guess its equally easy to use cassandra or redis for this, and who knows this maybe a good experiment to test which one of the two performs better and how to improve etc.
Best Regards, Sammy
On Fri, May 13, 2016 at 2:07 AM, Daniel-Constantin Mierla <miconda@gmail.com
wrote:
Hello,
redis is capable for sure of handling that size of records. If you just keep (key, value) pairs, redis is probably the best to choose because is know to be very fast for looking up on a key.
Cheers, Daniel
On 12/05/16 22:54, SamyGo wrote:
Hi Daniel,
I highly appreciate your share on this, I can make use of the ndb_cassandra too, or for the matter mongodb, or redis as well.
May I ask how huge whitelists in redis is manageable, I'm looking for about 5~10 million records.
Best Regards, Sammy
On Thu, May 12, 2016 at 4:48 PM, Daniel-Constantin Mierla < miconda@gmail.commiconda@gmail.com> wrote:
Hello,
the userblacklist module does caching in kamailio memory, so actually it doesn't seem to help much the type of the backend (apart of data distribution and loading from it).
If you want to interact with cassandra records always, maybe ndb_cassandra module can help -- iirc, it also uses newer versions of cassandra libs that db_cassandra. I don't have experience with cassandra at all, most of the deployments I dealt with use redis for matching white/black listed numbers. Also mongdb should have some operations allowing matching by key or prefix.
Cheers, Daniel
On 11/05/16 15:22, SamyGo wrote:
Hi,
I am tasked to make use of blacklist module for about 4 to 6 million numbers. I am thinking of using Cassandra for the purpose but reading through the documentatiom of module and recent mailing list discussion made me a bit hesitant.
I am looking for advise on this whether this is going to perform as expected or is not even going to work with the BlackListing module !
I am using Cassandra 33x and Kamailio 4.4 over Ubuntu 14.04.
Looking for suggestions here.
Regards, Sammy
SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing listsr-users@lists.sip-router.orghttp://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users
-- Daniel-Constantin Mierlahttp://www.asipto.comhttp://twitter.com/#!/miconda - http://www.linkedin.com/in/miconda Kamailio World Conference, Berlin, May 18-20, 2016 - http://www.kamailioworld.com
SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list sr-users@lists.sip-router.org http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users
-- Daniel-Constantin Mierlahttp://www.asipto.comhttp://twitter.com/#!/miconda - http://www.linkedin.com/in/miconda Kamailio World Conference, Berlin, May 18-20, 2016 - http://www.kamailioworld.com
-
Daniel-Constantin Mierla -
SamyGo