Crashes FreeRadius 3.0.11 using rlm_rest/libcurl + rlm_cache_rbtree

[RANJALAHY RASOLOFOMANANA, Bija]

Thanks for your help.

Here is some update:

- We upgraded the version of FreeRADIUS to 3.0.15 version.
- We still have the 2 bugs (crash and freeze).
- We deactivated the rlm_cache_rbtree module. So obviously, the problem isn't there.

We built in developer mode. We have much information but still can't figure out where the problem comes from.
Maybe because some debuginfo packages are still missing. We couldn't find the right versions of some debuginfo packages for redhat (json-c-debuginfo, libxml2-debuginfo...).

We are still working on that core dumps messages but maybe someone has any idea that may help ?
Anyone having issues using rlm_rest or libcurl ?

Thanks !




-----Message d'origine-----
De : Freeradius-Users [mailto:freeradius-users-bounces+bija.ranjalahy=capgemini.com at lists.freeradius.org] De la part de Arran Cudbard-Bell
Envoyé : mercredi 28 juin 2017 15:06
À : FreeRadius users mailing list
Objet : Re: Crashes FreeRadius 3.0.11 using rlm_rest/libcurl + rlm_cache_rbtree


> On Jun 28, 2017, at 7:09 AM, RANJALAHY RASOLOFOMANANA, Bija <bija.ranjalahy at capgemini.com> wrote:
> 
> Hi all,
> 
> We are frequently facing a crash of our freeradius server on live production environment (8 times in 2 months).
> The crash can't be reproduced on our test environment so we need help.
> Sometimes, we have a core dump (case 1- the server crashes), sometimes, we don't (case 2- the server freezes).
> Unfortunately, the core dumps don't provide useful informations:
> Here are examples of the core dumps :
> core 1:
> #0  0x00000034b680f5db in ?? ()
> #1  0x00007fa718d066c6 in ?? ()
> #2  0x0000000000000000 in ?? ()
> 
> core 2:
> #0  0x00000034b680f5db in ?? ()
> #1  0x00007f169f94e6c6 in ?? ()
> #2  0x0000000000000000 in ?? ()
> 
> 
> Freeradius version : 3.0.11
> Context : our server sends REST request to a http server to retrieve data which are then stored in a cache during 1 hour.
> The problem started when we added this feature.
> 
> Leads :
> 1- The server logs all http requests that are sent.
>   Somehow, the line log is truncated when the problem appears. Maybe, it is just a coincidence but we are suspecting this part.
>   We use the rlm_rest module + libcurl to make our requests.
> 
>   Have you encountered a problem using those module/library ?
>   We tried to upgrade libcurl from 7.50.3 to 7.54.0 but this doesn't fix the problem.
> 
> 2- In the case 2 (the server freezes), we've got the following message in our log files:
>   Mon Jun 26 22:00:31 2017 : Error: (10180900) Ignoring duplicate packet from client xxx port 21665 - ID: 164 due to unfinished request in component authorize module <our cache module>
> 
>   Our cache module is based on the rlm_cache_rbtree module:
>   cache <cache name> {
>        driver = "rlm_cache_rbtree"
> 
>   Have you encountered a problem using rlm_cache_rbtree module ?

Sounds like a double locking issue in rlm_cache_rbtree.

Upgrade to 3.0.14.  If that doesn't work install the debuginfo packages for libcurl, and build with server --with-developer so the debug symbols don't get stripped.

-Arran
This message contains information that may be privileged or confidential and is the property of the Capgemini Group. It is intended only for the person to whom it is addressed. If you are not the intended recipient, you are not authorized to read, print, retain, copy, disseminate, distribute, or use this message or any part thereof. If you receive this message in error, please notify the sender immediately and delete all copies of this message.