Crashes FreeRadius 3.0.11 using rlm_rest/libcurl + rlm_cache_rbtree

[Chaigneau, Nicolas]

Hello,


Thanks for all your suggestions on this.

I'm working with Bija.

We've finally found out what was going on. The issue is an overflow of allocated memory in rlm_rest module, triggering a server abort later on.
See the issue I've opened on GitHub for the details (and a proposed fix):

https://github.com/FreeRADIUS/freeradius-server/issues/2051


We had a CRC mismatch issue with our debuginfo packages, which is why gdb refused to use them.
This is weird as these are the official debuginfo, matching the exact version of the libraries.
Anyhow, we fixed this using objcopy, as follows (example for libpthread):

# backup the library - it will be modified
cp /lib64/libpthread-2.12.so /lib64/libpthread-2.12.so.ORIG
# then modify library: remove .gnu_debuglink and add it again (with correct CRC)
objcopy -R .gnu_debuglink --add-gnu-debuglink="/usr/lib/debug/lib64/libpthread-2.12.so.debug" /lib64/libpthread-2.12.so



Regards,
Nicolas.


> 
> Thanks for your help.
> 
> Here is some update:
> 
> - We upgraded the version of FreeRADIUS to 3.0.15 version.
> - We still have the 2 bugs (crash and freeze).
> - We deactivated the rlm_cache_rbtree module. So obviously, the problem isn't there.
> 
> We built in developer mode. We have much information but still can't figure out where the problem comes from.
> Maybe because some debuginfo packages are still missing. We couldn't find the right versions of some debuginfo packages for redhat (json-c-debuginfo, libxml2-debuginfo...).
> 
> We are still working on that core dumps messages but maybe someone has any idea that may help ?
> Anyone having issues using rlm_rest or libcurl ?
> 
> Thanks !
> 
> 
> 
> 
> -----Message d'origine-----
> De : Freeradius-Users [mailto:freeradius-users-bounces+bija.ranjalahy=capgemini.com at lists.freeradius.org] De la part de Arran Cudbard-Bell Envoyé : mercredi 28 juin 2017 15:06 À : FreeRadius users mailing list Objet : Re: Crashes FreeRadius 3.0.11 using rlm_rest/libcurl + rlm_cache_rbtree
> 
> 
> > On Jun 28, 2017, at 7:09 AM, RANJALAHY RASOLOFOMANANA, Bija <bija.ranjalahy at capgemini.com> wrote:
> > 
> > Hi all,
> > 
> > We are frequently facing a crash of our freeradius server on live production environment (8 times in 2 months).
> > The crash can't be reproduced on our test environment so we need help.
> > Sometimes, we have a core dump (case 1- the server crashes), sometimes, we don't (case 2- the server freezes).
>
This message contains information that may be privileged or confidential and is the property of the Capgemini Group. It is intended only for the person to whom it is addressed. If you are not the intended recipient, you are not authorized to read, print, retain, copy, disseminate, distribute, or use this message or any part thereof. If you receive this message in error, please notify the sender immediately and delete all copies of this message.