Version 1.1.1 stops responding
So I built 1.1.1 on Debian. After a period of so many hours (variable) it stops responding. (Sometimes 2hours, sometimes 16hours) Now here's where it get's weird, (and makes me suspect it might not be freeRADIUS at the root cause) If I stop and restart the freeRADIUS service, it continues to ignore RADIUS packets. But if I restart the server (hard reboot) it works fine. Till it stops responding again. Obviously this is not enough information to help you diagnose the problem. How do I gather that information? The box is a 233 Pentium with 64 megs of ram. Has about 15 AP's, with around 100 users (not simultaneous, maybe 30 simultaneous) So what's the suggested way of gathering more info? Running debug mode piping to a text file?
On Thu, 2006-03-23 at 09:24 -0500, King, Michael wrote:
So I built 1.1.1 on Debian.
After a period of so many hours (variable) it stops responding. (Sometimes 2hours, sometimes 16hours)
Now here's where it get's weird, (and makes me suspect it might not be freeRADIUS at the root cause)
If I stop and restart the freeRADIUS service, it continues to ignore RADIUS packets.
I am seeing a similar problem on RedHat. I originally thought it was only happening when I sent a HUP signal, but it turns out this is not the case. However in my case all I have to do to fix it is restart the service (I do not need to reboot the entire operating system). Ben
Hi,
I am seeing a similar problem on RedHat. I originally thought it was only happening when I sent a HUP signal, but it turns out this is not the case.
However in my case all I have to do to fix it is restart the service (I do not need to reboot the entire operating system).
for the record: this happened to me *once* as well (SuSE 8.2). That coincided with an access point crashing in the middle of an authentication, so I thought it might just be that the AP sent a very weird packet while dieing. Really strange symptoms... radiusd and all its threads are running, and bound to the port they should, but no indication of a received packet. Re-starting the service did the trick for me as well. Greetings, Stefan Winter -- Stefan WINTER Stiftung RESTENA - Réseau Téléinformatique de l'Education Nationale et de la Recherche Ingenieur Forschung & Entwicklung 6, rue Richard Coudenhove-Kalergi L-1359 Luxembourg E-Mail: stefan.winter@restena.lu Tel.: +352 424409-1 http://www.restena.lu Fax: +352 422473
I'm seeing the same thing here with 1.1.1. I have 2 servers with identical hardware/software configs. Both servers "hang" at the same time. stopping/starting the daemon doesn't resolve the issue, rebooting the box does. I was assuming it had something to do with the sql module because that is where it paused (see: sql hangs, was (conflicts/duplicates need)) ----- Original Message ----- From: "King, Michael" <MKing@bridgew.edu> To: "FreeRadius users mailing list" <freeradius-users@lists.freeradius.org> Sent: Thursday, March 23, 2006 9:24 AM Subject: Version 1.1.1 stops responding
So I built 1.1.1 on Debian.
After a period of so many hours (variable) it stops responding. (Sometimes 2hours, sometimes 16hours)
Now here's where it get's weird, (and makes me suspect it might not be freeRADIUS at the root cause)
If I stop and restart the freeRADIUS service, it continues to ignore RADIUS packets.
But if I restart the server (hard reboot) it works fine. Till it stops responding again.
Obviously this is not enough information to help you diagnose the problem. How do I gather that information?
The box is a 233 Pentium with 64 megs of ram. Has about 15 AP's, with around 100 users (not simultaneous, maybe 30 simultaneous)
So what's the suggested way of gathering more info? Running debug mode piping to a text file?
- List info/subscribe/unsubscribe? See http://www.freeradius.org/list/users.html
"Duane Cox" <duanec@mail.illicom.net> wrote:
I have 2 servers with identical hardware/software configs. Both servers "hang" at the same time.
stopping/starting the daemon doesn't resolve the issue, rebooting the box does.
That's fairly bad. I'm not sure how something in the application layer could cause that. Maybe an OS issue? But then why would *both* boxes hand at the *same* time?
I was assuming it had something to do with the sql module because that is where it paused (see: sql hangs, was (conflicts/duplicates need))
Maybe a wider network issue? I'm just guessing here... Alan DeKok.
On Apr 9, 2006, at 17:46, Alan DeKok wrote:
"Duane Cox" <duanec@mail.illicom.net> wrote:
I have 2 servers with identical hardware/software configs. Both servers "hang" at the same time.
stopping/starting the daemon doesn't resolve the issue, rebooting the box does.
That's fairly bad. I'm not sure how something in the application layer could cause that. Maybe an OS issue? But then why would *both* boxes hand at the *same* time?
I was assuming it had something to do with the sql module because that is where it paused (see: sql hangs, was (conflicts/duplicates need))
Maybe a wider network issue?
I'm just guessing here...
Check the times very closely. They may be 10 seconds apart. I had a problem with a module that was crashing. The first request took out the primary server and then when it didn't respond, 10 seconds later it tried the backup and crashed it also.
Hi,
I have 2 servers with identical hardware/software configs. Both servers "hang" at the same time.
stopping/starting the daemon doesn't resolve the issue, rebooting the box does.
Well, in my case the server doesn't respond to a normal kill, so the start/stop scripts indeed wouldn't do the job. Have you tried killing it it with "kill -SIGKILL" instead of the init scripts?
I was assuming it had something to do with the sql module because that is where it paused (see: sql hangs, was (conflicts/duplicates need))
For me it's also somewhere within sql. I will run our server in valgrind this morning, as Alan suggested elsewhere in the thread. I hope it will be responsive enough so I can keep it running for a few hours until the error eventually occurs... Greetings, Stefan -- Stefan WINTER RESTENA Foundation - Réseau Téléinformatique de l'Education Nationale et de la Recherche R&D Engineer 6, rue Richard Coudenhove-Kalergi L-1359 Luxembourg email: stefan.winter@restena.lu Tel.: +352 424409-1 http://www.restena.lu Fax: +352 422473
My problem may indeed be with my init scripts, I'll look into that and verify the status of the daemon. And for the record, what I mean by "hang" is that the server doesn't segfault or coredump, it just pauses processing data... Give the server 30 seconds, or maybe even 2-3 minutes, then it will start processing packets again. If you can catch the server during this act and look at the debug, you can see that the sql module has hung. Now I don't know if this is the cause or the effect, maybe it means something to someone, I don't know. I am going to attempt to load some previous versoins on the secondary server to see if I can alleviate or pinpoint the problem. Thanks for the feedback. ----- Original Message ----- From: "Stefan Winter" <stefan.winter@restena.lu> To: "FreeRadius users mailing list" <freeradius-users@lists.freeradius.org> Sent: Monday, April 10, 2006 1:13 AM Subject: Re: Version 1.1.1 stops responding
Hi,
I have 2 servers with identical hardware/software configs. Both servers "hang" at the same time.
stopping/starting the daemon doesn't resolve the issue, rebooting the box does.
Well, in my case the server doesn't respond to a normal kill, so the start/stop scripts indeed wouldn't do the job. Have you tried killing it it with "kill -SIGKILL" instead of the init scripts?
I was assuming it had something to do with the sql module because that is where it paused (see: sql hangs, was (conflicts/duplicates need))
For me it's also somewhere within sql. I will run our server in valgrind this morning, as Alan suggested elsewhere in the thread. I hope it will be responsive enough so I can keep it running for a few hours until the error eventually occurs...
Greetings,
Stefan
-- Stefan WINTER
RESTENA Foundation - Réseau Téléinformatique de l'Education Nationale et de la Recherche R&D Engineer
6, rue Richard Coudenhove-Kalergi L-1359 Luxembourg email: stefan.winter@restena.lu Tel.: +352 424409-1 http://www.restena.lu Fax: +352 422473
- List info/subscribe/unsubscribe? See http://www.freeradius.org/list/users.html
This definitely sounds like a problem with either your database server or your firewall. Most likely culprit is the firewall.. -Peter On Mon 10 Apr 2006 13:43, Duane Cox wrote:
My problem may indeed be with my init scripts, I'll look into that and verify the status of the daemon.
And for the record, what I mean by "hang" is that the server doesn't segfault or coredump, it just pauses processing data... Give the server 30 seconds, or maybe even 2-3 minutes, then it will start processing packets again.
If you can catch the server during this act and look at the debug, you can see that the sql module has hung. Now I don't know if this is the cause or the effect, maybe it means something to someone, I don't know.
I am going to attempt to load some previous versoins on the secondary server to see if I can alleviate or pinpoint the problem.
Thanks for the feedback.
----- Original Message ----- From: "Stefan Winter" <stefan.winter@restena.lu> To: "FreeRadius users mailing list" <freeradius-users@lists.freeradius.org> Sent: Monday, April 10, 2006 1:13 AM Subject: Re: Version 1.1.1 stops responding
Hi,
I have 2 servers with identical hardware/software configs. Both servers "hang" at the same time.
stopping/starting the daemon doesn't resolve the issue, rebooting the
box
does.
Well, in my case the server doesn't respond to a normal kill, so the start/stop scripts indeed wouldn't do the job. Have you tried killing it
it
with "kill -SIGKILL" instead of the init scripts?
I was assuming it had something to do with the sql module because that
is
where it paused (see: sql hangs, was (conflicts/duplicates need))
For me it's also somewhere within sql. I will run our server in valgrind
this
morning, as Alan suggested elsewhere in the thread. I hope it will be responsive enough so I can keep it running for a few hours until the error eventually occurs...
Greetings,
Stefan
-- Stefan WINTER
RESTENA Foundation - Réseau Téléinformatique de l'Education Nationale et
de
la Recherche R&D Engineer
6, rue Richard Coudenhove-Kalergi L-1359 Luxembourg email: stefan.winter@restena.lu Tel.: +352 424409-1 http://www.restena.lu Fax: +352 422473
- List info/subscribe/unsubscribe? See
http://www.freeradius.org/list/users.html
- List info/subscribe/unsubscribe? See http://www.freeradius.org/list/users.html
-- Peter Nixon http://www.peternixon.net/ PGP Key: http://www.peternixon.net/public.asc
participants (7)
-
Alan DeKok -
Ben Thompson -
Doug Hardie -
Duane Cox -
King, Michael -
Peter Nixon -
Stefan Winter