freeradius load and message handling
Hi, we have a freeradius server collecting accounting events from a few Nokia GGSN’s and are storing them into the MySQL DB. Now that we have activated all messages we are receiving around 20K messages a minute, and have started seeing these events in the radius.log Tue Jun 14 22:53:33 2016 : Info: WARNING: Please check the configuration file. The value for 'max_requests' is probably set too low. it was originally set to 1024, when we increased it and set it to 4096 the amount of such events was reduced but still didn’t disappear. If we set it higher (6100 for example) we start getting these errors Tue Jun 14 21:30:02 2016 : Error: Received conflicting packet from client localhost port 41935 - ID: 200 due to unfinished request 192178. Giving up on old request. why does this event appear? what would be the best way to manage this situation? The server has 8 Cores and 4GB of RAM. It seems that the CPU isn’t overly loaded, but our RAM is almost completely used by the Radius and Mysql processes. Will adding RAM to this server help us? or isn’t it the bottleneck for this issue? Thanks Liran
On Jun 14, 2016, at 4:00 PM, liran kessel <lirankessel@gmail.com> wrote:
Hi,
we have a freeradius server collecting accounting events from a few Nokia GGSN’s and are storing them into the MySQL DB.
Now that we have activated all messages we are receiving around 20K messages a minute, and have started seeing these events in the radius.log
Tue Jun 14 22:53:33 2016 : Info: WARNING: Please check the configuration file. The value for 'max_requests' is probably set too low.
it was originally set to 1024, when we increased it and set it to 4096 the amount of such events was reduced but still didn’t disappear. If we set it higher (6100 for example) we start getting these errors
Tue Jun 14 21:30:02 2016 : Error: Received conflicting packet from client localhost port 41935 - ID: 200 due to unfinished request 192178. Giving up on old request.
why does this event appear? what would be the best way to manage this situation?
The server has 8 Cores and 4GB of RAM. It seems that the CPU isn’t overly loaded, but our RAM is almost completely used by the Radius and Mysql processes.
Use version 4.0 (in about three months time), or get a faster database. -Arran
so this is happening cause of the speed that it takes to write to MySQL? How wil version 4.0 help me with this?
On 14 Jun 2016, at 11:04 PM, Arran Cudbard-Bell <a.cudbardb@freeradius.org> wrote:
On Jun 14, 2016, at 4:00 PM, liran kessel <lirankessel@gmail.com> wrote:
Hi,
we have a freeradius server collecting accounting events from a few Nokia GGSN’s and are storing them into the MySQL DB.
Now that we have activated all messages we are receiving around 20K messages a minute, and have started seeing these events in the radius.log
Tue Jun 14 22:53:33 2016 : Info: WARNING: Please check the configuration file. The value for 'max_requests' is probably set too low.
it was originally set to 1024, when we increased it and set it to 4096 the amount of such events was reduced but still didn’t disappear. If we set it higher (6100 for example) we start getting these errors
Tue Jun 14 21:30:02 2016 : Error: Received conflicting packet from client localhost port 41935 - ID: 200 due to unfinished request 192178. Giving up on old request.
why does this event appear? what would be the best way to manage this situation?
The server has 8 Cores and 4GB of RAM. It seems that the CPU isn’t overly loaded, but our RAM is almost completely used by the Radius and Mysql processes.
Use version 4.0 (in about three months time), or get a faster database.
-Arran
- List info/subscribe/unsubscribe? See http://www.freeradius.org/list/users.html
On Jun 14, 2016, at 4:00 PM, liran kessel <lirankessel@gmail.com> wrote:
we have a freeradius server collecting accounting events from a few Nokia GGSN’s and are storing them into the MySQL DB.
Now that we have activated all messages we are receiving around 20K messages a minute, and have started seeing these events in the radius.log
Tue Jun 14 22:53:33 2016 : Info: WARNING: Please check the configuration file. The value for 'max_requests' is probably set too low.
it was originally set to 1024, when we increased it and set it to 4096 the amount of such events was reduced but still didn’t disappear. If we set it higher (6100 for example) we start getting these errors
Tue Jun 14 21:30:02 2016 : Error: Received conflicting packet from client localhost port 41935 - ID: 200 due to unfinished request 192178. Giving up on old request.
why does this event appear? what would be the best way to manage this situation?
It appears because your database is overloaded. It can't write the records quickly enough.
The server has 8 Cores and 4GB of RAM. It seems that the CPU isn’t overly loaded, but our RAM is almost completely used by the Radius and Mysql processes.
Will adding RAM to this server help us? or isn’t it the bottleneck for this issue?
The bottleneck is the database. Typically it's waiting on "sync to disk". And there's very little you can do about that. Alan DeKok.
Can the Freeradius be configured to cache data and write to DB in batches? I could possibly stop writing to Mysql and logging the data to file, then parse the log files and load them to DB at a latter stage. Thanks
On 14 Jun 2016, at 11:48 PM, Alan DeKok <aland@deployingradius.com> wrote:
On Jun 14, 2016, at 4:00 PM, liran kessel <lirankessel@gmail.com> wrote:
we have a freeradius server collecting accounting events from a few Nokia GGSN’s and are storing them into the MySQL DB.
Now that we have activated all messages we are receiving around 20K messages a minute, and have started seeing these events in the radius.log
Tue Jun 14 22:53:33 2016 : Info: WARNING: Please check the configuration file. The value for 'max_requests' is probably set too low.
it was originally set to 1024, when we increased it and set it to 4096 the amount of such events was reduced but still didn’t disappear. If we set it higher (6100 for example) we start getting these errors
Tue Jun 14 21:30:02 2016 : Error: Received conflicting packet from client localhost port 41935 - ID: 200 due to unfinished request 192178. Giving up on old request.
why does this event appear? what would be the best way to manage this situation?
It appears because your database is overloaded. It can't write the records quickly enough.
The server has 8 Cores and 4GB of RAM. It seems that the CPU isn’t overly loaded, but our RAM is almost completely used by the Radius and Mysql processes.
Will adding RAM to this server help us? or isn’t it the bottleneck for this issue?
The bottleneck is the database. Typically it's waiting on "sync to disk". And there's very little you can do about that.
Alan DeKok. - List info/subscribe/unsubscribe? See http://www.freeradius.org/list/users.html
On Jun 14, 2016, at 5:15 PM, liran kessel <lirankessel@gmail.com> wrote:
Can the Freeradius be configured to cache data and write to DB in batches?
Not really. You can write to a log files and run run radsqlrelay, which comes with the server. But it misses much of the logic that the server has for merging RADIUS packets into existing SQL rows. The short answer is to disable sync on the database. Alan DeKok.
How would I do that? And what would the effect of it be on my data? Thanks for all the help via CloudMagic Email [https://cloudmagic.com/k/d/mailapp?ct=pa&cv=8.5.43&pv=5.0.2&source=email_foo...] On Wed, Jun 15, 2016 at 12:24 AM, Alan DeKok < aland@deployingradius.com [aland@deployingradius.com] > wrote: On Jun 14, 2016, at 5:15 PM, liran kessel <lirankessel@gmail.com> wrote:
Can the Freeradius be configured to cache data and write to DB in
batches? Not really. You can write to a log files and run run radsqlrelay, which comes with the server. But it misses much of the logic that the server has for merging RADIUS packets into existing SQL rows. The short answer is to disable sync on the database. Alan DeKok. - List info/subscribe/unsubscribe? See http://www.freeradius.org/list/users.html
On Jun 14, 2016, at 5:26 PM, liran kessel <lirankessel@gmail.com> wrote:
How would I do that? And what would the effect of it be on my data?
See your database documentation. This is the FreeRADIUS list. We can't answer every question about every piece of software. At some point, you have to consult the documentation for the other software. Alan DeKok.
participants (3)
-
Alan DeKok -
Arran Cudbard-Bell -
liran kessel