FreeRadius crashed on accounting load tests with 1000 concurrent clients

[Dinh Pham Cong]

Hi all,

I am using FreeRADIUS Version 2.1.7, CentOS 5.3 64 bit, MySQL 5.0.77 (max
connections 3000) on a 16-core, 16GB RAM server. This is my radiusd.conf

max_request_time = 10
cleanup_delay = 5
max_requests = 5120

start_servers = 1024
max_servers = 3000
max_spare_servers = 3000
max_requests_per_server = 0

My sql.conf

# number of sql connections to make to server
num_sql_socks = 1000

I developed a Java client that can create 1000 concurrent threads that
connect and send accounting requests (start and stop) to Radius server.
However, after sending for 20 or 30 seconds, radius server generated a lot
of error messages and crashed

Error messages

Tue Nov 10 16:14:34 2009 : Error: Discarding duplicate request from client
tester1 port 41442 - ID: 134 due to unfinished request 2436
Tue Nov 10 16:14:34 2009 : Error: Discarding duplicate request from client
tester1 port 38970 - ID: 150 due to unfinished request 2452
Tue Nov 10 16:14:34 2009 : Error: Discarding duplicate request from client
tester1 port 50783 - ID: 156 due to unfinished request 2458
Tue Nov 10 16:14:34 2009 : Error: Discarding duplicate request from client
tester1 port 60038 - ID: 162 due to unfinished request 2464
Tue Nov 10 16:14:34 2009 : Error: Discarding duplicate request from client
tester1 port 59541 - ID: 191 due to unfinished request 2493
Tue Nov 10 16:14:34 2009 : Error: Discarding duplicate request from client
tester1 port 59858 - ID: 205 due to unfinished request 2507
Tue Nov 10 16:14:34 2009 : Error: Discarding duplicate request from client
tester1 port 45654 - ID: 220 due to unfinished request 2522
Tue Nov 10 16:14:34 2009 : Error: Discarding duplicate request from client
tester1 port 59464 - ID: 229 due to unfinished request 2531
Tue Nov 10 16:14:34 2009 : Error: Discarding duplicate request from client
tester1 port 57658 - ID: 240 due to unfinished request 2542
Tue Nov 10 16:14:34 2009 : Error: Discarding duplicate request from client
tester1 port 33253 - ID: 71 due to unfinished request 2629
Tue Nov 10 16:14:34 2009 : Error: Discarding duplicate request from client
tester1 port 54171 - ID: 105 due to unfinished request 2663
Tue Nov 10 16:14:34 2009 : Error: Discarding duplicate request from client
tester1 port 41039 - ID: 176 due to unfinished request 2734
Tue Nov 10 16:14:34 2009 : Error: Discarding duplicate request from client
tester1 port 53611 - ID: 199 due to unfinished request 2757
Tue Nov 10 16:14:34 2009 : Error: Discarding duplicate request from client
tester1 port 58608 - ID: 208 due to unfinished request 2766
Tue Nov 10 16:14:36 2009 : Error: Discarding duplicate request from client
tester1 port 33814 - ID: 171 due to unfinished request 4521
Tue Nov 10 16:14:36 2009 : Info: rlm_sql_mysql: Starting connect to MySQL
server for #942
Tue Nov 10 16:14:36 2009 : Error: Discarding duplicate request from client
tester1 port 54081 - ID: 187 due to unfinished request 4537
Tue Nov 10 16:14:36 2009 : Info: rlm_sql_mysql: Starting connect to MySQL
server for #926
Tue Nov 10 16:14:36 2009 : Info: rlm_sql_mysql: Starting connect to MySQL
server for #913
Tue Nov 10 16:14:36 2009 : Error: rlm_sql_mysql: Socket not connected
Tue Nov 10 16:14:36 2009 : Error: rlm_sql_mysql: Socket not connected

Crashed

Nov 10 15:55:35 Mobile6 kernel: radiusd[22242]: segfault at 00000000000000c8
rip 0000003daee5306b rsp 00002aae5d82a780 error 4
Nov 10 15:57:29 Mobile6 kernel: radiusd[30941]: segfault at 00000000000000c8
rip 0000003daee5306b rsp 00002aaee56de180 error 4
Nov 10 16:14:36 Mobile kernel: radiusd[10788]: segfault at 00000000000000c8
rip 0000003daee5306b rsp 00002aac913de780 error 4

What do I need to do to enable FreeRadius server to meet more than 1000
accounting request (INSERT AND DELETE) for a second?

Thanks,

Dinh
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.freeradius.org/pipermail/freeradius-users/attachments/20091110/5ae5bd6c/attachment.html>