Alan, I am testing PAP authentication. I am following the performance-testing document but achieving not more than 125 auths/sec for 1000users. Any extra configuration to be done to get 50k auths/sec? Regards, Tejesh ________________________________________ From: freeradius-devel-bounces+tejesh.vijayakumar=lntinfotech.com@lists.freeradius.org [freeradius-devel-bounces+tejesh.vijayakumar=lntinfotech.com@lists.freeradius.org] On Behalf Of Alan DeKok [aland@deployingradius.com] Sent: Wednesday, December 23, 2009 6:04 PM To: FreeRadius developers mailing list Subject: Re: How to improve Radius Performance Tejesh Vijayakumar wrote:

I want to achieve around 5000 auths/sec with FreeRadius version 2.1.7. Currently I am able to achieve only 125 auths/sec with a PentiumIV 3Ghz single core 512 mb RAM machine. I am using just the users file with two users.

You have *not* said what authentication method you are using.

Can I improve radius performance using same machine or What is the preferable system configuration to achieve 5000 auths/sec?

For PAP, the server can do 50K auth/s in a normal configuration. Alan DeKok. - List info/subscribe/unsubscribe? See http://www.freeradius.org/list/devel.html ______________________________________________________________________ This Email may contain confidential or privileged information for the intended recipient (s) If you are not the intended recipient, please do not use or disseminate the information, notify the sender and delete it from your system. ______________________________________________________________________

Alan, I have followed the procedure as below.. 1) ./configure , make and make install for FreeRadiius Installation. 2) Added the below line in users file test Auth-Type := pap, Cleartext-Password := "test" 3) Tested the performance by modifying create-users script and time command. Pls advise if i have missed out anything to achieve more/normal auths/sec Regards, tejesh ________________________________________ From: freeradius-devel-bounces+tejesh.vijayakumar=lntinfotech.com@lists.freeradius.org [freeradius-devel-bounces+tejesh.vijayakumar=lntinfotech.com@lists.freeradius.org] On Behalf Of Alan DeKok [aland@deployingradius.com] Sent: Wednesday, December 23, 2009 7:38 PM To: FreeRadius developers mailing list Subject: Re: How to improve Radius Performance Tejesh Vijayakumar wrote:

I am testing PAP authentication. I am following the performance-testing document but achieving not more than 125 auths/sec for 1000users.

Well... something is broken in your configuration.

Any extra configuration to be done to get 50k auths/sec?

No. The default configuration works, and should be able to do at least 10K auth/s on normal hardware. Alan DeKok. - List info/subscribe/unsubscribe? See http://www.freeradius.org/list/devel.html ______________________________________________________________________ This Email may contain confidential or privileged information for the intended recipient (s) If you are not the intended recipient, please do not use or disseminate the information, notify the sender and delete it from your system. ______________________________________________________________________

Alan, I used the radclient on localhost. "time /usr/local/bin/radclient -q -s -f radius.test localhost auth testing123" The output of this command for 10000 users was: Total approved auths: 10000 Total denied auths: 0 Total lost auths: 0 real 1m55.536s user 0m28.046s sys 1m12.682s Also i have commented 'unix' in raddb/sites-available/default file. Have attached the log below. Pls Note: The log is not complete for 10000 users. Just pasted log for few users getting authenticated. radiusd -X FreeRADIUS Version 2.1.7, for host i686-pc-linux-gnu, built on Dec 24 2009 at 10:10:56 Copyright (C) 1999-2009 The FreeRADIUS server project and contributors. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. You may redistribute copies of FreeRADIUS under the terms of the GNU General Public License v2. Starting - reading configuration files ... including configuration file /usr/local/etc/raddb/radiusd.conf including configuration file /usr/local/etc/raddb/proxy.conf including configuration file /usr/local/etc/raddb/clients.conf including files in directory /usr/local/etc/raddb/modules/ including configuration file /usr/local/etc/raddb/modules/otp including configuration file /usr/local/etc/raddb/modules/etc_group including configuration file /usr/local/etc/raddb/modules/radutmp including configuration file /usr/local/etc/raddb/modules/ippool including configuration file /usr/local/etc/raddb/modules/sradutmp including configuration file /usr/local/etc/raddb/modules/smsotp including configuration file /usr/local/etc/raddb/modules/always including configuration file /usr/local/etc/raddb/modules/mac2vlan including configuration file /usr/local/etc/raddb/modules/detail.log including configuration file /usr/local/etc/raddb/modules/mac2ip including configuration file /usr/local/etc/raddb/modules/echo including configuration file /usr/local/etc/raddb/modules/policy including configuration file /usr/local/etc/raddb/modules/unix including configuration file /usr/local/etc/raddb/modules/expiration including configuration file /usr/local/etc/raddb/modules/checkval including configuration file /usr/local/etc/raddb/modules/cui including configuration file /usr/local/etc/raddb/modules/attr_rewrite including configuration file /usr/local/etc/raddb/modules/krb5 including configuration file /usr/local/etc/raddb/modules/counter including configuration file /usr/local/etc/raddb/modules/pap including configuration file /usr/local/etc/raddb/modules/pam including configuration file /usr/local/etc/raddb/modules/detail including configuration file /usr/local/etc/raddb/modules/perl including configuration file /usr/local/etc/raddb/modules/digest including configuration file /usr/local/etc/raddb/modules/sql_log including configuration file /usr/local/etc/raddb/modules/detail.example.com including configuration file /usr/local/etc/raddb/modules/expr including configuration file /usr/local/etc/raddb/modules/exec including configuration file /usr/local/etc/raddb/modules/attr_filter including configuration file /usr/local/etc/raddb/modules/inner-eap including configuration file /usr/local/etc/raddb/modules/files including configuration file /usr/local/etc/raddb/modules/realm including configuration file /usr/local/etc/raddb/modules/smbpasswd including configuration file /usr/local/etc/raddb/modules/ldap including configuration file /usr/local/etc/raddb/modules/logintime including configuration file /usr/local/etc/raddb/modules/mschap including configuration file /usr/local/etc/raddb/modules/sqlcounter_expire_on_login including configuration file /usr/local/etc/raddb/modules/wimax including configuration file /usr/local/etc/raddb/modules/chap including configuration file /usr/local/etc/raddb/modules/preprocess including configuration file /usr/local/etc/raddb/modules/linelog including configuration file /usr/local/etc/raddb/modules/passwd including configuration file /usr/local/etc/raddb/modules/acct_unique including configuration file /usr/local/etc/raddb/eap.conf including configuration file /usr/local/etc/raddb/policy.conf including files in directory /usr/local/etc/raddb/sites-enabled/ including configuration file /usr/local/etc/raddb/sites-enabled/control-socket including configuration file /usr/local/etc/raddb/sites-enabled/inner-tunnel including configuration file /usr/local/etc/raddb/sites-enabled/default including dictionary file /usr/local/etc/raddb/dictionary main { prefix = "/usr/local" localstatedir = "/usr/local/var" logdir = "/usr/local/var/log/radius" libdir = "/usr/local/lib" radacctdir = "/usr/local/var/log/radius/radacct" hostname_lookups = no max_request_time = 30 cleanup_delay = 5 max_requests = 1024 allow_core_dumps = no pidfile = "/usr/local/var/run/radiusd/radiusd.pid" checkrad = "/usr/local/sbin/checkrad" debug_level = 0 proxy_requests = yes log { stripped_names = no auth = no auth_badpass = no auth_goodpass = no } security { max_attributes = 200 reject_delay = 1 status_server = yes } } radiusd: #### Loading Realms and Home Servers #### proxy server { retry_delay = 5 retry_count = 3 default_fallback = no dead_time = 120 wake_all_if_all_dead = no } home_server localhost { ipaddr = 127.0.0.1 port = 1812 type = "auth" secret = "testing123" response_window = 20 max_outstanding = 65536 require_message_authenticator = no zombie_period = 40 status_check = "status-server" ping_interval = 30 check_interval = 30 num_answers_to_alive = 3 num_pings_to_alive = 3 revive_interval = 120 status_check_timeout = 4 irt = 2 mrt = 16 mrc = 5 mrd = 30 } home_server_pool my_auth_failover { type = fail-over home_server = localhost } realm example.com { auth_pool = my_auth_failover } realm LOCAL { } radiusd: #### Loading Clients #### client localhost { ipaddr = 127.0.0.1 require_message_authenticator = no secret = "testing123" nastype = "other" } radiusd: #### Instantiating modules #### instantiate { Module: Linked to module rlm_exec Module: Instantiating exec exec { wait = no input_pairs = "request" shell_escape = yes } Module: Linked to module rlm_expr Module: Instantiating expr Module: Linked to module rlm_expiration Module: Instantiating expiration expiration { reply-message = "Password Has Expired " } Module: Linked to module rlm_logintime Module: Instantiating logintime logintime { reply-message = "You are calling outside your allowed timespan " minimum-timeout = 60 } } radiusd: #### Loading Virtual Servers #### server inner-tunnel { modules { Module: Checking authenticate {...} for more modules to load Module: Linked to module rlm_pap Module: Instantiating pap pap { encryption_scheme = "auto" auto_header = no } Module: Linked to module rlm_chap Module: Instantiating chap Module: Linked to module rlm_mschap Module: Instantiating mschap mschap { use_mppe = yes require_encryption = no require_strong = no with_ntdomain_hack = no } Module: Linked to module rlm_unix Module: Instantiating unix unix { radwtmp = "/usr/local/var/log/radius/radwtmp" } Module: Linked to module rlm_eap Module: Instantiating eap eap { default_eap_type = "md5" timer_expire = 60 ignore_unknown_eap_types = no cisco_accounting_username_bug = no max_sessions = 2048 } Module: Linked to sub-module rlm_eap_md5 Module: Instantiating eap-md5 Module: Linked to sub-module rlm_eap_leap Module: Instantiating eap-leap Module: Linked to sub-module rlm_eap_gtc Module: Instantiating eap-gtc gtc { challenge = "Password: " auth_type = "PAP" } Module: Linked to sub-module rlm_eap_tls Module: Instantiating eap-tls tls { rsa_key_exchange = no dh_key_exchange = yes rsa_key_length = 512 dh_key_length = 512 verify_depth = 0 pem_file_type = yes private_key_file = "/usr/local/etc/raddb/certs/server.pem" certificate_file = "/usr/local/etc/raddb/certs/server.pem" CA_file = "/usr/local/etc/raddb/certs/ca.pem" private_key_password = "whatever" dh_file = "/usr/local/etc/raddb/certs/dh" random_file = "/usr/local/etc/raddb/certs/random" fragment_size = 1024 include_length = yes check_crl = no cipher_list = "DEFAULT" make_cert_command = "/usr/local/etc/raddb/certs/bootstrap" cache { enable = no lifetime = 24 max_entries = 255 } } Module: Linked to sub-module rlm_eap_ttls Module: Instantiating eap-ttls ttls { default_eap_type = "md5" copy_request_to_tunnel = no use_tunneled_reply = no virtual_server = "inner-tunnel" include_length = yes } Module: Linked to sub-module rlm_eap_peap Module: Instantiating eap-peap peap { default_eap_type = "mschapv2" copy_request_to_tunnel = no use_tunneled_reply = no proxy_tunneled_request_as_eap = yes virtual_server = "inner-tunnel" } Module: Linked to sub-module rlm_eap_mschapv2 Module: Instantiating eap-mschapv2 mschapv2 { with_ntdomain_hack = no } Module: Checking authorize {...} for more modules to load Module: Linked to module rlm_realm Module: Instantiating suffix realm suffix { format = "suffix" delimiter = "@" ignore_default = no ignore_null = no } Module: Linked to module rlm_files Module: Instantiating files files { usersfile = "/usr/local/etc/raddb/users" acctusersfile = "/usr/local/etc/raddb/acct_users" preproxy_usersfile = "/usr/local/etc/raddb/preproxy_users" compat = "no" } Module: Checking session {...} for more modules to load Module: Linked to module rlm_radutmp Module: Instantiating radutmp radutmp { filename = "/usr/local/var/log/radius/radutmp" username = "%{User-Name}" case_sensitive = yes check_with_nas = yes perm = 384 callerid = yes } Module: Checking post-proxy {...} for more modules to load Module: Checking post-auth {...} for more modules to load Module: Linked to module rlm_attr_filter Module: Instantiating attr_filter.access_reject attr_filter attr_filter.access_reject { attrsfile = "/usr/local/etc/raddb/attrs.access_reject" key = "%{User-Name}" } } # modules } # server server { modules { Module: Checking authenticate {...} for more modules to load Module: Checking authorize {...} for more modules to load Module: Linked to module rlm_preprocess Module: Instantiating preprocess preprocess { huntgroups = "/usr/local/etc/raddb/huntgroups" hints = "/usr/local/etc/raddb/hints" with_ascend_hack = no ascend_channels_per_line = 23 with_ntdomain_hack = no with_specialix_jetstream_hack = no with_cisco_vsa_hack = no with_alvarion_vsa_hack = no } Module: Checking preacct {...} for more modules to load Module: Linked to module rlm_acct_unique Module: Instantiating acct_unique acct_unique { key = "User-Name, Acct-Session-Id, NAS-IP-Address, Client-IP-Address, NAS-Port" } Module: Checking accounting {...} for more modules to load Module: Linked to module rlm_detail Module: Instantiating detail detail { detailfile = "/usr/local/var/log/radius/radacct/%{Client-IP-Address}/detail-%Y%m%d" header = "%t" detailperm = 384 dirperm = 493 locking = no log_packet_header = no } Module: Instantiating attr_filter.accounting_response attr_filter attr_filter.accounting_response { attrsfile = "/usr/local/etc/raddb/attrs.accounting_response" key = "%{User-Name}" } Module: Checking session {...} for more modules to load Module: Checking post-proxy {...} for more modules to load Module: Checking post-auth {...} for more modules to load } # modules } # server radiusd: #### Opening IP addresses and Ports #### listen { type = "auth" ipaddr = * port = 0 } listen { type = "acct" ipaddr = * port = 0 } listen { type = "control" listen { socket = "/usr/local/var/run/radiusd/radiusd.sock" } } Listening on authentication address * port 1812 Listening on accounting address * port 1813 Listening on command file /usr/local/var/run/radiusd/radiusd.sock Listening on proxy address * port 1814 Ready to process requests. rad_recv: Access-Request packet from host 127.0.0.1 port 59930, id=143, length=53 User-Name = "test" User-Password = "test" NAS-IP-Address = 127.0.0.1 NAS-Port-Id = "0" +- entering group authorize {...} ++[preprocess] returns ok ++[chap] returns noop ++[mschap] returns noop [suffix] No '@' in User-Name = "test", looking up realm NULL [suffix] No such realm "NULL" ++[suffix] returns noop [eap] No EAP-Message, not doing EAP ++[eap] returns noop [files] users: Matched entry test at line 61 ++[files] returns ok ++[expiration] returns noop ++[logintime] returns noop [pap] Found existing Auth-Type, not changing it. ++[pap] returns noop Found Auth-Type = PAP +- entering group PAP {...} [pap] login attempt with password "test" [pap] Using clear text password "test" [pap] User authenticated successfully ++[pap] returns ok +- entering group post-auth {...} ++[exec] returns noop Sending Access-Accept of id 143 to 127.0.0.1 port 59930 Finished request 0. Going to the next request Waking up in 4.9 seconds. rad_recv: Access-Request packet from host 127.0.0.1 port 59930, id=94, length=56 User-Name = "testper" User-Password = "testper1" NAS-IP-Address = 127.0.0.1 NAS-Port-Id = "0" +- entering group authorize {...} ++[preprocess] returns ok ++[chap] returns noop ++[mschap] returns noop [suffix] No '@' in User-Name = "testper", looking up realm NULL [suffix] No such realm "NULL" ++[suffix] returns noop [eap] No EAP-Message, not doing EAP ++[eap] returns noop [files] users: Matched entry testper at line 63 ++[files] returns ok ++[expiration] returns noop ++[logintime] returns noop [pap] Found existing Auth-Type, not changing it. ++[pap] returns noop Found Auth-Type = PAP +- entering group PAP {...} [pap] login attempt with password "testper1" [pap] Using clear text password "testper1" [pap] User authenticated successfully ++[pap] returns ok +- entering group post-auth {...} ++[exec] returns noop Sending Access-Accept of id 94 to 127.0.0.1 port 59930 Finished request 1. Going to the next request Waking up in 4.9 seconds. rad_recv: Access-Request packet from host 127.0.0.1 port 59930, id=5, length=53 User-Name = "test" User-Password = "test" NAS-IP-Address = 127.0.0.1 NAS-Port-Id = "0" +- entering group authorize {...} ++[preprocess] returns ok ++[chap] returns noop ++[mschap] returns noop [suffix] No '@' in User-Name = "test", looking up realm NULL [suffix] No such realm "NULL" ++[suffix] returns noop [eap] No EAP-Message, not doing EAP ++[eap] returns noop [files] users: Matched entry test at line 61 ++[files] returns ok ++[expiration] returns noop ++[logintime] returns noop [pap] Found existing Auth-Type, not changing it. ++[pap] returns noop Found Auth-Type = PAP +- entering group PAP {...} [pap] login attempt with password "test" [pap] Using clear text password "test" [pap] User authenticated successfully ++[pap] returns ok +- entering group post-auth {...} ++[exec] returns noop Sending Access-Accept of id 5 to 127.0.0.1 port 59930 Finished request 2. Going to the next request Waking up in 4.9 seconds. Regards, Tejesh ________________________________________ From: freeradius-devel-bounces+tejesh.vijayakumar=lntinfotech.com@lists.freeradius.org [freeradius-devel-bounces+tejesh.vijayakumar=lntinfotech.com@lists.freeradius.org] On Behalf Of Alan DeKok [aland@deployingradius.com] Sent: Thursday, December 24, 2009 4:08 AM To: FreeRadius developers mailing list Subject: Re: How to improve Radius Performance Tejesh Vijayakumar wrote:

Alan,

I have followed the procedure as below.. 1) ./configure , make and make install for FreeRadiius Installation. 2) Added the below line in users file test Auth-Type := pap, Cleartext-Password := "test" 3) Tested the performance by modifying create-users script and time command.

Pls advise if i have missed out anything to achieve more/normal auths/sec

Well... that should get 1000's of auth/s, even if you run "radclient" on the same machine as the RADIUS server. What are you using for load testing? Alan DeKok. - List info/subscribe/unsubscribe? See http://www.freeradius.org/list/devel.html ______________________________________________________________________ This Email may contain confidential or privileged information for the intended recipient (s) If you are not the intended recipient, please do not use or disseminate the information, notify the sender and delete it from your system. ______________________________________________________________________

Hi,

I think that for 2.2.0, this performance issue will need to be addressed. We'll need to have some performance measurements inside of the FreeRADIUS server itself, so that people can see where all of the CPU time is going. That will let people know what to blame.

aye - in the debug mode we get to see timestamps....so the server could be configured to keep timers...and then accumulate those for each module so then you could use eg raddebug or attachment to the radiusd interface and get a nice simple bar-chart or such of time spent - either rows of symbols or just pure numbers...eg authorization (4 seconds) -sql (2 seconds) -unix (1 second) -eap (1 second) authentication (8 seconds) -sql (6 seconds) -pap (2 seconds) accounting (15 seconds) -sql (12 seconds) -radutmp (2 seconds) -buffered_sql (1 second) where seconds is accumulated time?) or authorization #### -sql ## -unix # -eap # authentication ######## -sql ###### -pap ## accounting #################### -sql ############# -radutmp #### -buffered_sql ## ? alternatively, these values can be accessed much like the stats - in terms of average usec perhaps - and then we can get graphs shown in our munin (or SNMP) - thus allowing those with less technical bent to be aware of eg an incrementing value or big spike when some part of the system was changed? alan

*bang head on table in sign of despair* That's to run radiusd in debuging mode, you do NOT use that option for production. It starts radius in a single thread explaining why you are having issues. On 2009-12-23, at 6:55 AM, Tejesh Vijayakumar wrote:

Yes Alan... I am using radiusd -X to start Radius server ...

Regards, tejesh

________________________________________ From: freeradius-devel-bounces+tejesh.vijayakumar=lntinfotech.com@lists.freeradius.org [freeradius-devel-bounces+tejesh.vijayakumar=lntinfotech.com@lists.freeradius.org] On Behalf Of Alan Buxey [A.L.M.Buxey@lboro.ac.uk] Sent: Wednesday, December 23, 2009 8:25 PM To: FreeRadius developers mailing list Subject: Re: How to improve Radius Performance

Hi,

...

I want to achieve around 5000 auths/sec with FreeRadius version 2.1.7. Currently I am able to achieve only 125 auths/sec with a PentiumIV 3Ghz single core 512 mb RAM machine. I am using just the users file with two users. Can I improve radius performance using same machine or What is the preferable system configuration to achieve 5000 auths/sec?

radiusd -X - lets see what else you are using. a quick performance test with no tweaks on an old 2.4GHz P4 gets over 200 auths/s

alan - List info/subscribe/unsubscribe? See http://www.freeradius.org/list/devel.html

______________________________________________________________________

This Email may contain confidential or privileged information for the intended recipient (s) If you are not the intended recipient, please do not use or disseminate the information, notify the sender and delete it from your system.

______________________________________________________________________

- List info/subscribe/unsubscribe? See http://www.freeradius.org/list/devel.html

John Dennis <jdennis@redhat.com> wrote:

On 12/23/2009 07:46 AM, Gabriel Blanchard wrote:

...

*bang head on table in sign of despair*

That's to run radiusd in debuging mode, you do NOT use that option for production. It starts radius in a single thread explaining why you are having issues.

Not to mention the considerable overhead of console IO.

I never found a 'screen' session slows things down too much, guess I could strap a console to a dot matrix with continoues feed paper too :)

-- John Dennis <jdennis@redhat.com>

Looking to carve out IT costs? www.redhat.com/carveoutcosts/

...erm...nope. Cheers -- Alexander Clouter .sigmonster says: Accordion, n.: A bagpipe with pleats.

Tejesh Vijayakumar wrote:

You nailed me there.. I tried starting with just "radiusd" and figures showed improvement. Now I am getting 160 Auths/sec for 1000 users compared to 125 earlier. Is there anything else I could do for improving it more.?

I'll guess that you're using NSS for /etc/passwd authentication, and that your LDAP server is slow. Delete the references to "unix" from raddb/sites-available/default. Alan DeKok.