Dear friends, I searched list archive, but I couldn't find anything about this. I need to correctly design and deploy a brand new FreeRADIUS server. It will receive about 25.000 simultaneous users, so I'm planning to have, at least, two servers. My questions are: 1. What would be recommended server hardware (memory, disk, CPU, ...) and software (Linux distribution, kernel version, ...)? 2. How could I synchronize both servers' users? I mean, in the beginning, I'd have two separate /etc/shadow files but this is not scalable. I need to share a single file between both servers. Is it possible? How? 3. Any recommendations to the backup policy? Best regards, Maurício Harley Suporte Técnico Cisco IP Phone: +55 (85) 3133-7910 Auriga Tecnologia & Negócios Cisco SILVER Certified Partner IBM Business Partner
Dear friends,
I searched list archive, but I couldn't find anything about this. I need to correctly design and deploy a brand new FreeRADIUS server. It will receive about 25.000 simultaneous users, so I'm planning to have, at least, two servers.
My questions are:
1. What would be recommended server hardware (memory, disk, CPU, ...) and software (Linux distribution, kernel version, ...)?
Should be possible with off-the-shelve hardware. Some middle-class server should be enough.
2. How could I synchronize both servers' users? I mean, in the beginning, I'd have two separate /etc/shadow files but this is not scalable. I need to share a single file between both servers. Is it possible? How?
more than 10.000? You should use a SQL backend storage. use replication scheme of the SQL database. Or use DRBD to replicate disk partitions.
3. Any recommendations to the backup policy?
Ordinary backup solution of the SQL database. -- Dr. Michael Schwartzkopff Guardinistr. 63 81375 München Tel: (0163) 172 50 98 Fax: (089) 620 304 13
1. What would be recommended server hardware (memory, disk, CPU, ...) and software (Linux distribution, kernel version, ...)? Anything standard and new will do the trick here. You don't need "Pie in the sky", just make sure you have 2. How could I synchronize both servers' users? I mean, in the beginning, I'd have two separate /etc/shadow files but this is not scalable. I need to share a single file between both servers. Is it possible? How? Do you have a SAN that you could utilize? For performance, I'd suggest a MySQL Cluster running on something with quite a few spindles. The SAN provides great performance in that arena. Otherwise, you are looking at having to do a Master/Slave scenario for MySQL DB Replication 3. Any recommendations to the backup policy? Just your standard nightly full backups to disk, then to either tape, SAN or offsite storage of some kind. Best regards, Maurício Harley Suporte Técnico Cisco IP Phone: +55 (85) 3133-7910 Auriga Tecnologia & Negócios Cisco SILVER Certified Partner IBM Business Partner The information contained in this e-mail message may be confidential and protected from disclosure. If you are not the intended recipient, any dissemination, distribution or copying is strictly prohibited. If you think that you have received this e-mail message in error, please notify the sender immediately by replying to this message and then delete it from your system.
My message was truncated somehow... For point 1, I was going to just say, the more spindles for the hard drives the better, and a normal amount of RAM, like 4GB or so. You will have a decent amount of IOPS, especially if you go with MySQL. However, point 2 might take care of that. From: freeradius-users-bounces+jjulson=marketron.com@lists.freeradius.org [mailto:freeradius-users-bounces+jjulson=marketron.com@lists.freeradius.org] On Behalf Of Julson, Jim Sent: Thursday, August 16, 2012 2:24 PM To: FreeRadius users mailing list Subject: RE: New FreeRADIUS Deployment 1. What would be recommended server hardware (memory, disk, CPU, ...) and software (Linux distribution, kernel version, ...)? Anything standard and new will do the trick here. You don't need "Pie in the sky", just make sure you have 2. How could I synchronize both servers' users? I mean, in the beginning, I'd have two separate /etc/shadow files but this is not scalable. I need to share a single file between both servers. Is it possible? How? Do you have a SAN that you could utilize? For performance, I'd suggest a MySQL Cluster running on something with quite a few spindles. The SAN provides great performance in that arena. Otherwise, you are looking at having to do a Master/Slave scenario for MySQL DB Replication 3. Any recommendations to the backup policy? Just your standard nightly full backups to disk, then to either tape, SAN or offsite storage of some kind. Best regards, Maurício Harley Suporte Técnico Cisco IP Phone: +55 (85) 3133-7910 Auriga Tecnologia & Negócios Cisco SILVER Certified Partner IBM Business Partner The information contained in this e-mail message may be confidential and protected from disclosure. If you are not the intended recipient, any dissemination, distribution or copying is strictly prohibited. If you think that you have received this e-mail message in error, please notify the sender immediately by replying to this message and then delete it from your system. The information contained in this e-mail message may be confidential and protected from disclosure. If you are not the intended recipient, any dissemination, distribution or copying is strictly prohibited. If you think that you have received this e-mail message in error, please notify the sender immediately by replying to this message and then delete it from your system.
Ok, friends, Thank you very much for start discussing. Let's get that more objective. RADIUS Server: any CPU, 4 GB RAM, any disk space / any Linux Database Server: any CPU, RAM (???), disk space (???), MySQL / any Linux Additional: SAN to enable database cluster (any tip?) Am I right? What would be answers to the question marks? Kind regards, Maurício Harley Suporte Técnico Cisco IP Phone: +55 (85) 3133-7910 Auriga Tecnologia & Negócios Cisco SILVER Certified Partner IBM Business Partner De: freeradius-users-bounces+mauricio.brito=auriga.com.br@lists.freeradius.org [mailto:freeradius-users-bounces+mauricio.brito=auriga.com.br@lists.freeradius.org] Em nome de Julson, Jim Enviada em: quinta-feira, 16 de agosto de 2012 17:53 Para: FreeRadius users mailing list Assunto: RE: New FreeRADIUS Deployment My message was truncated somehow... For point 1, I was going to just say, the more spindles for the hard drives the better, and a normal amount of RAM, like 4GB or so. You will have a decent amount of IOPS, especially if you go with MySQL. However, point 2 might take care of that. From: freeradius-users-bounces+jjulson=marketron.com@lists.freeradius.org [mailto:freeradius-users-bounces+jjulson=marketron.com@lists.freeradius.org] On Behalf Of Julson, Jim Sent: Thursday, August 16, 2012 2:24 PM To: FreeRadius users mailing list Subject: RE: New FreeRADIUS Deployment 1. What would be recommended server hardware (memory, disk, CPU, ...) and software (Linux distribution, kernel version, ...)? Anything standard and new will do the trick here. You don't need "Pie in the sky", just make sure you have 2. How could I synchronize both servers' users? I mean, in the beginning, I'd have two separate /etc/shadow files but this is not scalable. I need to share a single file between both servers. Is it possible? How? Do you have a SAN that you could utilize? For performance, I'd suggest a MySQL Cluster running on something with quite a few spindles. The SAN provides great performance in that arena. Otherwise, you are looking at having to do a Master/Slave scenario for MySQL DB Replication 3. Any recommendations to the backup policy? Just your standard nightly full backups to disk, then to either tape, SAN or offsite storage of some kind. Best regards, Maurício Harley Suporte Técnico Cisco IP Phone: +55 (85) 3133-7910 Auriga Tecnologia & Negócios Cisco SILVER Certified Partner IBM Business Partner The information contained in this e-mail message may be confidential and protected from disclosure. If you are not the intended recipient, any dissemination, distribution or copying is strictly prohibited. If you think that you have received this e-mail message in error, please notify the sender immediately by replying to this message and then delete it from your system. The information contained in this e-mail message may be confidential and protected from disclosure. If you are not the intended recipient, any dissemination, distribution or copying is strictly prohibited. If you think that you have received this e-mail message in error, please notify the sender immediately by replying to this message and then delete it from your system.
####### Q: RADIUS Server: any CPU, 4 GB RAM, any disk space / any Linux A: A reasonable amount of Disk space, something like 30GB should be more than sufficient, particularly if your SAN is housing your databases. As for distro, I'm a fan of CentOS 6.2/6.3 or Ubuntu 12.04. I actually have both in production behind load balancers. ####### ####### Q: Database Server: any CPU, RAM (???), disk space (???), MySQL / any Linux A: This is just me, but I'd suggest running both MySQL and FreeRADIUS on the same servers if you can keep the actually data off of the server, and on a SAN. This is because in terms of processor, RAM, and Network IO, MySQL won't peg the system very hard at all. Of course, if budget is of no consequence, then of course separating out services is always fine. But I like to keep all my DB queries local where I can, especially for network intensive operations. This will have to be looked at and integrated into your environment based upon your current variables. There are just too many ways to go, and there is no 1 particulary "right way". (Though some may disagree) To touch on this further though, RAM is cheap, and if you house them on the same servers, I'd probably make sure you had 6GB to dedicate to MySQL, and about 2-4GB to the OS. Getting 12GB of RAM on a system nowadays is nothing, so if you can, I'd do that. ####### ####### Q: Additional: SAN to enable database cluster (any tip?) A: If you have a SAN Available, it's pretty straight forward. You will create a volume, carve out a LUN, assign it to the Linux Servers, and then mount the partition to begin using it. Both of your FreeRADIUS MySQL Servers servers will point to the same data, thereby giving you good speed, a single point of management, as well as great redundancy with the SAN. ####### From: freeradius-users-bounces+jjulson=marketron.com@lists.freeradius.org [mailto:freeradius-users-bounces+jjulson=marketron.com@lists.freeradius.org] On Behalf Of Mauricio Harley Sent: Thursday, August 16, 2012 3:15 PM To: FreeRadius users mailing list Subject: RES: New FreeRADIUS Deployment Ok, friends, Thank you very much for start discussing. Let's get that more objective. RADIUS Server: any CPU, 4 GB RAM, any disk space / any Linux Database Server: any CPU, RAM (???), disk space (???), MySQL / any Linux Additional: SAN to enable database cluster (any tip?) Am I right? What would be answers to the question marks? Kind regards, Maurício Harley Suporte Técnico Cisco IP Phone: +55 (85) 3133-7910 Auriga Tecnologia & Negócios Cisco SILVER Certified Partner IBM Business Partner De: freeradius-users-bounces+mauricio.brito=auriga.com.br@lists.freeradius.org<mailto:freeradius-users-bounces+mauricio.brito=auriga.com.br@lists.freeradius.org> [mailto:freeradius-users-bounces+mauricio.brito=auriga.com.br@lists.freeradius.org]<mailto:[mailto:freeradius-users-bounces+mauricio.brito=auriga.com.br@lists.freeradius.org]> Em nome de Julson, Jim Enviada em: quinta-feira, 16 de agosto de 2012 17:53 Para: FreeRadius users mailing list Assunto: RE: New FreeRADIUS Deployment My message was truncated somehow... For point 1, I was going to just say, the more spindles for the hard drives the better, and a normal amount of RAM, like 4GB or so. You will have a decent amount of IOPS, especially if you go with MySQL. However, point 2 might take care of that. From: freeradius-users-bounces+jjulson=marketron.com@lists.freeradius.org<mailto:freeradius-users-bounces+jjulson=marketron.com@lists.freeradius.org> [mailto:freeradius-users-bounces+jjulson=marketron.com@lists.freeradius.org]<mailto:[mailto:freeradius-users-bounces+jjulson=marketron.com@lists.freeradius.org]> On Behalf Of Julson, Jim Sent: Thursday, August 16, 2012 2:24 PM To: FreeRadius users mailing list Subject: RE: New FreeRADIUS Deployment 1. What would be recommended server hardware (memory, disk, CPU, ...) and software (Linux distribution, kernel version, ...)? Anything standard and new will do the trick here. You don't need "Pie in the sky", just make sure you have 2. How could I synchronize both servers' users? I mean, in the beginning, I'd have two separate /etc/shadow files but this is not scalable. I need to share a single file between both servers. Is it possible? How? Do you have a SAN that you could utilize? For performance, I'd suggest a MySQL Cluster running on something with quite a few spindles. The SAN provides great performance in that arena. Otherwise, you are looking at having to do a Master/Slave scenario for MySQL DB Replication 3. Any recommendations to the backup policy? Just your standard nightly full backups to disk, then to either tape, SAN or offsite storage of some kind. Best regards, Maurício Harley Suporte Técnico Cisco IP Phone: +55 (85) 3133-7910 Auriga Tecnologia & Negócios Cisco SILVER Certified Partner IBM Business Partner The information contained in this e-mail message may be confidential and protected from disclosure. If you are not the intended recipient, any dissemination, distribution or copying is strictly prohibited. If you think that you have received this e-mail message in error, please notify the sender immediately by replying to this message and then delete it from your system. The information contained in this e-mail message may be confidential and protected from disclosure. If you are not the intended recipient, any dissemination, distribution or copying is strictly prohibited. If you think that you have received this e-mail message in error, please notify the sender immediately by replying to this message and then delete it from your system. The information contained in this e-mail message may be confidential and protected from disclosure. If you are not the intended recipient, any dissemination, distribution or copying is strictly prohibited. If you think that you have received this e-mail message in error, please notify the sender immediately by replying to this message and then delete it from your system.
Ok, Jim, Thanks a lot. I guess it's quite clear for me now! Regars, Maurício Harley Suporte Técnico Cisco IP Phone: +55 (85) 3133-7910 Auriga Tecnologia & Negócios Cisco SILVER Certified Partner IBM Business Partner De: freeradius-users-bounces+mauricio.brito=auriga.com.br@lists.freeradius.org [mailto:freeradius-users-bounces+mauricio.brito=auriga.com.br@lists.freeradius.org] Em nome de Julson, Jim Enviada em: quinta-feira, 16 de agosto de 2012 18:30 Para: FreeRadius users mailing list Assunto: RE: New FreeRADIUS Deployment ####### Q: RADIUS Server: any CPU, 4 GB RAM, any disk space / any Linux A: A reasonable amount of Disk space, something like 30GB should be more than sufficient, particularly if your SAN is housing your databases. As for distro, I'm a fan of CentOS 6.2/6.3 or Ubuntu 12.04. I actually have both in production behind load balancers. ####### ####### Q: Database Server: any CPU, RAM (???), disk space (???), MySQL / any Linux A: This is just me, but I'd suggest running both MySQL and FreeRADIUS on the same servers if you can keep the actually data off of the server, and on a SAN. This is because in terms of processor, RAM, and Network IO, MySQL won't peg the system very hard at all. Of course, if budget is of no consequence, then of course separating out services is always fine. But I like to keep all my DB queries local where I can, especially for network intensive operations. This will have to be looked at and integrated into your environment based upon your current variables. There are just too many ways to go, and there is no 1 particulary "right way". (Though some may disagree) To touch on this further though, RAM is cheap, and if you house them on the same servers, I'd probably make sure you had 6GB to dedicate to MySQL, and about 2-4GB to the OS. Getting 12GB of RAM on a system nowadays is nothing, so if you can, I'd do that. ####### ####### Q: Additional: SAN to enable database cluster (any tip?) A: If you have a SAN Available, it's pretty straight forward. You will create a volume, carve out a LUN, assign it to the Linux Servers, and then mount the partition to begin using it. Both of your FreeRADIUS MySQL Servers servers will point to the same data, thereby giving you good speed, a single point of management, as well as great redundancy with the SAN. ####### From: freeradius-users-bounces+jjulson=marketron.com@lists.freeradius.org [mailto:freeradius-users-bounces+jjulson=marketron.com@lists.freeradius.org] On Behalf Of Mauricio Harley Sent: Thursday, August 16, 2012 3:15 PM To: FreeRadius users mailing list Subject: RES: New FreeRADIUS Deployment Ok, friends, Thank you very much for start discussing. Let's get that more objective. RADIUS Server: any CPU, 4 GB RAM, any disk space / any Linux Database Server: any CPU, RAM (???), disk space (???), MySQL / any Linux Additional: SAN to enable database cluster (any tip?) Am I right? What would be answers to the question marks? Kind regards, Maurício Harley Suporte Técnico Cisco IP Phone: +55 (85) 3133-7910 Auriga Tecnologia & Negócios Cisco SILVER Certified Partner IBM Business Partner De: freeradius-users-bounces+mauricio.brito=auriga.com.br@lists.freeradius.org [mailto:freeradius-users-bounces+mauricio.brito=auriga.com.br@lists.freeradius.org] Em nome de Julson, Jim Enviada em: quinta-feira, 16 de agosto de 2012 17:53 Para: FreeRadius users mailing list Assunto: RE: New FreeRADIUS Deployment My message was truncated somehow... For point 1, I was going to just say, the more spindles for the hard drives the better, and a normal amount of RAM, like 4GB or so. You will have a decent amount of IOPS, especially if you go with MySQL. However, point 2 might take care of that. From: freeradius-users-bounces+jjulson=marketron.com@lists.freeradius.org [mailto:freeradius-users-bounces+jjulson=marketron.com@lists.freeradius.org] On Behalf Of Julson, Jim Sent: Thursday, August 16, 2012 2:24 PM To: FreeRadius users mailing list Subject: RE: New FreeRADIUS Deployment 1. What would be recommended server hardware (memory, disk, CPU, ...) and software (Linux distribution, kernel version, ...)? Anything standard and new will do the trick here. You don't need "Pie in the sky", just make sure you have 2. How could I synchronize both servers' users? I mean, in the beginning, I'd have two separate /etc/shadow files but this is not scalable. I need to share a single file between both servers. Is it possible? How? Do you have a SAN that you could utilize? For performance, I'd suggest a MySQL Cluster running on something with quite a few spindles. The SAN provides great performance in that arena. Otherwise, you are looking at having to do a Master/Slave scenario for MySQL DB Replication 3. Any recommendations to the backup policy? Just your standard nightly full backups to disk, then to either tape, SAN or offsite storage of some kind. Best regards, Maurício Harley Suporte Técnico Cisco IP Phone: +55 (85) 3133-7910 Auriga Tecnologia & Negócios Cisco SILVER Certified Partner IBM Business Partner The information contained in this e-mail message may be confidential and protected from disclosure. If you are not the intended recipient, any dissemination, distribution or copying is strictly prohibited. If you think that you have received this e-mail message in error, please notify the sender immediately by replying to this message and then delete it from your system. The information contained in this e-mail message may be confidential and protected from disclosure. If you are not the intended recipient, any dissemination, distribution or copying is strictly prohibited. If you think that you have received this e-mail message in error, please notify the sender immediately by replying to this message and then delete it from your system. The information contained in this e-mail message may be confidential and protected from disclosure. If you are not the intended recipient, any dissemination, distribution or copying is strictly prohibited. If you think that you have received this e-mail message in error, please notify the sender immediately by replying to this message and then delete it from your system.
Do you have a SAN that you could utilize? For performance, I’d suggest a MySQL Cluster running on something with quite a few spindles. The SAN provides great performance in that arena. Otherwise, you are looking at having to do a Master/Slave scenario for MySQL DB Replication
(citation needed) :) -Arran
I'm not sure I get what you mean by "(citation needed)". Forgive me, I hope I didn't do something wrong by posting that to the List. Sorry if I caused a problem. -----Original Message----- From: freeradius-users-bounces+jjulson=marketron.com@lists.freeradius.org [mailto:freeradius-users-bounces+jjulson=marketron.com@lists.freeradius.org] On Behalf Of Arran Cudbard-Bell Sent: Thursday, August 16, 2012 2:57 PM To: FreeRadius users mailing list Subject: Re: New FreeRADIUS Deployment
Do you have a SAN that you could utilize? For performance, I'd suggest a MySQL Cluster running on something with quite a few spindles. The SAN provides great performance in that arena. Otherwise, you are looking at having to do a Master/Slave scenario for MySQL DB Replication
(citation needed) :) -Arran - List info/subscribe/unsubscribe? See http://www.freeradius.org/list/users.html The information contained in this e-mail message may be confidential and protected from disclosure. If you are not the intended recipient, any dissemination, distribution or copying is strictly prohibited. If you think that you have received this e-mail message in error, please notify the sender immediately by replying to this message and then delete it from your system.
On 16 Aug 2012, at 23:01, "Julson, Jim" <jjulson@MARKETRON.COM> wrote:
I'm not sure I get what you mean by "(citation needed)". Forgive me, I hope I didn't do something wrong by posting that to the List. Sorry if I caused a problem.
From what i've read DA (directly attached) storage still has the lead over SAN based storage in terms of IOP/s and bandwidth. So suggesting a SAN based solution for the database data volume seemed a bit strange, and I was wondering if you had any evidence to back it up. -Arran http://knowyourmeme.com/memes/citation-needed
Oh I see now. Forgive my ignorance with the terms. Let me explain a bit more about the logic behind that. I work for a Television and Radio broadcast software development company. Our software is entirely dependant upon MSSQL, MySQL and PostgreSQL. Since we virtualize about 75% of our environment, including SQL servers, and run everything in redundant pools via XenMotion, we have to utilize SANS. Performance wise, we see better disk utilization, and IOP performance when connected to the SANS space versus DA storage on a typical RAID 1, or 5 for redundancy. We use both RAID z and RAID 10 at this point, as for the last 15 years we've gone through every configuration you could think of. I've been architecting DB infrastructures for companies like Capital One and my current company on very large scales for many years, and given the proper budget, and initial design, a SAN infrastructure can (and is) a very fast one. Additionally, we use 8GB fiber on every host for the SAN space as well as separate 10GB Ethernet uplinks to these hosts. Now, my email to the gentleman before, was based on the "assumption" (I know, shame on me), that he's buy a Dell, IBM, or HP server of some sort, and it would have your standard Perc or QLogic RAID controller that supports standard RAID 0, 1 or 5 configurations. Given the amount of IO he was expecting, I proposed he offload the DB services to another physical source to ensure that local functions were uninterrupted. Obviously with any *SQL configuration, offloading the DB files to separate physical spindles is the best, simply due to the nature of any Database engine (You know, traditional LOGS and DATA on separate physical spindles etc..) So I guess I should have cited my logic behind it as well. Sorry for the confusion, and thanks for keeping folks accountable. It's good that all the information is put out there in it's entirety with real life experience, and not just "do it this way because I say so". As for proof, hehe, not sure how to prove the last 15 years of work I've done. I can just tell you what my experience has been with the given technologies. Hope that helps my friend. Have a good one. -----Original Message----- From: freeradius-users-bounces+jjulson=marketron.com@lists.freeradius.org [mailto:freeradius-users-bounces+jjulson=marketron.com@lists.freeradius.org] On Behalf Of Arran Cudbard-Bell Sent: Friday, August 17, 2012 9:59 AM To: FreeRadius users mailing list Subject: Re: New FreeRADIUS Deployment On 16 Aug 2012, at 23:01, "Julson, Jim" <jjulson@MARKETRON.COM> wrote:
I'm not sure I get what you mean by "(citation needed)". Forgive me, I hope I didn't do something wrong by posting that to the List. Sorry if I caused a problem.
From what i've read DA (directly attached) storage still has the lead over SAN based storage in terms of IOP/s and bandwidth. So suggesting a SAN based solution for the database data volume seemed a bit strange, and I was wondering if you had any evidence to back it up.
-Arran http://knowyourmeme.com/memes/citation-needed - List info/subscribe/unsubscribe? See http://www.freeradius.org/list/users.html The information contained in this e-mail message may be confidential and protected from disclosure. If you are not the intended recipient, any dissemination, distribution or copying is strictly prohibited. If you think that you have received this e-mail message in error, please notify the sender immediately by replying to this message and then delete it from your system.
participants (4)
-
Arran Cudbard-Bell -
Julson, Jim -
Mauricio Harley -
Michael Schwartzkopff