All, I got a FR3 to Seg Fault today when it tried to proxy an authentication attempt to another RADIUS server. The conditions were/are: * proxying over IPv6 * using RADSEC * Other server is Dead I have reproduced the Seg Fault by blocking outgoing communication (using ip6tables) to a working server. Wed Jun 27 11:25:26 2012 : Info: (2) files : preproxy_users: Matched entry DEFAULT at line 33 Wed Jun 27 11:25:26 2012 : Info: (2) [files] = ok Wed Jun 27 11:25:26 2012 : Info: (2) policy cui.pre-proxy { Wed Jun 27 11:25:26 2012 : Info: (2) - entering policy cui.pre-proxy {...} Wed Jun 27 11:25:26 2012 : Info: (2) update proxy-request { Wed Jun 27 11:25:26 2012 : Info: (2) } # update proxy-request = ok Wed Jun 27 11:25:26 2012 : Info: (2) - policy cui.pre-proxy returns ok Wed Jun 27 11:25:26 2012 : Info: (2) pre_proxy_log : expand: /var/log/radius/radacct/%{Client-IP-Address}/pre-proxy-detail-%Y%m%d -> /var/log/radius/radacct/131.231.190.6/pre-proxy-detail-20120627 Wed Jun 27 11:25:26 2012 : Info: (2) pre_proxy_log : /var/log/radius/radacct/%{Client-IP-Address}/pre-proxy-detail-%Y%m%d expands to /var/log/radius/radacct/131.231.190.6/pre-proxy-detail-20120627 Wed Jun 27 11:25:26 2012 : Info: (2) pre_proxy_log : expand: %t -> Wed Jun 27 11:25:26 2012 Wed Jun 27 11:25:26 2012 : Info: (2) [pre_proxy_log] = ok Wed Jun 27 11:25:26 2012 : Debug: Opening new proxy (::, 0) -> home_server (2001:630:1:129::249, 2083) Wed Jun 27 11:25:26 2012 : Debug: Waking up in 0.1 seconds. Wed Jun 27 11:25:26 2012 : Debug: Waking up in 0.4 seconds. Segmentation fault Starting program: /usr/sbin/radiusd -f [Thread debugging using libthread_db enabled] [New Thread 0x7fffe8208700 (LWP 1321)] [New Thread 0x7fffe7807700 (LWP 1322)] [New Thread 0x7fffe6e06700 (LWP 1323)] [New Thread 0x7fffe6405700 (LWP 1324)] [New Thread 0x7fffe5a04700 (LWP 1325)] [New Thread 0x7fffe5003700 (LWP 1326)] [New Thread 0x7fffe4602700 (LWP 1327)] [New Thread 0x7fffe3c01700 (LWP 1329)] [New Thread 0x7fffe3200700 (LWP 1330)] [New Thread 0x7fffe27ff700 (LWP 1332)] [New Thread 0x7fffe1dfe700 (LWP 1333)] [New Thread 0x7fffe13fd700 (LWP 1336)] [New Thread 0x7fffe09fc700 (LWP 1337)] [New Thread 0x7fffdfffb700 (LWP 1338)] [New Thread 0x7fffdf5fa700 (LWP 1339)] [New Thread 0x7fffdebf9700 (LWP 1340)] [New Thread 0x7fffde1f8700 (LWP 1341)] [New Thread 0x7fffdd7f7700 (LWP 1342)] [New Thread 0x7fffdcdf6700 (LWP 1343)] [New Thread 0x7fffdc3f5700 (LWP 1344)] [New Thread 0x7fffdb9f4700 (LWP 1345)] [New Thread 0x7fffdaff3700 (LWP 1346)] [New Thread 0x7fffda5f2700 (LWP 1347)] [New Thread 0x7fffd9bf1700 (LWP 1348)] [New Thread 0x7fffd91f0700 (LWP 1349)] [New Thread 0x7fffd87ef700 (LWP 1350)] [New Thread 0x7fffd7dee700 (LWP 1352)] [New Thread 0x7fffd73ed700 (LWP 1353)] [New Thread 0x7fffd69ec700 (LWP 1355)] [New Thread 0x7fffd5feb700 (LWP 1356)] [New Thread 0x7fffd55ea700 (LWP 1357)] [New Thread 0x7fffd4be9700 (LWP 1358)] [New Thread 0x7fffd41e8700 (LWP 1359)] [New Thread 0x7fffd37e7700 (LWP 1360)] [New Thread 0x7fffd2de6700 (LWP 1361)] [New Thread 0x7fffd23e5700 (LWP 1362)] [New Thread 0x7fffd19e4700 (LWP 1363)] [New Thread 0x7fffd0fe3700 (LWP 1364)] [New Thread 0x7fffd05e2700 (LWP 1365)] [New Thread 0x7fffcfbe1700 (LWP 1366)] [New Thread 0x7fffcf1e0700 (LWP 1367)] [New Thread 0x7fffce7df700 (LWP 1368)] [New Thread 0x7fffcddde700 (LWP 1370)] [New Thread 0x7fffcd3dd700 (LWP 1371)] [New Thread 0x7fffcc9dc700 (LWP 1372)] [New Thread 0x7fffcbfdb700 (LWP 1373)] [New Thread 0x7fffcb5da700 (LWP 1374)] [New Thread 0x7fffcabd9700 (LWP 1375)] [New Thread 0x7fffca1d8700 (LWP 1376)] [New Thread 0x7fffc97d7700 (LWP 1378)] [New Thread 0x7fffc8dd6700 (LWP 1381)] [New Thread 0x7fffc83d5700 (LWP 1383)] [New Thread 0x7fffc79d4700 (LWP 1384)] [New Thread 0x7fffc6fd3700 (LWP 1385)] [New Thread 0x7fffc65d2700 (LWP 1386)] [New Thread 0x7fffc5bd1700 (LWP 1387)] [New Thread 0x7fffc51d0700 (LWP 1388)] [New Thread 0x7fffc47cf700 (LWP 1389)] [New Thread 0x7fffc3dce700 (LWP 1390)] [New Thread 0x7fffc33cd700 (LWP 1391)] [New Thread 0x7fffc29cc700 (LWP 1393)] [New Thread 0x7fffc1fcb700 (LWP 1394)] [New Thread 0x7fffc15ca700 (LWP 1395)] [New Thread 0x7fffc0bc9700 (LWP 1396)] Program received signal SIGSEGV, Segmentation fault. 0x000000000042d9e7 in proxy_wait_for_reply (request=0x3ab0880, action=<value optimized out>) at process.c:2830 2830 FR_STATS_TYPE_INC(request->proxy_listener->stats.total_timeouts); Missing separate debuginfos, use: debuginfo-install cyrus-sasl-lib-2.1.23-13.el6.x86_64 db4-4.7.25-16.el6.x86_64 glibc-2.12-1.47.el6_2.12.x86_64 keyutils-libs-1.4-3.el6.x86_64 krb5-libs-1.9-22.el6_2.1.x86_64 libcom_err-1.41.12-11.el6.x86_64 libselinux-2.0.94-5.2.el6.x86_64 nspr-4.8.9-3.el6_2.x86_64 nss-3.13.1-7.el6_2.x86_64 nss-softokn-freebl-3.12.9-11.el6.x86_64 nss-util-3.13.1-3.el6_2.x86_64 openldap-2.4.23-20.el6.x86_64 openssl-1.0.0-20.el6_2.5.x86_64 perl-5.10.1-119.el6_1.1.x86_64 perl-DBI-1.609-4.el6.x86_64 perl-libs-5.10.1-119.el6_1.1.x86_64 postgresql-libs-8.4.11-1.el6_2.x86_64 zlib-1.2.3-27.el6.x86_64 65 Thread 0x7fffc0bc9700 (LWP 1396) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 64 Thread 0x7fffc15ca700 (LWP 1395) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 63 Thread 0x7fffc1fcb700 (LWP 1394) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 62 Thread 0x7fffc29cc700 (LWP 1393) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 61 Thread 0x7fffc33cd700 (LWP 1391) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 60 Thread 0x7fffc3dce700 (LWP 1390) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 59 Thread 0x7fffc47cf700 (LWP 1389) 0x00007ffff757184d in connect () from /lib64/libpthread.so.0 58 Thread 0x7fffc51d0700 (LWP 1388) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 57 Thread 0x7fffc5bd1700 (LWP 1387) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 56 Thread 0x7fffc65d2700 (LWP 1386) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 55 Thread 0x7fffc6fd3700 (LWP 1385) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 54 Thread 0x7fffc79d4700 (LWP 1384) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 53 Thread 0x7fffc83d5700 (LWP 1383) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 52 Thread 0x7fffc8dd6700 (LWP 1381) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 51 Thread 0x7fffc97d7700 (LWP 1378) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 50 Thread 0x7fffca1d8700 (LWP 1376) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 49 Thread 0x7fffcabd9700 (LWP 1375) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 48 Thread 0x7fffcb5da700 (LWP 1374) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 47 Thread 0x7fffcbfdb700 (LWP 1373) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 46 Thread 0x7fffcc9dc700 (LWP 1372) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 45 Thread 0x7fffcd3dd700 (LWP 1371) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 44 Thread 0x7fffcddde700 (LWP 1370) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 43 Thread 0x7fffce7df700 (LWP 1368) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 42 Thread 0x7fffcf1e0700 (LWP 1367) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 41 Thread 0x7fffcfbe1700 (LWP 1366) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 40 Thread 0x7fffd05e2700 (LWP 1365) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 39 Thread 0x7fffd0fe3700 (LWP 1364) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 38 Thread 0x7fffd19e4700 (LWP 1363) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 37 Thread 0x7fffd23e5700 (LWP 1362) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 36 Thread 0x7fffd2de6700 (LWP 1361) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 35 Thread 0x7fffd37e7700 (LWP 1360) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 34 Thread 0x7fffd41e8700 (LWP 1359) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 33 Thread 0x7fffd4be9700 (LWP 1358) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 32 Thread 0x7fffd55ea700 (LWP 1357) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 31 Thread 0x7fffd5feb700 (LWP 1356) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 30 Thread 0x7fffd69ec700 (LWP 1355) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 29 Thread 0x7fffd73ed700 (LWP 1353) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 28 Thread 0x7fffd7dee700 (LWP 1352) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 27 Thread 0x7fffd87ef700 (LWP 1350) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 26 Thread 0x7fffd91f0700 (LWP 1349) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 25 Thread 0x7fffd9bf1700 (LWP 1348) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 24 Thread 0x7fffda5f2700 (LWP 1347) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 23 Thread 0x7fffdaff3700 (LWP 1346) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 22 Thread 0x7fffdb9f4700 (LWP 1345) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 21 Thread 0x7fffdc3f5700 (LWP 1344) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 20 Thread 0x7fffdcdf6700 (LWP 1343) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 19 Thread 0x7fffdd7f7700 (LWP 1342) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 18 Thread 0x7fffde1f8700 (LWP 1341) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 17 Thread 0x7fffdebf9700 (LWP 1340) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 16 Thread 0x7fffdf5fa700 (LWP 1339) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 15 Thread 0x7fffdfffb700 (LWP 1338) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 14 Thread 0x7fffe09fc700 (LWP 1337) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 13 Thread 0x7fffe13fd700 (LWP 1336) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 12 Thread 0x7fffe1dfe700 (LWP 1333) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 11 Thread 0x7fffe27ff700 (LWP 1332) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 10 Thread 0x7fffe3200700 (LWP 1330) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 9 Thread 0x7fffe3c01700 (LWP 1329) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 8 Thread 0x7fffe4602700 (LWP 1327) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 7 Thread 0x7fffe5003700 (LWP 1326) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 6 Thread 0x7fffe5a04700 (LWP 1325) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 5 Thread 0x7fffe6405700 (LWP 1324) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 4 Thread 0x7fffe6e06700 (LWP 1323) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 3 Thread 0x7fffe7807700 (LWP 1322) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 2 Thread 0x7fffe8208700 (LWP 1321) 0x00007ffff75706c0 in sem_wait () from /lib64/libpthread.so.0 * 1 Thread 0x7ffff7fea7c0 (LWP 1317) 0x000000000042d9e7 in proxy_wait_for_reply (request=0x3ab0880, action=<value optimized out>) at process.c:2830 Thanks Scott Armitage