Radius accounting file scanning and upload to database

[Ming-Ching Tiew]

I have implemented a file scanning mechanism to scan the radius 
accounting detail file and subsequently upload to database server 
but at the time of scanning, I detect the presence of a "yesterday" 
file ( ie a completed file). This will mean that my accounting 
record inside the database is one day late.

Now I understand there is a way to instruct radius server to change
the file name hourly, so theoretically I should be able to
scan the presence of "last hour" completed file, and then upload to
database server.

However, assumming the scanning, processing, and subsequent uploading
to database server is very slow, it could mean that from the start 
of one scan to the next scan, if more than one hour has passed, 
I would have missed one of the "last hour" file.

Anyone has a better idea of how to process an hourly file more
gracefully ?