Could not find requested key warnings

I am using the rlm_counter module and am getting “rlm_counter: Could not find requested key in the database.” warnings even though the key (the username) is in the database. I know this because later, without adding any or deleting any users, it does find the user in the database. Why would a user not be found in the database?