I have a binder that I keep ALL essential bill-paying items in. It has a zipper pocket that has stamps, envelopes, checks, pen, little calculator, and debit card for the account that all my utilities are paid out of. It also has the most recent utility bills that are due along with a calendar with DUE DATES written out. I have notebook paper inside that I record what was paid, the date, and confirmation number. This is the only way that I can keep track of the finances and be sure my bills get paid!
Also, when there is a tornado warning and we have to go to the basement, this folder usually goes with me. It has everything I would need in case ALL my papers got destroyed.