I pay all my bills online and do not receive any paper bills at home. Who wants all that stuff anyways?! I also use a spreadsheet for our budget. My worry was that I was just paying things online and not really having anything in return except once it clears my bank account when it appears on my virtual statement. So for my piece of mind, I bought this little pink book:
I record the days that payments are made and the confirmation numbers that the website give you when a payment is accepted. Works for me!