It is all about the quality of the communication, not the quantity.
Anytime you are with a horse, no matter if you are a daily rider or one who just gets a chance to ride to the mailbox, you are interacting with your horse. It is all about the quality of the communication, not the quantity. Doing something right once in a while will far surpass anything done wrong more often.
Once you have seen quality horsemanship and are exposed to the things you can do to help a horse be gentle and dependable, then why wouldn't you do those things? No matter what your horse's age, you are going to try to offer him the best that you can. If you adjust what you are doing, he will adjust too; horses have an amazing capacity to make changes. There is always hope.