I don't think it's even about loving football or not loving family enough, I think a lot of men (and women) are afraid of retirement. The fear of what do I do with my free time?
My dad retired in July and is loving every bit of it. Waking up whenever, find new hobbies, learning new things. My mom on the other hand was supposed to retire this month, but has pushed it to January, maybe later. The excuse of making sure she has even position on her team filled or not leaving without her replacement hired and fully trained or some other none factor. I talked with her extensively and she told me her fear was just not knowing what to do with life without deadlines, meetings and the feeling of being needed everyday.