Worrying is worthless. When you stop focusing on what has already happened and what may never happen, then you'll be in the present moment. Then you'll begin to experience joy in life.
You need your ego to survive in the three-dimensional world, but you need only that part of the ego which processes information. The rest - pride, arrogance, defensiveness, fear - is worse than useless. The rest of the ego separates you from wisdom, joy, and God.
The more you go within, the more you understand your true nature, and the more joy and happiness you feel in your life.