We can only feel happy and fulfilled if we're engaged in our (soul's) purpose.
Don't feel obligated to spend time with people who pull you off the path of your life purpose.
Everyone has a life purpose, and the key to your life purpose is following your passion, which consumes a lot of time.
A lot of my work is helping people to find their own life's purpose and then follow it. I find that when people are not working on their life's purpose there is a sense of emptiness and anxiety.