In whatever you choose to do, do it because it's hard, not because it's easy. Math and physics and astrophysics are hard. For every hard thing you accomplish, fewer other people are out there doing the same thing as you. That's what doing something hard means. And in the limit of this, everyone beats a path to your door because you're the only one around who understands the impossible concept or who solves the unsolvable problem.