I think the biggest fear is the fear of what a life devoted to God will cost. We love our stuff, don't we? It's the fear of the thought that maybe, just maybe, a life going all in for God might mean we would have to let go of some of our stuff, our way of life, our comforts. That scares people. I know it scares me sometimes.
