The problem isn't materialism as such. Rather it is the underlying assumption that full satisfaction can arise from gratifying the senses alone. Unlike animals whose quest for happiness is restricted to survival and to the immediate gratification of sensory desires, we human beings have the capacity to experience happiness at a deeper level which, when achieved, can overwhelm unhappy experiences.