All of the progress that the US has made over the last couple of centuries has come from unemployment. It has come from figuring out how to produce more goods with fewer workers, thereby releasing labor to be more productive in other areas. It has never come about through permanent unemployment, but temporary unemployment, in the process of shifting people from one area to another.
Rich people are the experimental ground for every new development. The nature of progress is that what begins as a luxury for the rich becomes a necessity for the poor as it's developed and passed on.
Everywhere, and at all times, economic progress has meant far more to the poor than to the rich.