Fewer Americans are at work today than in April 2000, even though the population since then has grown by 31 million.