The reduced variability of small populations is not always due to accidental gene loss, but sometimes to the fact that the entire population was started by a single pair or by a single fertilized female. These 'founders' of the population carried with them only a very small proportion of the variability of the parent population. This 'founder' principle sometimes explains even the uniformity of rather large populations, particularly if they are well isolated and near the borders of the range of the species.
Ernst Mayr (1942). “Systematics and the Origin of Species, from the Viewpoint of a Zoologist”, p.237, Harvard University Press