Small changes in the genetics of a smaller population can lead to larger overall changes in the population's evolutionary fitness. With a smaller number of organisms to work with at the outset, these small changes can be more useful (or more detrimental) to how these organisms will survive or perish in their environments.
