The idea of creating a stable gene pool from a start point of only one breeding pair, especially in a higher order species like humans is to me... implausible.

You've seen what happens with even small populations like Mormons, or low variation like Dalmatians... genetic instability and retardation.