Well-read people are less likely to be evil.
Count Olaf certainly does sound evil. Imagine forcing children to stand near a stove!
Figuratively, they escaped from Cout Olaf and their miserable existence. They did not literally escape, because they were still in his house and vulnerable to Olaf's evil in loco parentis ways.