And then like a song we'd forgotten was even on the mix, you stepped into the house and my whole life.
Stealing, of course, is a crime, and a very impolite thing to do. But like most impolite things, it is excusable under certain circumstances. Stealing is not excusable if, for instance, you are in a museum and you decide that a certain painting would look better in your house, and you simply grab the painting and take it there. But if you were very, very hungry, and you had no way of obtaining money, it would be excusable to grab the painting, take it to your house, and eat it.
But there was more, as there always is when the love goes. She was haunted, naturally. Otherwise what is the point, why leave your rickety house, and why this yo-yo world giving us things and yanking them back?
And when love is over when the diner of love seems closed from the outside you want all those hours back along with anything you left at the lover’s house and maybe a couple of things which aren’t technically yours on the grounds that you wasted a portion of your life and those hours have all gone southside.
Figuratively, they escaped from Cout Olaf and their miserable existence. They did not literally escape, because they were still in his house and vulnerable to Olaf's evil in loco parentis ways.