An expectation is a shelter - it gives you a security feeling. So when someone breaks your expectations he is breaking your shelter, making you insecure, fearful.