Fondness for people can be terrifying, because it's intangible and it can disappear, or it can be taken away, or you can say the wrong thing. A million things, so it's so uncomfortable. So when you suddenly become aware of it because they don't call you or something for half an hour or whatever, you lose it.
