People get comfortable with the way you are—they have formed their opinion of you based on everything they see and know about you as a person. When you change that up by losing weight, they no longer understand you.