Put any woman in an area run mostly by men and rumors will fly. Unless you make it very clear that you are off limits, there is also a certain competitiveness that sets in. Some men are either trying to run you out of town or get into your pants. They don't seem to know any other way to deal with a woman. If you're not a sexual object, you're a threat.