Do you check it when you travel, do you check it when you're just at home? They'd be able to tell something called your 'pattern of life.' When are you doing these kind of activities? When do you wake up? When do you go to sleep? What other phones are around you when you wake up and go to sleep? Are you with someone who's not your wife?
