In physics, your solution should convince a reasonable person. In math, you have to convince a person who's trying to make trouble. Ultimately, in physics, you're hoping to convince Nature. And I've found Nature to be pretty reasonable.
Frank Wilczek, Betsy Devine (2006). “Fantastic Realities: 49 Mind Journeys and a Trip to Stockholm”, p.516, World Scientific
