I feel that one should employ methods that reflect the physics of the problem at hand rather than the methods one happens to know.
Data-driven statistics has the danger of isolating statistics from the rest of the scientific and mathematical communities by not allowing valuable cross-pollination of ideas from other fields.
Of course it was always a friendly debate though sometimes I got too loud.
