Quoted in Nicholas Slonimsky, Lexicon of Musical Invective: Critical Assaults on Composers Since Beethoven's Time (1953). Cassell's Humorous Quotations suggests that an earlier version of this jab appeared in a letter by the Fourth Earl of Sandwich in 1785, but no such anecdote is found in the book said to be the source.