Sense data are much more controversial than qualia, because they are associated with a controversial theory of perception - that one perceives the world by perceiving one's sense-data, or something like that.