I think that's the real horror story for me, how little you can ever really know about your own motivations. How in the dark we all are about the concerns and the contents of our minds.
So much of the way books get classified has to do with marketing decisions. I think it's more useful to think of literary books and sci-fi/fantasy books as existing on a continuum.