As a woman who doesn't give a damn about fashion, I'm confused by this weird stereotype.