That’s because it’s a straw-man. Unless someone has serious social deficiencies, this doesn’t happen. The experience is 99% ignore, 0.9% might get “like your shirt”, or “cool band”, 0.1% some weirdo - who would have found something else anyway if it wasn’t your shirt.
Don’t worry everyone, this is just their love language.