Sometimes there’s something or someone that holds us back from wearing something one likes. I suggest you should not hold back and just wear what you like. Your style is a representation of you! Who cares what others say?!
Wear it proudly, its your style.