I believe people who use the line about, "The only reason I wear a mask is because I don't want the hassle that comes with not wearing one" are in many cases covering for their true sentiment - which they're uncountable admitting - of "I don't want people thinking I'm 'that kind of person'."
Years ago I came to no longer give a fuck what others think of me.
Many people SAY they don't care what others think. I live it out every day.