Almost everyone cares to an extent and it's because a lot of people are judgmental dickheads that will go to great lengths to make your life a living hell. Be it spreading rumors or what have you. They could cost you future friends, lovers, whatever and you will have this annoying stigma attached to you that can't be shaken off. That said, I don't care what others think of me, just so long as I don't have to put up with any bullshit. I don't need things being more difficult than they have to be.