Very confused, need some relationship advice

I'll give you some background, context is fairly important for this.

I'm 18, a college freshman, as is my boyfriend. This is basically my first relationship with a guy. We're both out (i'm not out to my parents, but he is). We've been dating for a little over two weeks (i know, not very long), but I do care about him a lot. Neither of us are the sort of person who is into flings or one-night stands, and I get the feeling from what he's said that he sees us workin well together, atleast in the short term.

But here's the problem. Though he is out to his friends and family, he doesn't like people knowing that he's gay before they get to know him. He's worried about people prejudging him based solely on that fact, and I totally understand that. I used to feel that way, but then I realized that for me it was based really just on some internalized homophobia. I've since learned to be comfortable with myself regardless of what other people think. I don't care if people think or know I'm gay. In fact i honestly do not care what any stranger thinks, and if a friend has a problem with it then they really aren't a friend.

Well, because he doesn't want people knowing he's gay before they meet him, he is very much against showing affection in any form when we go out to restaurants of parties. I'm not talking violent groping or making out, but normal couple stuff like holding hands or hugging. This makes me feel very uncomfortable; i've grown very used to not having to censor myself, it isn't easy for me to be social or myself when I feel like I have to act 'normal'. He's made it very clear that it's not a problem he has with me.

It just makes me very sad. I feel bad for him. I want him to be able to live freely, but he's very much a people pleaser. I don't care whose toes I step on. He's down to earth and is universally loved. This is the source of our differences, i think.

I basically don't know what to do. I flat out asked him if he intends to live his whole life like this, and he said he does. Frankly, I find that sad and sick, but I know where he's coming from at the same time and it isn't fair of me to push him into something he isn't ready for. Maybe he'll get over this, or maybe it'll become too comfortable of a mask to wear. The point is, I always feel like complete shit after we are done hanging out at a party. We can't act like a couple until we end up back at one of our places, and then we end up having sex which makes me feel almost as if i'm being used (i know i'm not though, but i can't help but feel uneasy about it).

Anyway, my question is this: am i being unreasonable?
Should i be more patient? Should I try to help him be more comfortable with his sexuality? I just don't know what to do. I care for him so much but it's a huge source of tension for me and it can be very hard to be happy. I also know we've only been dating for a little over two weeks, so things are still in a very fluid state and could change pretty quickly.

advice?