I have found this a common problem myself. Maybe try to be more assertive? I find I now have to interrupt people sometimes to get my point across, or say something from my point of view rather than interpreting their's. Have confidence in your perspective on the world.
True story: Back in the day when I was in college I grew a beard and let my hair grow all narly because I was tired of girls coming up to me. It kinda worked, I think until beards started becoming popular again! Didn't work too well though in retrospect - there was this one random chick who decided it was ok for her to play with my long hair while she stood behind me as we rode the elevator. Then another incident at a Radioshack. Didn't know women were into the hobo look. Guess I belong more in the "WTF do they see in me" thread.
Would you guys get out of here. This isn't the cool dudes thread. This thread is for lame guys. Stop showing off.