Is It Possible Rejection From Women Can Turn Someone Bisexual?

I understand you can't turn bisexual, gay, or straight, it's in your genetics, but I'm just very confused right now.
Let me explain. I'm a 30 year old man, who has had very little luck with women. In my life, I've had zero girlfriends, am still a virgin, and have only kissed two women in my life.
I'm not attracted to men, at least not to their faces. I never have, and I've honestly tried in a serious effort to see if I was at all attracted to a man's face, but I'm just not. I am very much attracted to women, there are times where I will basically start having a crush or daydreaming about every living woman I see.
But I have been sexually attracted to men since I was about 20. It started slowly, but as I further explored the particular sexual fetish of mine, thanks to the internet, I became more interested in the idea.
My sexual fantasy basically involves me dressing up in womens clothing and being submissive to another man. I have no interest in having an actual emotional relationship, just purely physical. Now, I've yet to ever try anything before, simply out of fear of std's (Because I've only tried talking to men on craigslist and I've heard enough bad things about craigslist to know it's not the best place to trust someones word)
Here is the thing though. This fantasy of mine only occupies my mind when I go a long amount of time without any kind of interaction or flirtation from women at all.
Say I were to work up the courage to ask a woman at my job out, and maybe send a few messages to women on some of the online dating sites I'm on, but get no positive responses or responses at all, usually that will trigger my depression, I'll be sad for a day or two, and it's almost like I feel that I'm just completely unattractive, physically and emotionally, too fucked up for a woman to ever love.
But like all men, I still get horny, so what happens then, while I'm in this "No woman will ever love me" state, I start getting interest in my sexual fantasy with men again. I start actively posting on craigslist, looking for a man who I will then talk to a little and get to know, and will legitimately think I will finally try it for once this time. I stop thinking about women during this time, because I'm just convinced that I'm so unappealing to them in every way, why should I even bother?

But as SOON as I get any kind of interaction from a woman, whether it's one simply smiling at me, laughing at a joke of mine, or responding to a message on a dating site, the fantasy involving men completely dissipates from my mind. I literally have zero interest in it whatsoever. And it stays that way until I get depressed again. The same thing actually happens with masturbation. Say I'm in one of the phases where I feel interested in sex with another man, as soon as I orgasm, my interest in the fantasy is gone for at least week.

I'm just very confused, I know a lot of people say labels are pointless, but this is a vicious cycle in my life that I just don't understand. I know it likely is being very much affected by my paranoia, anxiety, and depression, but I wanted to get some feedback.
Does this sound just like some kind of particular fetish I have? Basically I like dressing up in women's clothing and the idea of being sexually submissive to another man, but don't want to wear makeup or dress up in drag. It's only in the bedroom I'd like to try that stuff.
Or perhaps I've always been bisexual? But then why does that side of me only come out when I'm depressed and lonely? It almost feels like my brain (Or perhaps my dick) is telling me "Well you have no shot with women so might as well meet a guy and try out your fantasy"
And let me just state, I'm at my happiest when I do feel like I have a shot with women. I'm actually getting therapy fairly soon for my high and low mood swings, but that is another issue.
If I had one wish though, had to chose between the two, I would love nothing more than to find a woman I love and live a long happy life together with, raising kids, etc..

I'm just very confused here is all, would love any kind of feedback I can receive.

 

Lots of straight men get rejected by women constantly without ever going gay. As far as genetics, there's no credible, peer reviewed evidence that is actually the case. Neil Whitehead has disproven any notion of such.

 

I think of sexuality as somewhat fluid for some people. Also, I think you just illustrated why prison sex happens.

also, when I typed prison I originally made the typo orison

 

I always.assumed with both prison sex and orison sex, the exact same things happen

 

On a more serious note.

No there is nothing that exists that is 'genetic'

 

if rejection from women could turn you bisexual, i think i would be beyond that and into pansexuality by now. being bisexual makes you bisexual.

 

Thanks for all the feedback so far. I wasn't intending to say rejection was turning me bisexual. The header was more to grab peoples attention. I'm new to this forum so not sure how much people respond to posts.
My real questioning was to see what other peoples opinions were. I've tried opening my mind to the idea of having an emotional, real relationship with another man, but I just couldn't see myself doing it as I'm not attracted to men's faces and I long to be in love with a woman.
So I've just been very confused as to whether I'm bisexual, bi-curious, just have a kinky bi-curious fantasy, or in the end does it all just boil down to there being a huge spectrum of sexualities? I've heard people say the latter, and that labels are pointless, maybe that's the case with me. I was just wondering if anyone else had a thought or could relate in any way.