I think if you can not separate lust from love.. better to find someone who will reciprocate your feelings to invest your time, thoughts, body and heart on. No strings attached sexual relationships are not something everyone is capable.. if its hurting you, time to close and lock door!
It almost seems like you have, or could have, real feelings for him, but deny them because he has made it clear that all you are is a fuck buddy. Several things your wrote raise warning flags that your emotions run a little deep for someone who is supposed to just be a bed buddy. Like "Why would I want to date you" and "I know if I just cut him out of my life I wouldn't feel like this, but I can't I want him in my life" for example. One of the biggest issues in a FWB situation is the possibility that someone will develop real feelings. If that happens, they can either try to ignore their feelings so the sex continues, or they can talk to the other person and hope for the best. Many choose to ignore their feelings out of fear that the other person will end all contact. It usually ends painfully when emotions get buried. Tread carefully, and be honest with yourself. The worst thing that could happen is he ghosts you, and you have to find someone else. The best thing is he may like you too, and wants more of relationship with you, OR he ghosts you, so that you can find someone who makes you happy in bed, and out of bed.