Of course not. Who doesn't from time to time? I have never fantasized about my first wife, but certainly ex-gfs before that that I was intimate with.