My wife was traveling and spent the night at a hotel. She told me a girl was very interested in her and vice versa. The girl, an employee there, knocked on my wife'd hotel door and wanted to carry out the obvious flirting in her bed. My wife said she was getting so wet in her panties with anticipation when she saw her and what was about to happen. Then she simply declined because she felt like there just might be an emotional connection that would hurt our relationship and possibly end it. The girl got real pissed off and said she hated teasers and left.
I was the one who declined an invitation, twice. Tempted? YES especially one of them. That was a work place issue for me, I always steered away from that.