Visiting Key West with a Friend

Well, he is more than a friend. He was a former love interest some 45 years ago. I had dreamed of his one day realizing what he had turned away. But, as time went by, he became more and more self-absorbed and arrogant and superior. Some would call him a narcissist. His conversations can sometimes sound like a pedantic challenge and the worst moments that I dread are those when he plays Henry Higgins and tries to guess where someone is from. I have told him that there are some people who (a) may not want to reveal that personal information, or (b) may be concerned that the person asking might work for the government, or (c) may not want to be interrogated for more information than he or she might care to divulge.
The man got a deal on a room in a time share in Key West and he asked me to join in on the 8-hour to get there. I did. He said that he i not all that keen on doing long distance driving. His roadwork on the interstate as horrifying and frightful. He would go at least 20 mph above the speed limit and then get ticked off if someone were to pass him. He would feel compelled to tell me what the other person's speed was (as if it were information of interest or value to me). The weaving and the speeding were horrifying and I know who is going to be behind the wheel for most of the return trip driving.
He feels compelled to invite his lesbian friend to meals. I'm certain that she would probably prefer to spend time with 'her own kind,' but I don't make a thing of it. She had brunch with us the second afternoon that we had arrived. The following day she joined us and invited two of her friends. And tonight she is inviting the same two friends and two more. I, however, am an introvert and don't like crowds and don't warm up to strangers either. I'm the one who sits and smiles and remembers what someone had said 30-60 minutes ago and can repeat it at an appropriate moment at a later time. However, such social grace exhausts the sh*t out of me and I would rather be one-on-one with someone I know.
I have another day with him here and then on Thursday we drive back to his place. I return home on Friday. Am I the only person who finds vacations exhausting? I absolutely hate being outside for any lengthy of time unless I am doing solitary ambulating. And that's best done when it's not so hot. I'd get up relatively early (5:30-6:00) and take a walk. There aren't many places that serve at that hour; at 7:00 am some Cuban restaurants open the grills.
In another 5 days I will be back at work doing the boring rote work that I do best. I will be with my dog and my cat. And I will not be at the mercy of someone else's whims and fancies. Now I remember why I never got married.