So we're supposed to believe some grumpy, older man is having not one, but TWO lurid affairs with younger women?  Kim Hunter says he's "too short, too fat, and too old".  When asked if he's a karate expert, he says, "I can hardly play croquet."  Why-oh-why-oh-why would any YOUNG woman want this guy!?!  It's just way too unbelievable.
Having Kim Hunter in this episode helps, but it's really dragged down by bad writing.