So it sounds like his mistress is jealous of you. You have something she wants or wishes she had. Maybe next time you have a moment alone with her, compliment her. I find what the other woman prides herself on and then say something self deprecating while building her up. You could also just continue to engage in a war of egos for the rest of your life.