We do not currently know of any antonyms for lady's man.
The noun lady's man is defined as:
See full definition of the word lady's man.