We do not currently know of any antonyms for endearing person.
For similar words to endearing person, try: