We do not currently know of any antonyms for object of affection.
For similar words to object of affection, try: