We do not currently know of any antonyms for object of one's affections.
For similar words to object of one's affections, try: