We do not currently know of any antonyms for set your heart upon.
For similar words to set your heart upon, try: