We do not currently know of any antonyms for toy with the idea of.
For similar words to toy with the idea of, try: