We do not currently know of any antonyms for remembering with pleasure.
For similar words to remembering with pleasure, try: