We do not currently know of any antonyms for staying with something.
For similar words to staying with something, try: