We do not currently know of any antonyms for keeping the faith.
For similar words to keeping the faith, try: