We do not currently know of any antonyms for prided oneself on.
For similar words to prided oneself on, try: