We do not currently know of any antonyms for risen up in arms.
For similar words to risen up in arms, try: