We do not currently know of any antonyms for holding sway over.
For similar words to holding sway over, try: