We do not currently know of any antonyms for having charge of.
For similar words to having charge of, try: