We do not currently know of any synonyms for make yourself scarce.
For similar words to make yourself scarce, try: