We do not currently know of any antonyms for have the freedom to.
For similar words to have the freedom to, try: