We do not currently know of any antonyms for permittee.
The noun permittee is defined as:
Did you mean permitted?