We do not currently know of any antonyms for conferree.
The noun conferree is defined as:
Did you mean conferred or conferrer?