We do not currently know of any antonyms for man or woman of letters.
For similar words to man or woman of letters, try: