We do not currently know of any antonyms for man or woman of learning.
For similar words to man or woman of learning, try: