We do not currently know of any antonyms for holding in high esteem.
For similar words to holding in high esteem, try: