We do not currently know of any antonyms for in all conscience.
For similar words to in all conscience, try: