We do not currently know of any antonyms for with a vengeance.
The prepositional phrase with a vengeance is defined as: