We do not currently know of any synonyms for getting your goat.
For similar words to getting your goat, try: