We do not currently know of any synonyms for getting under skin.
For similar words to getting under skin, try: