The past tense of get on someone's last nerve is got on his last nerve.
The third-person singular simple present indicative form of get on someone's last nerve is gets on his last nerve.
The present participle of get on someone's last nerve is getting on his last nerve.
The past participle of get on someone's last nerve is gotten on his last nerve.