The past tense of get a rise out of is got a rise out of.
The third-person singular simple present indicative form of get a rise out of is gets a rise out of.
The present participle of get a rise out of is getting a rise out of.
The past participle of get a rise out of is gotten a rise out of.