The past tense of go on the rampage is went on the rampage.

The third-person singular simple present indicative form of go on the rampage is goes on the rampage.

The present participle of go on the rampage is going on the rampage.

The past participle of go on the rampage is gone on the rampage.