The past tense of have it going on is had it going on.
The third-person singular simple present indicative form of have it going on is has it going on.
The present participle of have it going on is having it going on.
The past participle of have it going on is had it going on.