The past tense of have a party is had a party.
The third-person singular simple present indicative form of have a party is has a party.
The present participle of have a party is having a party.
The past participle of have a party is had a party.