The past tense of have fun with is had fun with.
The third-person singular simple present indicative form of have fun with is has fun with.
The present participle of have fun with is having fun with.
The past participle of have fun with is had fun with.