The past tense of keep company with is kept company with.
The third-person singular simple present indicative form of keep company with is keeps company with.
The present participle of keep company with is keeping company with.
The past participle of keep company with is kept company with.