The past tense of keep on a tight rein is kept on a tight rein.

The third-person singular simple present indicative form of keep on a tight rein is keeps on a tight rein.

The present participle of keep on a tight rein is keeping on a tight rein.

The past participle of keep on a tight rein is kept on a tight rein.