The past tense of think on one's feet is thought on one's feet.
The third-person singular simple present indicative form of think on one's feet is thinks on one's feet.
The present participle of think on one's feet is thinking on one's feet.
The past participle of think on one's feet is thought on one's feet.