The past tense of go on talking is went on talking.
The third-person singular simple present indicative form of go on talking is goes on talking.
The present participle of go on talking is going on talking.
The past participle of go on talking is gone on talking.