The past tense of go off on tangent is went off on tangent.
The third-person singular simple present indicative form of go off on tangent is goes off on tangent.
The present participle of go off on tangent is going off on tangent.
The past participle of go off on tangent is gone off on tangent.