Go off on a tangent is the present tense of went off on a tangent.
The third-person singular simple present indicative form of go off on a tangent is goes off on a tangent.
The present participle of go off on a tangent is going off on a tangent.
The past participle of go off on a tangent is gone off on a tangent.
