The past tense of go to pot is went to pot.
The third-person singular simple present indicative form of go to pot is goes to pot.
The present participle of go to pot is going to pot.
The past participle of go to pot is gone to pot.