The past tense of go to the polls is went to the polls.
The third-person singular simple present indicative form of go to the polls is goes to the polls.
The present participle of go to the polls is going to the polls.
The past participle of go to the polls is gone to the polls.