The past tense of go bump is went bump.
The third-person singular simple present indicative form of go bump is goes bump.
The present participle of go bump is going bump.
The past participle of go bump is gone bump.