The past tense of give up the ghost is gave up the ghost.
The third-person singular simple present indicative form of give up the ghost is gives up the ghost.
The present participle of give up the ghost is giving up the ghost.
The past participle of give up the ghost is given up the ghost.