The past tense of give oneself up to is gave oneself up to.
The third-person singular simple present indicative form of give oneself up to is gives oneself up to.
The present participle of give oneself up to is giving oneself up to.
The past participle of give oneself up to is given oneself up to.