The past tense of relieve of is relieved of.
The third-person singular simple present indicative form of relieve of is relieves of.
The present participle of relieve of is relieving of.
The past participle of relieve of is relieved of.