The past tense of relieve is relieved.
The third-person singular simple present indicative form of relieve is relieves.
The present participle of relieve is relieving.
The past participle of relieve is relieved.