The past tense of remain silent is remained silent.
The third-person singular simple present indicative form of remain silent is remains silent.
The present participle of remain silent is remaining silent.
The past participle of remain silent is remained silent.