The past tense of stay silent is stayed silent.
The third-person singular simple present indicative form of stay silent is stays silent.
The present participle of stay silent is staying silent.
The past participle of stay silent is stayed silent.