The past tense of stay with something is stayed with something.
The third-person singular simple present indicative form of stay with something is stays with something.
The present participle of stay with something is staying with something.
The past participle of stay with something is stayed with something.