The past tense of marry with is married with.
The third-person singular simple present indicative form of marry with is marries with.
The present participle of marry with is marrying with.
The past participle of marry with is married with.