The past tense of leave someone holding the baby is left someone holding the baby.
The third-person singular simple present indicative form of leave someone holding the baby is leaves someone holding the baby.
The present participle of leave someone holding the baby is leaving someone holding the baby.
The past participle of leave someone holding the baby is left someone holding the baby.