The past tense of hold each other close is held each other close.
The third-person singular simple present indicative form of hold each other close is holds each other close.
The present participle of hold each other close is holding each other close.
The past participle of hold each other close is held each other close.