Have memories is the present tense of had memories.
The third-person singular simple present indicative form of have memories is has memories.
The present participle of have memories is having memories.
The past participle of have memories is had memories.