The past tense of amuse oneself with is amused oneself with.
The third-person singular simple present indicative form of amuse oneself with is amuses oneself with.
The present participle of amuse oneself with is amusing oneself with.