The past tense of do on the sly is did on the sly.
The third-person singular simple present indicative form of do on the sly is does on the sly.
The present participle of do on the sly is doing on the sly.
The past participle of do on the sly is done on the sly.