The past tense of go furtively is went furtively.
The third-person singular simple present indicative form of go furtively is goes furtively.
The present participle of go furtively is going furtively.
The past participle of go furtively is gone furtively.