The past tense of continue walking is continued walking.
The third-person singular simple present indicative form of continue walking is continues walking.
The present participle of continue walking is continuing walking.
The past participle of continue walking is continued walking.