The past tense of window-shop is window-shopped.
The third-person singular simple present indicative form of window-shop is window-shops.
The present participle of window-shop is window-shopping.
The past participle of window-shop is window-shopped.