The past tense of go out of business is went out of business.

The third-person singular simple present indicative form of go out of business is goes out of business.

The present participle of go out of business is going out of business.

The past participle of go out of business is gone out of business.