The past tense of go out on a limb is went out on a limb.
The third-person singular simple present indicative form of go out on a limb is goes out on a limb.
The present participle of go out on a limb is going out on a limb.
The past participle of go out on a limb is gone out on a limb.