We do not currently know of any adverbs for finish.
Using available adjectives, one could potentially construct nonstandard adverbs such as finishably, finishedly, finitoly or finishingly.
Note, however, that these words will not generally be contained within standard English language lexicons.