We do not currently know of any antonyms for start off with.
For similar words to start off with, try: