We do not currently know of any synonyms for optimization problem.
The noun optimization problem is defined as:
The problem of finding the "best" solution from all feasiblesolutions, given constraints defining which of the solutions are feasible, and goal function defining which of the feasible solutions is the best one.