In general, numerical optimization, multi-objective is transformed into a single functional called as a preference function. There are several types of preference function such as weighed summation type, weighted distance type and weighted min-max type.
• Weighted Summation Type
• Weighted Distance Type
• Min-Max Type
Conceptually, each local optimum is preferred as a in the above formulations. In practical design, no one knows them until solving each single objective optimization. One guesses them properly or replaces them as , where is the initial design point.
Now, we compare the optimization results for multi-objective formulations. Suppose that and will be minimized simultaneously. Figure 1 shows them.
Figure 1 Graphical representation of two objectives
If the same weightings are used in these two objectives, Figure 1 shows that the pareto optimum is and .
• Weighted Summation Type
As the optimum satisfies , it gives
Thus, the optimum is , which is different from the Pareto optimum.
• Weighted Distance Type
Let the value of be 2. Then, the distance function is
By solving ,
This gives that , which is different from the Pareto optimum.
• Weighted Min-Max Type
This functional is a composite non-smooth function as follows:
Figure shows that this formulation gives the Pareto optimum but it requires some special techniques to overcome the non-smoothness of functional. This is the reason that the min-max type is not used in the gradient-based optimization, even though it can guarantee a local Pareto optimum.