Mathematical Formulation of Multi-Objective

 

In general, numerical optimization, multi-objective is transformed into a single functional called as a preference function. There are several types of preference function such as weighed summation type, weighted distance type and weighted min-max type.

 

     Weighted Summation Type

 

     Weighted Distance Type

 

     Min-Max Type

 

Conceptually, each local optimum  is preferred as a  in the above formulations. In practical design, no one knows them until solving each single objective optimization. One guesses them properly or replaces them as , where  is the initial design point.

Now, we compare the optimization results for multi-objective formulations. Suppose that  and  will be minimized simultaneously. Figure 1 shows them.

 

Figure 1  Graphical representation of two objectives

 

If the same weightings are used in these two objectives, Figure 1 shows that the pareto optimum is  and .

 

     Weighted Summation Type

 

As the optimum satisfies , it gives

 

Thus, the optimum is , which is different from the Pareto optimum.

 

     Weighted Distance Type

Let the value of  be 2. Then, the distance function is

 

 

By solving ,

 

 

This gives that , which is different from the Pareto optimum.

 

     Weighted Min-Max Type

 

This functional is a composite non-smooth function as follows:

 

 

Figure shows that this formulation gives the Pareto optimum  but it requires some special techniques to overcome the non-smoothness of functional. This is the reason that the min-max type is not used in the gradient-based optimization, even though it can guarantee a local Pareto optimum.