This chapter proposes a genetic algorithm (GA)-based approach as an all-purpose problem-solving method for optimization problems with uncertainty. This chapter explains the GA-based method and presents details on the computation procedures involved for solving the three types of inexact optimization problems, which include the ILP, inexact quadratic programming (IQP) and inexact nonlinear programming (INLP) optimization problems.
- genetic algorithms
- inexact optimization problem
- linear programming
- quadratic programming
- nonlinear programming
Linear and nonlinear programming are considered powerful optimization tools suitable for modeling and solving complex optimization problems in engineering. To handle uncertainty in real world data, inexact parameters and constraints are combined with various kinds of optimization techniques. Often a detailed solution of an inexact programming optimization problem involves a large number of direct comparisons to interactively identify the uncertain relationships among the objective function and decision variables, whether the problems are medium-sized or larger-scaled. When these methods are applied to complicated and nonlinear problems, the number of direct comparisons can become exponential.
The genetic algorithm (GA) method is a suitable optimization approach especially for solving problems that involve nonsmooth and multimodal search spaces. The GA-based optimization technique is suitable for solving linear and nonlinear programming optimization problems with inexact information; and the fields of application include operations research, industrial engineering and management science.
This chapter is organized as follows. Section 2 presents the background and literature review of this research. Section 3 discusses the proposed GA-based methods for solving inexact linear programming (ILP), inexact quadratic programming (IQP) and inexact nonlinear programming (INLP) problems. Section 4 presents the case study of using GAINLP in the solution of an INLP problem of solid waste disposal planning. Section 5 is the conclusion.
2. Background and literature review
Economic optimization in the operation programming of solid waste management was first proposed in the 1960s . Different models of waste management planning have been developed in the following decades. The primary considerations involved include cost control, environmental sustainability and waste reutilization. The techniques employed include linear programming [2–5], mixed integer linear programming , multiobjective programming [7–9], nonlinear programming [10, 11], as well as their hybrids, which involve probability, fuzzy set and inexact analysis [12–16]. Due to complexity of the nonlinear programming problems for solid waste management, research works in the area are scant; some exceptions include [17, 18].
The approach of operational programming with inexact analysis often treats the uncertain parameters as intervals with known lower and upper bounds and unclear distributions. In real-life problems, while the available information is often inadequate and the distribution functions are often unknown, it is generally possible to represent the obtained data with inexact numbers that can be readily used in the inexact programming models. For decision makers, it is usually more feasible to represent uncertain information as inexact data than to specify distributions of fuzzy sets or probability functions. Hence, various kinds of inexact programming such as ILP, IQP, inexact integer programming (IIP), inexact dynamic programming (IDP) and inexact multiobjective programming (IMOP) have been developed and are well discussed [10, 11, 19]. It can be observed from these studies that applications of inexact models to practical solid waste planning systems are effective. These research reports demonstrated substantial effort has been developed to traditional binary analysis for ILP and IQP. However, traditional binary analysis methods for ILP and IQP involve unavoidable simplifications and assumptions, which often increase the chance for error in the problem-solving process and adversely affected the quality of the results. Moreover, a more complex model often increases the chance of error in the solution. It has been observed that more complex models often produce less optimal results, and studies that focus on INLP problems are scarce. For example, in , the methodology mainly focused on combining endpoint values of the inexact parameters to form a set of deterministic problems, which will only work for particular monotone functions within a small-scale model. Therefore, a more flexible problem-solving method for the general inexact optimization problems is desired.
Engineering problems that have traditionally been formulated as IQP or INLP problems often involve large and uneven search spaces, for which a global optimal solution is often not required. GA is a suitable optimization tool especially for solving complex and nonlinear problems, which involve nonsmooth and multimodal search spaces. Therefore, we suggest a GA-based method as a more effective problem-solving approach than the traditional inexact programming methods.
For implementation of GA, the Genetic Algorithm Solver of Global Optimization Toolbox (GASGOT), developed by MATLAB (Trademark of MathWord), has been adopted. GASGOT implements simulated evolution in the MATLAB environment using both binary and floating point representations and the ordered base representation. This enables flexible implementation of the genetic operators, selection functions, termination functions and evaluation functions. GASGOT was developed by the Department of Industrial Engineering of North Carolina State University as a toolbox of MATLAB. Hence, it runs in a MATLAB workspace and can be easily invoked by other programs.
In this study, the GA linear program solving engine of GASGOT has been adopted for ILP problems and GA nonlinear program solving engine of GASGOT has been adopted for IQP and INLP problems.
3.1. GA-based method for solving ILP problems (GAILP)
A typical ILP problem can be expressed as follows:
where are inexact parameters and is an inexact variable. It is assumed that an optimal solution exists. For an inexact number , and are the upper and lower bounds, respectively.
GA has been adopted for solving ILP problem. In this GA approach, the upper and lower bounds of the inexact numbers of coefficients can be determined by substituting the initial suboptimal decision variables into the objective function. and can be calculated directly without any uncertainty in the coefficients. This approach is called the GA-based method for solving ILP problems, or the GAILP method.
GAILP has been designed to include three stages, which are discussed as follows:
The objective of the first stage is to get an initial suboptimal for the following problem, which is transformed from the ILP problem defined in Eq. (1):
Where are random numbers that satisfy the continuous uniform distribution in the intervals of , and ,respectively. Then, the problem is solved by the GA linear program solving engine of GASGOT, which uses the objective function in Eq. (2) as the positive term of the fitness function and the constraints of Eq. (1) as the negative punishment terms. Thus, a suboptimal solution can be identified and the corresponding decision variables of are also obtained.
In the second stage, the inexact coefficients of will be determined. Let the determined coefficients corresponding to be and those corresponding to be . These two sets of coefficients can be obtained using the following method.
To identify the coefficients corresponding to , a set of objective functions needs to be constructed and solved. Since are suboptimal variables, which tend to make the objective function closer to , consider as variables, then the objective function of Eq. (4) can be constructed so as to find .
The coefficients are considered to be corresponding to .
Meanwhile, the objective function presented in Eq. (5) can be constructed so as to find .
There are two kinds of decision schemes for inexact programming problems, which are the conservative scheme and the optimistic scheme . The former assumes less risk than the latter, so that for a maximization objective function, planning for the lower bound of an objective value represents the conservative scheme and planning for the upper bound of an objective value represents the optimistic scheme. In terms of constraints, the conservative scheme involves more rigorous or stringent constraints and the optimistic scheme adopts more tolerant ones.
Thus, the problem of searching for of the optimistic scheme and corresponding to the upper bound of the objective value of can be represented as follows:
will give of the conservative scheme, corresponding to the lower bound of the objective value of .
Hence, the values of and can be calculated.
In the third stage, the problem represented in Eq. (1) is converted into the following two subproblems:
Generally speaking, the interactive binary algorithm (IBA) proposed in [19, 22] can be used for solving inexact linear problems reliably and relatively quickly. However, this binary algorithm has some limitations. One of them, for example, is the limitation that the upper and lower bounds of an inexact coefficient cannot have different signs. In contrast, the GAILP does not have this kind of limitation because the GA method does not depend on any assumed distribution of the inexact parameter. Hence, the GAILP method effectively extends the scope of problems solvable using the methods of ILP. It is more adaptable for real world applications of optimization problems with uncertainty.
A sample ILP problem in  is as follows,
By using the traditional IBA method , two submodels are obtained,
The results were .
By using the GAILP, the results can be calculated with the following objective functions:
The results were .
The GAILP method generates a solution, which is different from that obtained using the IBA proposed in . A comparison will be discussed as follows:
For the optimistic scheme, the GAILP method can generate a result that is guaranteed to be as close as possible to the upper bound of the constraints. Hence, the maximized value of the objective function is greater than that produced by the IBA. For the conservative scheme, the GAILP method has a higher probability of satisfying the requirements of the constraints as close as possible to the lowest limit. Hence, the maximized objective value is smaller.
In Figures 1 to 4, the bold lines denote the boundaries of the constraints, which limit the possible values for to the left lower area. The constraint is shown in these figures as the grey bold solid lines, which is the same for both the IBA and GAILP methods. The dark bold dotted lines represent the constraint of given by the IBA and the dark bold solid lines represent the same constraint given by the proposed GAILP method.
The boundaries, together with the
In Figures 1 to 4, the thin dotted lines are given by the IBA and the thin solid lines represent the objective functions given by the proposed GAILP method. The legends for Figure 1 to 4 are listed in Table 1.
3.2. GA-based method for solving IQP problems (GAIQP)
The GAILP method can be extended to solve the IQP problems or other more complicated INLP problems.
A typical IQP problem is formulated as follows:
where are inexact parameters and is an inexact variable.
In stage one, to obtain an initial suboptimal from a problem transformed from the IQP problem:
where are random numbers that satisfy the continuous uniform distribution in the intervals and . Then, a suboptimal solution can be identified, and the corresponding decision variables are also obtained.
In the second stage, substituting into the formula in Eq. (11). To determine the coefficients corresponding to
To determine of the optimistic scheme and corresponding to the upper limit of the objective value of
In the third stage, the problem expressed in Eq. (11) has been converted into the following two subproblems:
The inexact information has been incorporated in these two subproblems. These two subproblems, as typical nonlinear programming problems, can be solved by the GA nonlinear program solving engine of GASGOT.
3.3. GA-based method for solving inexact nonlinear problems (GAINLP)
Quadratic programming problems are specific cases of nonlinear programming problems. Due to the lack of generally applicable algorithms for handling the nonlinear structure and the inexact information embedded in the structure, most nonlinear programming problems are difficult to solve. The IBA method proposed in [11, 22] is not intended for dealing with generic nonlinear problems. In contrast, the GA-based method can be used as a general problem solver for this type of problems because there is not much difference for GA between treating the term of in quadratic programming problems and the terms or in generic nonlinear programming problems. GAIQP can be modified to solve generic inexact nonlinear programming.
In the following, a computation experiment will be conducted to illustrate how the GAINLP method can handle complicated inexact nonlinear problems. A sample INLP problem is as follows:
where are inexact parameters and is an inexact variable. In this experiment,
GAINLP has been designed to include the three stages of problem solving.
In stage one, to obtain the initial suboptimal , the random numbers of were selected to transform this INLP problem into a NLP problem, such that satisfy the continuous uniform distribution in the intervals of and .
Then, the heuristic search algorithm of the GA nonlinear program solving engine of GASGOT can be used to identify a suboptimal solution , and the corresponding decision variable . The objective function in Eq. (20) was used as the positive term of the fitness function and the constraints of Eq. (19) adopted as the negative punishment terms. The results are .
In stage two, by substituting into Eq. (19), the inexact coefficients of will be determined. Theobtained in stage one are used to construct two optimization problems in order to determine the coefficients of and , respectively. The coefficients from the first group are considered to be corresponding to the optimistic scheme , while those from the second group correspond to the conservative scheme . Considering are variables, the following two objective functions can be constructed:
To determine of the optimistic scheme corresponding to the upper limit of the objective value , the objective function can be constructed as follows:
The objective functions to get of the conservative scheme are
In stage three, the objective function presented in Eq. (20) is converted into the following two subproblems:
As demonstrated above, it can be seen that the GAINLP method can generate the optimal result without any simplification or assumption, and it can be adapted for applications of optimization problems with uncertainty. The next section demonstrates application of this method to a real world regional waste management problem.
4. Case study
Solid waste management is the process of removing waste materials from the surrounding environment, which involves the collection, separation, storage, processing, treatment, transport, recovery and disposal of solid waste. Landfill and incineration are two of the most commonly used solid waste disposal methods. The objective of a solid waste management process is to dispose discarded materials in a timely manner so as to prevent the spread of disease, minimize the likelihood of contamination and reduce their effects on human health and the environment.
The economy of scale (ES) is a microeconomics term, and it refers to the advantages that enterprises obtain due to their size or scale of operation, with the cost per unit of output generally decreasing as the scale increases and fixed costs are distributed over more units of output. In a solid waste management system, ES exists within the transportation process  and it can be expressed as a sizing model with a power law .
where (t/d) is a waste flow decision variable; (t/d) is a reference waste flow; ($/t) is the transportation unit cost due to the ES of waste flow(t/d); ($/t) is a coefficient reflecting the significance of the ES to the unit cost of waste transported for reference waste flow (t/d), ; and
The study region includes three municipalities, a waste-to-energy (WTE) facility and a landfill, as shown in Figure 5. Three time periods are considered; each has an interval of five years. Over the 15-year planning horizon, an existing landfill and WTE facilities are available to serve the municipal solid waste (MSW) disposal needs in the region. The landfill has an existing capacity of , and the WTE facility has a capacity of .The WTE facility generates residues of approximately (on a mass basis) of the incoming waste streams, and its revenue from energy sale is combusted.
Table 2 shows the waste generation rates of the three municipalities and the operating costs of the two facilities in the three periods.
|Waste generation (t/d)|
|Municipality 1 (||[260, 340]||[310, 390]||[360, 440]|
|Municipality 2 (||[160, 240]||[185, 265]||[210, 290]|
|Municipality 3 (||[260, 340]||[260, 340]||[310, 390]|
|Operation cost ($/t)|
|Landfill (||[30, 45]||[40, 60]||[50, 80]|
|WTE facility (||[55, 75]||[60, 85]||[65, 95]|
Taking into consideration the effects of the ES, the INLP model can be formulated as follows:
In this objective function (Eq. (26)), the first term on the right side reflects the transportation costs in each management period (
The MSW generation rates generally vary between different municipalities and for different periods, and the costs for the waste transportation and treatment also vary temporally and spatially. Furthermore, interactions exist between the waste flows and their transportation costs due to the effects of the ES (Eq. (25)). Table 3 and Table 4 show the parameters related to the ES, which include the fixed unit transportation cost , the reference waste flow and the coefficient corresponding to .
|Fixed unit transportation cost ($/t)||Reference waste flow (t/d)|
|[14.58, 19.40]||[16.04, 21.34]||[17.64, 23.48]||[220, 250]||[240, 280]||[260, 320]|
|[12.65, 16.87]||[13.92, 18.56]||[15.31, 20.41]||[160, 200]||[180, 220]||[220, 260]|
|[15.30, 20.49]||[16.83, 22.53]||[18.52, 24.79]||[160, 200]||[180, 240]||[200, 240]|
|[11.57, 15.42]||[12.73, 16.97]||[14.00, 18.66]||[200, 240]||[240, 280]||[280, 320]|
|[12.17, 16.15]||[13.39, 17.76]||[14.73, 19.54]||[120, 170]||[150, 190]||[180, 220]|
|[10.60, 14.10]||[11.67, 15.51]||[12.83, 17.06]||[220, 270]||[220, 270]||[240, 270]|
|[5.71, 7.62]||[6.28, 8.38]||[6.91, 9.33]||[170, 200]||[200, 260]||[240, 270]|
Hence, it can be observed that the traditional IBA cannot solve this problem without additional assumptions or simplifications. The following discussion will explain how traditional methods solve this problem by simplifying the nonlinear effects of the ES.
(i) Let , the effects of the ES are totally ignored. This converts the INLP problem to an ILP problem, and the GAILP method can solve the problem.
(ii) Assuming, it is indicated that the nonlinear relationships in Eq. (26) can be approximated with grey quadratic functions within a predetermined degree of error. Thus, the INLP problem is converted into an IQP problem.
The left two columns of Table 5 list the solutions for and .
Both of the above simplifications introduce inaccuracy and limitations. When the value of
Applying the GAINLP model on the inexact nonlinear programming problem, the optimization problem can be solved directly without additional assumptions for the effects of the ES. Three different scenarios, () have been tested, and the solutions given by the GAINLP model are shown in the right three columns of Table 5.
The above three scenarios assume that the ES exponent is universal in the whole region during the entire period. However, this is not always necessarily true for practical engineering problems. More common situations may involve different scale exponents for various combinations of municipalities and facilities in different periods. Thus, Table 6 illustrates the solutions for the 4th scenario, which involves different scale exponents.
|Decision variable(t/d)||ILP solution||IQP solution||Other solutions|
|[210, 290]||[250, 290]||[203, 292]||[100, 221]||[35, 88]|
|0||[310, 350]||[1, 36]||[1, 44]||[1, 36]|
|[0, 30]||[360, 440]||[1, 44]||[126, 190]||[240, 300]|
|0||[0, 30]||[1, 43]||[60, 141]||[144, 240]|
|[0, 65]||[185, 225]||[1, 73]||[20, 103]||[75, 148]|
|[210, 290]||[50, 80]||[200, 290]||[200, 259]||[197, 260]|
|[0, 30]||0||[1, 37]||[90, 190]||[225, 312]|
|[260, 330]||0||[247, 332]||[189, 270]||[120, 200]|
|[170, 200]||0||[154, 209]||[139, 210]||[143, 192]|
|50||[10, 50]||[35, 58]||[120, 167]||[220, 307]|
|[310, 390]||[0, 40]||[295, 390]||[299, 385]||[295, 390]|
|[360, 410]||0||[329, 426]||[202, 323]||[120, 161]|
|[160, 240]||[160, 210]||[147, 240]||[55, 145]||[1, 30]|
|[185, 200]||[0, 40]||[165, 222]||[142, 200]||[80, 154]|
|0||[160, 210]||[1, 25]||[1, 40]||[1, 43]|
|[260, 310]||[260, 340]||[230, 320]||[122, 164]||[12, 40]|
|[0, 10]||[260, 340]||[1, 28]||[30, 100]||[108, 167]|
|[140, 190]||[310, 390]||[125, 200]||[125, 194]||[120, 214]|
|= ()||[220.2, 507.4]||[239.5, 514.1]||[209.8, 522.3]||[200.5, 519.6]||[197.6, 516.8]|
In the 4th scenario, the weight of the transportation cost in the system operation cost varies according to different values. The effect becomes significant when waste flow becomes lower and the hauling distances are substantial. This effect is a nonlinear function of the waste flow , in which the reference waste flow and the ES exponent
|Decision variable||Solution (t/d)||Decision variable||Solution (t/d)|
|[100, 192]||−0.15||[125, 189]||−0.1|
|[0, 40]||−0.2||[300, 390]||−0.15|
|[112, 178]||−0.35||[205, 312]||−0.15|
|[65, 139]||−0.2||[42, 142]||−0.45|
|[40, 78]||−0.3||[129, 192]||−0.3|
|[199, 279]||−0.3||[0, 40]||−0.1|
|[90, 189]||−0.25||[100, 198]||−0.3|
|[135, 280]||−0.25||[44, 113]||−0.45|
|[127, 218]||−0.3||[99, 219]||−0.4|
The results also show that when the value of the ES exponent
In this chapter, the GA-based methods have been proposed and applied for identifying an all-purpose optimization solution for the ILP, IQP and INLP problems. These methods are called GAILP, GAIQP and GAINLP. Compared to these GA-based methods, the traditional problem-solving method has limitations due to the complexity involved in selecting the upper or lower bounds of variables and parameters when the subobjective functions are being constructed. The complexity arises due to the extensive computation and necessary associated assumptions and simplification. The solution procedures of the proposed GA-based optimization methods do not involve any such assumption or simplification, and the quality of the result is guaranteed. The GAINLP was applied to a solid waste management optimization problem, and the result analysis illustrates the practicality and flexibility of the proposed GAINLP method for solving more complex INLP problems.
GAILP, GAIQP and GAINLP have been implemented in MATLAB, and can be easily extended to include other nonlinear operation programming software packages so as to enhance the flexibility and efficiency of the problem-solving process. The GA-based heuristic optimization approach is flexible and it can be extended to find solutions for various types of operation programming scenarios that involve nonlinear optimization and inexact information. It can also be used as an all-purpose algorithm for economic optimizations.
The authors gratefully acknowledge the support of the Canada Research Chair program and the Natural Sciences and Engineering Research Council of Canada.