[]\fnmVassilis \surM. Charitopoulos
]\orgdivDepartment of Chemical Engineering, The Sargent Centre for Process Systems Engineering, \orgnameUniversity College London, \orgaddress\streetTorrington Place, \cityLondon, \postcodeWC1E 7JE, \countryUK
Global and Robust Optimisation for Non-Convex Quadratic Programs
Abstract
This paper presents a novel algorithm integrating global and robust optimisation methods to solve continuous non-convex quadratic problems under convex uncertainty sets. The proposed Robust spatial branch-and-bound (RsBB) algorithm combines the principles of spatial branch-and-bound (sBB) with robust cutting planes. We apply the RsBB algorithm to quadratically constrained quadratic programming (QCQP) pooling problems, utilising McCormick envelopes to obtain convex lower bounds. The performance of the RsBB algorithm is compared with state-of-the-art methods that rely on global solvers. As computational test bed for our proposed approach we focus on pooling problems under different types and sizes of uncertainty sets. The findings of our work highlight the efficiency of the RsBB algorithm in terms of computational time and optimality convergence and provide insights to the advantages of combining robustness and optimality search.
keywords:
Robust optimisation, Spatial Branch and Bound, Pooling problems, Global Optimisation, Cutting planes1 Introduction
One of the fundamental assumptions when constructing mathematical programming models is the degree of uncertainty in the input parameter data. If uncertainty is neglected, then a deterministic optimisation problem is generated, while for the case where uncertainty is considered to some degree, there are various methods to model uncertainty. There are two key drivers for the selection of the appropriate optimisation method: statistical data availability and desired degree of robustness. Robust optimisation has emerged as a leading method for problems with limited uncertain parameter data and requirements for a risk-averse solution. In a robust optimisation context, solutions that lead to attainable decisions under all parameter realisations are referred to as robust feasible, while the solution that also leads to the best objective value is called robust optimal. A general form of the robust optimisation problem is given by ().
() | ||||
where denotes continuous decisions, and is the vector of uncertain parameters that resides within an uncertainty set . Despite the presence of an embedded optimisation problem within (), robust optimisation problems can yield tractable reformulations under restrictive assumptions about the problem structure. That is, if Problem () is convex with respect to the decisions and concave in , and is a convex set, then using duality theory one can derive a tractable robust counterpart reformulation of Problem (). Because of this, the field of convex robust optimisation is well-established, whereas the field of non-convex robust optimisation is still at its infancy [1].
State-of-the-art robust optimisation algorithms for non-convex problems typically rely on global solvers to obtain robust optimal solutions. The prevailing approach involves deriving the dual reformulation and utilising a global solver, either directly or adaptively. However, the dual reformulation can increase the problem complexity, and in the case of challenging non-convex problems may only yield a robust feasible solution. An alternative approach is based on an iterative robust cutting plane algorithm. In this case, significant computational time can be spent searching for a global solution that may be deemed robust infeasible.
Contributions of this work: Our research hypothesis is that integrated exploration of global and robust optimality can yield computational benefits. To this end, in this article we introduce a novel algorithm that conducts a concurrent global optimality and robustness search for continuous non-convex problems. The proposed approach integrates spatial branch-and-bound with robust cutting plane notions. The key idea is that, while exploring the branch-and-bound tree, we assess the robustness of nodes entailing the best-found solutions. We illustrate the performance and benefits of our proposed approach through benchmark Quadratically Constrained Quadratic Programs (QCQPs) of pooling problems. At each node, the non-convex problem is solved via a local solver. If the computed solution is as good as the best-found so far, an infeasibility test is performed to evaluate the robustness of the obtained solution. If not, then the corresponding cutting planes are added both to the non-convex and convex problems. The algorithm proceeds to the next step once no more violations are detected. The convex problem is solved next, and the solution of this problem is used to decide the most promising variable for branching into two child nodes. With the use of appropriate fathoming criteria, the tree nodes are exhausted, and the robust optimal solution is obtained.
Section 2 provides a literature review on state-of-the-art nonlinear robust optimisation methods and their applications, along with a brief overview of the pooling problem which serves as our case study. The outline of the robust cutting planes algorithm and the details for proposed Robust spatial branch-and-bound algorithm are introduced in Section 3. In Section 4 we present the pooling problem under uncertainty, and derive the corresponding formulations for the dual reformulation and RsBB solution methods. In Section 5 we evaluate the performance of the RsBB algorithm compared to the state-of-the-art for benchmark pooling problems under box, ellipsoidal and polyhedral sets of varying sizes.
2 Literature review
Robust optimisation (RO) is developing into one of the prevailing risk-averse methods to study problems under uncertainty in the optimisation literature [2, 3]. It is largely preferred for applications where there is no or limited statistical data for the uncertain parameters, or when dealing with hard feasibility constraints. In RO, the modeller must decide an appropriate, in size and shape, uncertainty set to characterise the uncertain parameters. The RO algorithms provide an optimal solution that corresponds to the worst-case uncertainty realisation and at the same time guarantee that the solution is feasible given any parameter value from the selected uncertainty set. As such, robust optimisation problems belong to the general class of Semi-Infinite Programming (SIP)[4]. The main challenge of RO is to find the appropriate way to transform the uncertain optimisation problem into a tractable deterministic formulation. The most prevailing methods in that direction, are dual reformulation [5, 6, 7] and robust cutting sets [8, 9]. The first comparison of the two methods can be traced to [10] who applied both methods in linear and mixed integer problems. Based on the computational experiments, cutting planes were found to be more suitable for the linear programs, while the dual reformulation performed better for the mixed integer programs. [11] quantified the performance of the two methods for different variants of the cutting planes, as well as that of a hybrid approach. In contrast to previous results in the literature, for the ellipsoidal uncertainty sets, the dual reformulation dominated in the linear programs and cutting planes for mixed-integer instances. For polyhedral uncertainty sets neither method was deemed to be superior.
Nonlinear robust optimisation problems have gained increasing attention from the research community over the past two decades [12]. For nonlinear convex problems under convex uncertainty sets both of the aforementioned methods can be applied. [13] highlight the computational challenge in solving nonlinear robust optimisation problems under general norms and propose an approximate reformulation that employs a linearisation of the uncertainty set. For nonlinear convex problems convex analysis may also be applied to retrieve tractable reformulations for specific classes of uncertainty sets [14, 6]. [15] presented a rigorous method to choose safety margins for uncertain parameters in nonlinear and non-convex problems via local linearisation around a nominal uncertainty value. Instead of using the nominal uncertainty point, [16] proposed an algorithm based on outer approximation over sampled uncertainty points and tested their methodology in non-convex process systems engineering problems. [17] performed a neighbourhood search using a robust local descent method to avoid locally infeasible regions. Their methodology obtained local robust solutions for non-convex and simulation-based problems. [18] used a sequential bilevel approach for non-convex min-max problems resulting in less conservative solutions compared to the state-of-the-art.
In various applications, finding a local robust solution may not suffice, necessitating thus the need for coupling global and robust optimisation. Polynomial max-min and min-max problems are represented as general SDP problems and their corresponding robust optimal values can be approximated solving a hierarchy of SDP relaxations [19, 20]. [21] studied the scheduling of crude oil operations under demand uncertainty. The authors derived the deterministic robust counterpart of the uncertain constraints using a tailored branch and bound (BB) algorithm. [22] addressed the pooling problem under uncertainty comparing dual reformulation and cutting plane methods using a global solver. For the cutting planes method they relied on using a global solver and gradually decreasing the solver tolerance. Cutting planes outperformed the dual reformulation approach, since the latter increased the problem complexity for ellipsoidal and polyhedral uncertainty sets. [9] extending the work of [8], and proposed a robust cutting set algorithm to be able to certify robust solutions to non-convex problems entailing a large number of equality constraints. The quality of the final solution, i.e. being robust feasible or robust optimal, is solver dependant. On the same year, [23] employed enhanced normalised multiparametric disaggregation technique (ENMDT) and optimality-based bound tightening to solve the problem of refinery-wide planning operations under uncertainties. [24] introduced a BB algorithm with interval arithmetic to solve benchmark unconstrained non-convex optimisation problems of low-dimensionality under robust uncertainty. Most robust optimisation methods require the convexity of the uncertainty set or the inner-maximisation problem, however [25] proposed an adaptive bundle method for MINLP problems under robust uncertainty that allows the inner-maximisation problem to be non-convex. In the SIP literature, [26] proposed an iterative global optimisation method that relies on continuity rather than convexity for both the outer and inner optimisation problems. Their approach involved constructing a decreasing sequence of right-hand side constraint relaxations for the outer- minimisation problem. The feasibility of the obtained solution was evaluated in an inner-maximisation problem. Both optimisation steps were conducted using a global solver. This method was later generalised to address general SIP problems [27].
We derive our QCQP case study from the process systems engineering literature as the planning of pooling problems. The pooling problem belongs to the general class of non-convex quadratic problems and is proven to be NP-hard even for a small number of variables [28]. Historically, the most common solution approach to address non-convex NLPs, such as the pooling problem, is spatial branch-and-bound (sBB) [29]. In sBB, in contrast to classic branch-and-bound, branching is performed on continuous variables. The original non-convex problem constitutes the upper bound and the equivalent relaxed linear programming (LP) problem the lower bound. [30] used convex relaxations to approximate the bilinear terms within a branch-and-bound framework. [31] integrated the McCormick envelopes [32] with RLT constraints [33] in an sBB framework selecting the branching variable as the one with the worst-approximation error. Using RLT constraints result in tightening the convex relaxations of the bilinear terms without affecting the feasible region. Later on, [28] used both convex and concave envelopes following a novel branching strategy. For high-dimensional problems, the number of convex relaxation constraints increases drastically increasing the complexity of the problem. To that end, [34] proposed a branch-and-cut algorithm where only the violating linearisation constraints are added as cuts, instead of all convex and concave envelopes. Every generated cut is applied to all tree nodes. [35], replaced the non-convex pooling problem with a piecewise linear relaxation resulting in an MILP problem. [36] studied the impact of using piecewise linearisation for the linear envelopes, they also introduced pooling benchmark problems of increased dimensionality and complexity. [37] introduced the open-source MIQCQP solver GALINI that is based on a branch-and-cut algorithm using convex linear relaxations and mixed-integer restrictions for the pooling problems. The performance of the MILP pooling formulation can be improved using appropriate tightening methods and reduce computational time [38].
3 Methods
The proposed Robust spatial branch-and-bound (RsBB) integrates the robust cutting set algorithm within a spatial branch-and-bound global optimisation algorithm in search of the optimal robust solution. The robust cutting set algorithm [8] will be outlined with a theoretical study on the convergence of the integrated robust cutting planes and BB algorithms. In the following subsection, the proposed RsBB algorithm is introduced. The assumptions for our methodology are the following.
-
1.
The domain of x, is bounded;
-
2.
The objective and constraint functions are uniformly Lipschitz continuous on ;
-
3.
The uncertainty set is convex and generates a non-empty robust feasible region;
-
4.
The uncertain constraints are concave in ;
-
5.
The problem of maximising over is tractable and the exact solution can be obtained.
3.1 Robust cutting set algorithm
() | ||||
Following [8], there exists a subset involving finite uncertainty samples or realizations and the corresponding problem .
() | ||||
Let , the following uncertainty sample can be determined via solving the outer-minimisation problem , and evaluating the robustness of the solution in the inner-maximisation problem T.
(T) | ||||
Given specific properties of and the exactness of the solution of problem (T) can be guaranteed [8]. We focus on the case that is affine in and we are evaluating box, polyhedral and ellipsoidal sets, hence exactness of the solution is satisfied. If a solution is detected, such that , then it is added on subset . Let be the worst-case constraint function
it is true that
where .
Proposition 1.
The optimal solution of the sampled problem provides a lower bound for the robust problem.
Proof.
Let the feasible sets and the optimal values for the robust, sampled and nominal problems. Then, , and . By definition . Hence, and . ∎
Proposition 2.
If the optimal solution of the sampled problem is feasible for the robust problem, then it is also optimal for the robust problem.
Proof.
Let be the optimal solution for the sampled problem. From Proposition 1 . If then as the sampled solution belongs to the robust feasible region. Hence at . ∎
[8] have proved that there exist a finite number of cutting plane iterations to find the robust optimal solution using the robust cutting set method, without depending on convexity assumptions of on . An outline of the robust cutting set algorithm is provided in Algorithm 1. We note that [9] have implemented a generalised cutting set method in the PyROS solver enabling the solution of non-convex problems as well.
3.2 Robust spatial Branch and Bound
The aim of this work, is to solve problems with non-convex bilinear functions in under robust uncertainty using an sBB algorithm via McCormick relaxations. Let be the index for the complicating variables participating in bilinear formulations where . Consider the convex nominal problem and sampled problem augmented by for bilinear terms of using the McCormick envelopes [32].
() | ||||
() | ||||
Proposition 3.
The relaxed problem provides a lower bound for the the original robust problem.
Proof.
Let be the robust, sampled and nominal feasible regions of the relaxed convex problem. The non-convex problem can be reformulated using the auxiliary variables without affecting the feasible region of the problem . Hence, the relaxed feasible region is which is a superset of the original problem . From Proposition 1 the relaxed problem provides also a lower bound for the robust problem . ∎
In the Robust spatial Branch and Bound (RsBB) algorithm we consider a two-level problem approach as in the robust cutting plane algorithm. The outer-level is comprised of the deterministic problems () and (). The inner-level (T) problems evaluate the robustness of the solution of the outer-level non-convex problem. The RsBB algorithm is initialised in the root node for the original variable bounds . Note that for both outer-level problems the domain and the subset are the same at each node. The domain is partitioned into subsets based on the sBB steps of the algorithm and the subset is augmented by any uncertainty samples that violate the robustness of the obtained solution. For a given node, problems and are defined for and the corresponding . The proposed algorithm for the RsBB implementation is displayed in Algorithm 3 and the Infeasibility Test in Algorithm 2.
Lemma 1.
The Infeasibility Test Algorithm 2 terminates in a finite number of iterations.
Proof.
Algorithm 2 is applied to nodes for which a solution to is obtained. Since is assumed to be tractable, the algorithm remains well-defined at every iteration. Moreover, Algorithm 2 follows the same structure as Algorithm 1, which corresponds to the robust cutting set algorithm. By Assumptions 2 and 5, along with the tractability of , the conditions required for finite convergence of Algorithm 1 are satisfied. Thus, by the results in [8] (Section 5.2), Algorithm 2 terminates in a finite number of iterations. ∎
The effectiveness of the sBB algorithm heavily depends on the choice of bounding, branching, and node update strategies. Our bounding strategy relies on McCormick relaxations [39, 40], which generate degenerate perfect sequences of under-estimators [41][Theorem 5]. For branching, we adopt the bisection method, which ensures an exhaustive subdivision of the original variable domain [42][Definition IV.10]. The node update strategy follows a best-first approach, selecting the node with the lowest lower bound. This method is node-improving [42](Definition IV.6), meaning it prioritises promising candidates for early exploration [43]. An additional decision lies in the choice of branching variable. In this work we consider the maximum violation strategy [44, 45, 46] and a pseudoscore strategy [47, 46]. The use the maximum approximation error strategy is prioritised and if the errors are below the selected tolerance, then the branching variable is selected based on the pseudoscore. We define the branching variable selected via the maximum approximation error as:
(1) |
If the maximum approximation error is below the selected tolerance, the branching variable is selected based on a pseudoscore. For the pseudoscore calculation, strong branching is taking place on the evaluating node and the variable with the most promising lower bound improvement is selected. Using bisection to define the branching point at node , the intervals for child nodes can be defined as and . Let lower bound values of the child nodes for branching in variable and the lower bound of the parent node. If any of the child nodes is infeasible, the corresponding lower bound is set to 0. The lower bound improvement of the pseudonodes is evaluated as and . Let be the objective gain for branching on variable . Let be the variable selected for branching via pseudoscores:
(2) |
Proposition 4.
The RsBB algorithm 3 terminates after finitely many steps.
Proof.
A sBB algorithm terminates after finitely many steps if the bounding operation is finitely consistent as stated in [42][Theorem IV. I]. Let denote the subset of corresponding to node . Then be the lower bound and the upper bound of . A bounding operation is finitely consistent if . The McCormick relaxations are known to be degenerate perfect as established by [41][Theorem 5], which implies that and . Since both bounds converge to the condition for finite consistency is satisfied. ∎
Proposition 5.
The optimal solution obtained after the exhaustion of the RsBB tree is also optimal for the robust problem.
Proof.
Let denote the objective value of the sampled problem at node , and let be the best feasible objective value found by the RsBB algorithm up to this node. Let be the corresponding optimal solution for the sampled problem at node . By construction, RsBB performs a robustness evaluation for all nodes where . This ensures that any solution is also feasible for the robust problem. Hence, the final optimal solution obtained by RsBB is necessarily feasible for the robust problem. By Proposition 2, the RsBB solution is also optimal for the robust problem. ∎
3.3 Motivating example
The implementation of the RsBB algorithm is demonstrated in a non-convex QCQP toy problem defined by Eqs (3)-(7). We consider box uncertainty for around the nominal value . The corresponding relaxed problem using McCormick envelopes will be denoted as . The feasible regions for the toy nominal, sampled and robust problems are depicted in Fig. 1. The robust feasible region corresponds to a set of equations when no more feasibility violations are detected, while the sampled region corresponds to intermediate robust cutting plane iterations. In essence, at the termination of our algorithm the sampled and robust regions overlap.
(3) | |||
(4) | |||
(5) | |||
(6) | |||
(7) |
The contour plots for the objective value in the feasible regions is displayed in Figure 2 which also entails the solutions of the examined nodes in rhombuses. For the root node and node 1 a trivial solution was found by the local solver hence no robust cuts were added to the problem. Node 2 obtained the optimal solution for the nominal problem resulting in an infeasibility cut. The robust optimal solution was obtained on the same node for a tighter sampled feasible region. The descendand nodes are not depicted on the figure but can be found in the detailed RsBB tree representation of Figure 3. The implementation of the RsBB algorithm is the following:
Step 0:
Initialise the sampled uncertainty set with the nominal uncertainty value. Solve with local solver. The obtained solution at root node is which is set as the best found . The solution trivially satisfies the uncertain constraint in Eq.(4) hence no cuts are added.
Step 1:
Solve the relaxed problem and generate two new (1,2) child nodes based on maximum approximation error.
Step 2:
Select new node as based on lowest-lower bound .
Step 3:
Solve with local solver. The obtained optimal value is . The Infeasibility Test is trivial for this node as well.
Step 4:
Solve the relaxed problem and generate two new (3, 4) child nodes based on maximum approximation error. None of the waiting nodes is fathomed.
Step 5:
Select new node as based on lowest-lower bound .
Step 6:
Solve with local solver. The obtained optimal value is .
Step 7:
Perform the Infeasibility Test. The sampled point was found to violate Eq. (4) and was appended in .
Step 8:
Solve with local solver and the new feasible region. The obtained optimal value is .
Step 9:
No more violations are detected by the infeasibility test, hence we set the new best found solution as .
Step 10:
Solve the relaxed problem and generate two new (5,6) child nodes based on maximum approximation error. Node 6 is fathomed due to infeasibility of the relaxed problem.
Step 11:
Fathom nodes for which . Node 4 is fathomed.
Step 12:
Select new node based on lowest-lower bound.
Steps 8 to 12 are repeated for the remaining nodes, the corresponding solutions for each node can be found in Figure 3. The RsBB terminates in node 14 and the robust optimal solution .



4 Problem description
For the purpose of this study, we evaluate the performance of RsBB for the pooling problems. We use the pq-formulation of the pooling problem, resulting in a quadratically constrained quadratic program (QCQP). bilinear terms are manifested both in the objective function and the quality constraints.
4.1 The pooling problem
In the standard pooling formulation, given an existing infrastructure, the optimal flows between input streams, mixing pools and output product streams need to be determined. The objective is to minimise the cost of the process under storage capacity, demand satisfaction and product quality constraints. [48] proposed the q-formulation of the pooling problem in order to derive smaller in size dual problems. Later on, [49] proposed an alternative pq-formulation via the use of two RLT constraints which improved the performance of the state-of-the-art solvers at that time, while not changing the problem structure. We introduce the auxiliary variables to replace the bilinear terms. Let be the original non-convex pooling problem of cost minimisation:
(8) | |||
(9) | |||
(10) | |||
(11) | |||
(12) | |||
(13) | |||
(14) | |||
(15) |
To derive the convex relaxation of the pooling problem , Eq. (15) is replaced by the equivalent McCormick envelopes Eqs.(16)-(19) [32].
(16) | |||
(17) | |||
(18) | |||
(19) |
In the pooling problem, uncertainty can be manifested in any of the model parameters, such as the feed component cost, product price and feed component quality. For this study we consider uncertainty in the feed component quality, i.e. in Eq. (14). Following the notation in [7], the true value of the uncertain level quality can be formulated as follows:
(20) |
where represents the nominal value, the constant perturbation (which is positive) and is a vector of random variables which are subject to uncertainty. Given a selected uncertainty set , the deterministic quality constraints in (14) are replaced by their robust formulations in Eqs.(21) and(22) resulting in the semi-infinite programming problems [50].
(21) | |||
(22) |
4.2 Uncertainty set modelling
In this study we consider the case where is a convex uncertainty set with , i.e. box, ellipsoidal and polyhedral uncertainty. [51] was the first to study linear problems under box uncertainty using the dual reformulation method, resulting in the most conservative solution, i.e. worst-case solution. Later on, [52] aiming at a less conservative approach, proposed the ellipsoidal uncertainty set defined by the -norm. Despite the fact that the ellipsoidal set reduces the conservatism of the problem, it introduces extra nonlinear terms. To this end, [53] proposed an alternative formulation assuming that it it unlikely that all uncertain parameters would be affected by the maximum perturbation. The corresponding polyhedral set is defined by the -norm. Given that Eqs. (21) and (22) are linear in both dual reformulation and robust cutting planes can be used to address the robust problem . The deterministic dual reformulations of Eqs. (21) and(22) derived in Eqs. (23) and(24) using the according to the selected uncertainty set as displayed in Table 1.
Uncertainty set | ||
---|---|---|
Box | ||
Ellipsoidal | ||
Polyhedral |
(23) | |||
(24) |
For the robust cutting planes algorithm, consider the sampled quality constraints Eqs. (25), (26). The robustness of each solution is evaluated by the infeasibility test problem , and both upper and lower quality constraints. For each sampled that violates a quality constraint, the sampled uncertainty set is augmented by the corresponding value.
(25) | |||
(26) |
() |
Table 2 summarises the notation for the different problems and the equations comprising them providing a correspondence to the general problem notation used for the RsBB methodology.
Optimisation level | Problem | Notation | Equations |
---|---|---|---|
Outer-level | Nominal pooling | (8)-(15) | |
Robust pooling | (8)-(13), (15), (21), (22) | ||
Sampled pooling | (8)-(13), (15), (25), (26) | ||
Relaxed nominal pooling | (8)-(14), (16)-(19) | ||
Relaxed robust pooling | (8)-(13), (16)-(19), (21), (22) | ||
Relaxed sampled pooling | (8)-(13), (16)-(19), (25), (26) | ||
Inner-level | Quality robustness | () |
5 Computational experiments
5.1 Case studies
The performance of the RsBB algorithm is evaluated for 10 benchmark pooling instances, details of the problems can be found in Table 3. For the uncertain inlet quality, we set . The uncertain parameters are defined by box, ellipsoidal and polyhedral uncertainty sets for six different uncertainty set sizes, i.e. . The selected modelling environment is Pyomo v6.7 [54]. For the RsBB algorithm HiGHS v.1.5.3 [55] is used as the LP solver and conopt4 as the local NLP solver. The proposed algorithm is compared with PyROS v1.2.8 using Gurobi v11.1 [56] as the global solver. The deterministic robust counterparts are evaluated as well using Gurobi v11.1 as global solver. We set a time limit of 1 hour for all of the examined methods.
Problem | Feeds | Pools | Products | Qualities | Variables | Equations QP | Equations LP |
---|---|---|---|---|---|---|---|
haverly1 | 3 | 1 | 2 | 1 | 10 | 17 | 29 |
haverly2 | 3 | 1 | 2 | 1 | 13 | 20 | 38 |
haverly3 | 3 | 1 | 2 | 1 | 10 | 17 | 29 |
bental4 | 4 | 1 | 2 | 1 | 13 | 21 | 39 |
bental5 | 13 | 3 | 5 | 2 | 92 | 121 | 301 |
foulds2 | 6 | 2 | 4 | 1 | 36 | 46 | 94 |
adhya1 | 5 | 2 | 4 | 4 | 33 | 62 | 122 |
adhya2 | 5 | 2 | 4 | 6 | 33 | 70 | 130 |
adhya3 | 8 | 3 | 4 | 6 | 52 | 94 | 190 |
adhya4 | 8 | 2 | 5 | 4 | 58 | 95 | 215 |
5.2 Results
A comparison of the RsBB algorithm with state-of-the-art methods in terms of % of problems solved within 1 hour of CPU time can be found in Figure 4. Dual-Gurobi corresponds to solving the dual problem, using the dual constraints for the different uncertainty types, with global solver Gurobi. PyROS-Gurobi corresponds to using PyROS solver with Gurobi as a global solver both for the upper and lower level problems. The RsBB algorithm is using conopt4 for the upper and lower level problems for box and polyhedral sets and BARON for the lower level problems under ellipsoidal uncertainty. For each of the 10 benchmark problems of Table 3 6 different uncertainty sizes are evaluated, resulting in 60 problems in total for each uncertainty type. The RsBB and Dual algorithms solve the same number of problems for all uncertainty types, i.e. 100% for box and polyhedral and 92% for ellipsoidal. In contrast, PyROS solves all problems only for box, 90% for ellipsoidal and 40% for polyhedral set. Dual reformulation method retrieves robust optimal solutions in less than 1 sec for all problems with box set and 80% of problems with ellipsoidal and polyhedral set. RsBB algorithm for box and polyhedral sets requires few seconds to less than 5 minutes to solve all instances. For the ellipsoidal set, RsBB relies on using BARON to solve the lower level problems resulting in an increase of the total computational time, rendering PyROS marginally faster. The results of Figure 4 suggest that integrating the robust cutting planes in a sBB framework can improve the performance of solely using robust cutting planes. Further optimising the RsBB algorithm via more rigorous BB techniques could further improve the computational efficiency of the proposed algorithm.

Statistics for RsBB algorithm can be evaluated via the variability of the number of tree nodes explored in Figure 5. As a general trend, for all set types the range of the nodes explored reduces with the increase of the uncertainty set size. As the uncertainty size increases, the corresponding robust cuts become more restraining reducing the feasible region more rigorously. For uncertainty set sizes greater than 0.15 the number of nodes explored does not depend on the set type and all problems are solved evaluating less than 15 nodes. However, for smaller set sizes, the variability of the nodes explored increases with the decrease of the conservativism of the uncertainty set (boxellipsoidalpolyhedral). The box uncertainty set corresponds to the worst-case uncertainty realisation, were all uncertain parameters can obtain the maximum allowed perturbation. For ellipsoidal and polyhedral sets more RsBB iterations are required to find all combinations of maximum parameter violations.

Figure 6 illustrates the optimality gap closure of the RsBB algorithm for problems of varying dimensionality under a box uncertainty set with . The computational time for the depicted problems and total number of cuts is summarised in Table 4. An initial observation suggests that the number of nodes explored is not proportional to the problem size (haverly1 foulds2 adhya4 bental5). Pooling problems have multiple local minima which are independent of the problem dimensionality, hence larger problems may be solved in less CPU time. This observation is further supported by the comparison of the corresponding CPU times in Table 4. Both in RsBB and Dual methods the higher CPU time is required for adhya4 followed by bental5, haverly1 and foulds2. While for PyROS, the problem size and CPU time are positively correlated, the CPU time entails the time required for Gurobi to find an optimal solution and the total robust cut iterations. The delay of PyROS can also be attributed to the smaller number of total cuts added compared to RsBB. In the proposed method, all uncertain parameter violations are included in the sampled uncertainty set, whereas PyROS considers only the uncertain parameters that cause the maximum violation. Selecting only a subset of violating cuts, rather than all, can be advantageous for larger problems where multiple constraints are impacted by uncertainty. This approach helps mitigate the exponential growth of constraints in the sampled problem. Another noteworthy aspect of Figure 6 is the significant variability in the optimality gap at the root node across the examined problems, which directly influences the algorithm’s convergence.

Problem | CPU Dual [s] | CPU PyROS [s] | CPU RsBB [s] | Cuts PyROS | Cuts RsBB |
---|---|---|---|---|---|
haverly1 | 0.4 | 5.5 | 4.4 | 2 | 2 |
foulds2 | 0.3 | 20.0 | 4.2 | 5 | 8 |
adhya4 | 0.7 | 164.2 | 73.9 | 9 | 21 |
bental5 | 0.3 | 205.7 | 30.2 | 17 | 37 |
Focusing on a specific problem, i.e. foulds2, we can investigate the dependence of the RsBB convergence on the uncertainty set size and set type as in Figure 7. Increasing the uncertainty size results in a decrease of the RsBB iterations and at the same time a decrease in the optimality gap at the root node. Fixing the same uncertainty size to 0.15, faster convergence is achieved for the box uncertainty set followed by the ellipsoidal and the polyhedral, analogous to the decrease of the set conservativism. For foulds2 with , RsBB terminates at the robust optimal solution on the root node, providing grounds for further investigation. Figure 8 depicts the increase of the objective value in robust cut iterations at the root node of foulds2 from Figure 7. For , RsBB performs 11 robust cut iterations to obtain the robust optimal solution at the root node. In contrast, for , fewer cut iterations lead to a higher optimality gap at the root node. For the polyhedral set and only 3 cut iterations take place in the root node, resulting in an initial gap of 9.5%. It is important to highlight that the objective values retrieved at the root node in 8b correspond to the robust optimal solution and the extra tree nodes are used to tighten the solution of the linear relaxation. For the box and polyhedral uncertainty sets solving the lower level problem has a finite number of solutions, which are the vertices of the polytopes. Finiteness has also been proved in the case of ellipsoidal set by [57], however as displayed in Figure 8b there can be multiple degenerate lower level violating solutions that do not affect the feasibility region of the upper level problem. The optimal objective value of foulds2 for the nominal uncertain parameter is at -1100. The right axis of Figure 8 depicts the % increase of the cost as different uncertainty set and sizes and considered. Allowing a 15% perturbation with the polyhedral set will result in an increase of 38% of the objective value, 50% for the ellipsoidal set and 80% for the box set. Throughout the examined results is has been highlighted that increasing the conservativism of the problem either via set size or set type, facilitates and accelerates the performance of the RsBB algorithm. Notably, robust cuts serve as a powerful feasibility bounds tightening method, significantly reducing the feasible region for the sBB tree nodes, which enhances the overall efficiency and accuracy of the algorithm.


6 Conclusion
In this work, we introduced a novel algorithm that integrates global and robust optimisation methods. The proposed RsBB algorithm combines the principles of spatial branch-and-bound (sBB) and robust cutting planes to solve continuous non-convex problems under convex uncertainty sets. We applied our approach to QCQP pooling problems utilising McCormick envelopes to obtain convex lower bounds. The inlet quality parameter was treated as uncertain, with its range defined by box, ellipsoidal, and polyhedral uncertainty sets of varying sizes. The performance of the RsBB algorithm was compared to state-of-the-art methods that rely on global solvers. Our computational results demonstrate that the proposed method can solve the 97% of the tested problems to robust optimality while being computationally competitive with the state-of-the-art. We observed that using robust cutting planes in the sBB algorithm serves as an effective feasibility bounds tightening method. Finally, the integration of robust cuts is proven to have a beneficial impact on the sBB algorithm facilitating the optimality search both in terms of problem tractability and CPU time. Ongoing work in our work is looking into extending this approach to general non-convex problems.
Nomenclature
Sets
Feed components | |
Pools | |
Products | |
Qualities |
Parameters
Random uncertain variable of quality | |
Adjustable parameter controlling the size of the uncertainty set | |
Upper bound for component availability | |
Upper bound for product demand | |
Upper bound for pool size | |
Upper bound for product quality | |
Lower bound for product quality | |
Nominal level of quality for component | |
True level of quality for component | |
Perturbed level of quality for component | |
Unit price for component | |
Unit price for product |
Variables
Fraction of flow of component entering pool | |
Flow from pool to product | |
Flow from component to product | |
Total flow to product | |
Auxiliary variable for flow from component passing pool to product |
Data availability statement Data and software will be made available by the authors upon reasonable request. \bmheadAcknowledgements Financial support under the EPSRC grants ADOPT (EP/W003317/1) and RiFtMaP (EP/V034723/1) is gratefully acknowledged by the authors.
References
- \bibcommenthead
- Hung et al. [2024] Hung, N.C., Chuong, T.D., Le Hoang Anh, N.: Solution existence for a class of nonsmooth robust optimization problems. Journal of Global Optimization, 1–23 (2024) https://doi.org/10.1007/s10898-024-01450-9
- Zhang and Gounaris [2022] Zhang, Q., Gounaris, C.E.: Methodology and applications of robust optimization. Optimization and Engineering 23, 1761–1764 (2022) https://doi.org/10.1007/S11081-022-09759-8
- Gabrel et al. [2014] Gabrel, V., Murat, C., Thiele, A.: Recent advances in robust optimization: An overview. European Journal of Operational Research 235, 471–483 (2014) https://doi.org/10.1016/J.EJOR.2013.09.036
- Djelassi et al. [2021] Djelassi, H., Mitsos, A., Stein, O.: Recent advances in nonconvex semi-infinite programming: Applications and algorithms. EURO Journal on Computational Optimization 9, 100006 (2021) https://doi.org/%****␣RsBB.bbl␣Line␣100␣****10.1016/J.EJCO.2021.100006
- Ben-Tal and Nemirovski [1998] Ben-Tal, A., Nemirovski, A.: Robust convex optimization. Mathematics of Operations Research 23, 769–805 (1998) https://doi.org/10.1287/MOOR.23.4.769
- Gorissen et al. [2015] Gorissen, B.L., Yanikoğlu, I., Hertog, D.: A practical guide to robust optimization. Omega 53, 124–137 (2015) https://doi.org/10.1016/J.OMEGA.2014.12.006
- Li et al. [2011] Li, Z., Ding, R., Floudas, C.A.: A comparative theoretical and computational study on robust counterpart optimization: I. robust linear optimization and robust mixed integer linear optimization. Industrial and Engineering Chemistry Research 50, 10567–10603 (2011) https://doi.org/10.1021/ie200150p
- Mutapcic and Boyd [2009] Mutapcic, A., Boyd, S.: Cutting-set methods for robust convex optimization with pessimizing oracles. Optimization Methods and Software 24, 381–406 (2009) https://doi.org/10.1080/10556780802712889
- Isenberg et al. [2021] Isenberg, N.M., Akula, P., Eslick, J.C., Bhattacharyya, D., Miller, D.C., Gounaris, C.E.: A generalized cutting-set approach for nonlinear robust optimization in process systems engineering. AIChE Journal 67, 17175 (2021) https://doi.org/10.1002/AIC.17175
- Fischetti and Monaci [2012] Fischetti, M., Monaci, M.: Cutting plane versus compact formulations for uncertain (integer) linear programs. Mathematical Programming Computation 4, 239–273 (2012) https://doi.org/10.1007/S12532-012-0039-Y
- Bertsimas et al. [2016] Bertsimas, D., Dunning, I., Lubin, M.: Reformulation versus cutting-planes for robust optimization: A computational study. Computational Management Science 13, 195–217 (2016) https://doi.org/10.1007/s10287-015-0236-z
- Leyffer et al. [2020] Leyffer, S., Menickelly, M., Munson, T., Vanaret, C., Wild, S.M.: A survey of nonlinear robust optimization. INFOR: Information Systems and Operational Research 58, 342–373 (2020) https://doi.org/10.1080/03155986.2020.1730676
- Diehl et al. [2005] Diehl, M., Bock, H.G., Kostina, E.: An approximation technique for robust nonlinear optimization. Mathematical Programming 107, 213–230 (2005) https://doi.org/10.1007/S10107-005-0685-1
- Ben-Tal et al. [2015] Ben-Tal, A., Hertog, D., Vial, J.P.: Deriving robust counterparts of nonlinear uncertain inequalities. Mathematical Programming 149, 265–299 (2015) https://doi.org/10.1007/s10107-014-0750-8
- Zhang [2007] Zhang, Y.: General robust-optimization formulation for nonlinear programming. Journal of Optimization Theory and Applications 132, 111–124 (2007) https://doi.org/10.1007/S10957-006-9082-Z
- Yuan et al. [2018] Yuan, Y., Li, Z., Huang, B.: Nonlinear robust optimization for process design. AIChE Journal 64, 481–494 (2018) https://doi.org/10.1002/AIC.15950
- Bertsimas et al. [2009] Bertsimas, D., Nohadani, O., Teo, K.M.: Nonconvex robust optimization for problems with constraints. INFORMS Journal on Computing, 1–15 (2009) https://doi.org/10.1287/ijoc.1090.0319
- Houska and Diehl [2012] Houska, B., Diehl, M.: Nonlinear robust optimization via sequential convex bilevel programming. Mathematical Programming 142, 539–577 (2012) https://doi.org/10.1007/S10107-012-0591-2
- Lasserre [2006] Lasserre, J.B.: Robust global optimization with polynomials. Mathematical Programming 107, 275–293 (2006) https://doi.org/10.1007/S10107-005-0687-Z
- Lasserre [2011] Lasserre, J.B.: Min-max and robust polynomial optimization. Journal of Global Optimization 51, 1–10 (2011) https://doi.org/10.1007/S10898-010-9628-3
- Li et al. [2011] Li, J., Misener, R., Floudas, C.A.: Scheduling of crude oil operations under demand uncertainty: A robust optimization framework coupled with global optimization. AIChE Journal 58, 2373–2396 (2011) https://doi.org/10.1002/aic.12772
- Wiebe et al. [2019] Wiebe, J., Cecĺlio, I., Misener, R.: Robust optimization for the pooling problem. Industrial and Engineering Chemistry Research 58, 12712–12722 (2019) https://doi.org/10.1021/acs.iecr.9b01772
- Zhang et al. [2021] Zhang, L., Yuan, Z., Chen, B.: Refinery-wide planning operations under uncertainty via robust optimization approach coupled with global optimization. Computers & Chemical Engineering 146, 107205 (2021) https://doi.org/10.1016/J.COMPCHEMENG.2020.107205
- Carrizosa and Messine [2021] Carrizosa, E., Messine, F.: An interval branch and bound method for global robust optimization. Journal of Global Optimization 80, 507–522 (2021) https://doi.org/10.1007/s10898-021-01010-5
- Kuchlbauer et al. [2022] Kuchlbauer, M., Liers, F., Stingl, M.: Outer approximation for mixed-integer nonlinear robust optimization. Journal of Optimization Theory and Applications 195, 1056–1086 (2022) https://doi.org/10.1007/s10957-022-02114-y
- Mitsos [2011] Mitsos, A.: Global optimization of semi-infinite programs via restriction of the right-hand side. Optimization 60, 1291–1308 (2011) https://doi.org/10.1080/02331934.2010.527970
- Mitsos and Tsoukalas [2015] Mitsos, A., Tsoukalas, A.: Global optimization of generalized semi-infinite programs via restriction of the right hand side. Journal of Global Optimization 61, 1–17 (2015) https://doi.org/10.1007/S10898-014-0146-6
- Alfaki and Haugland [2013] Alfaki, M., Haugland, D.: Strong formulations for the pooling problem. Journal of Global Optimization 56, 897–916 (2013) https://doi.org/10.1007/S10898-012-9875-6
- Tuy [1998] Tuy, H.: Convex Analysis. Springer, Boston, MA (1998). https://doi.org/10.1007/978-1-4757-2809-5
- Foulds et al. [1992] Foulds, L.R., Haugland, D., Jörnsten, K.: A bilinear approach to the pooling problem†. Optimization 24, 165–180 (1992) https://doi.org/10.1080/02331939208843786
- Quesada and Grossmann [1995] Quesada, I., Grossmann, I.E.: A global optimization algorithm for linear fractional and bilinear programs. Journal of Global Optimization 6, 39–76 (1995) https://doi.org/10.1007/BF01106605
- McCormick [1976] McCormick, G.P.: Computability of global solutions to factorable nonconvex programs: Part i — convex underestimating problems. Mathematical Programming 10, 147–175 (1976) https://doi.org/10.1007/BF01580665
- Sherali and Alameddine [1992] Sherali, H.D., Alameddine, A.: A new reformulation-linearization technique for bilinear programming problems. Journal of Global Optimization 2, 379–410 (1992) https://doi.org/10.1007/BF00122429
- Audet et al. [2004] Audet, C., Brimberg, J., Hansen, P., Digabel, S.L., Mladenović, N.: Pooling problem: Alternate formulations and solution methods. Management Science 50, 761–776 (2004) https://doi.org/10.1287/MNSC.1030.0207
- Gounaris et al. [2009] Gounaris, C.E., Misener, R., Floudas, C.A.: Computational comparison of piecewise-linear relaxations for pooling problems. Industrial and Engineering Chemistry Research 48, 5742–5766 (2009) https://doi.org/10.1021/ie8016048
- Dey and Gupte [2015] Dey, S.S., Gupte, A.: Analysis of milp techniques for the pooling problem. Operations Research 63, 412–427 (2015) https://doi.org/10.1287/OPRE.2015.1357
- Ceccon and Misener [2022] Ceccon, F., Misener, R.: Solving the pooling problem at scale with extensible solver galini. Computers & Chemical Engineering 159, 107660 (2022) https://doi.org/10.1016/J.COMPCHEMENG.2022.107660
- Chen et al. [2024] Chen, Y., Maravelias, C.T., Zhang, X.: Tightening discretization-based milp models for the pooling problem using upper bounds on bilinear terms. Optimization Letters 18, 215–234 (2024) https://doi.org/10.1007/S11590-023-01985-Y
- Mitsos et al. [2009] Mitsos, A., Chachuat, B., Barton, P.I.: Mccormick-based relaxations of algorithms. SIAM Journal on Optimization 20, 573–601 (2009) https://doi.org/10.1137/080717341
- Bompadre and Mitsos [2012] Bompadre, A., Mitsos, A.: Convergence rate of mccormick relaxations. Journal of Global Optimization 52, 1–28 (2012) https://doi.org/10.1007/s10898-011-9685-2
- Scott et al. [2011] Scott, J.K., Stuber, M.D., Barton, P.I.: Generalized mccormick relaxations. Journal of Global Optimization 51, 569–606 (2011) https://doi.org/10.1007/S10898-011-9664-7
- Horst and Tuy [1996] Horst, R., Tuy, H.: Global Optimization. Springer, Berlin Heidelberg (1996). https://doi.org/10.1007/978-3-662-03199-5
- Locatelli and Schoen [2013] Locatelli, M., Schoen, F.: Global Optimization:Theory, Algorithms, and Applications. Society for Industrial and Applied Mathematics, Philadelphia, United States (2013). https://doi.org/10.1137/1.9781611972672
- Smith and Pantelides [1999] Smith, E.M.B., Pantelides, C.C.: A symbolic reformulation/spatial branch-and-bound algorithm for the global optimisation of nonconvex minlps. Computers & Chemical Engineering 23, 457–478 (1999) https://doi.org/10.1016/S0098-1354(98)00286-5
- Tawarmalani and Sahinidis [2004] Tawarmalani, M., Sahinidis, N.V.: Global optimization of mixed-integer nonlinear programs: A theoretical and computational study. Mathematical Programming 99, 563–591 (2004) https://doi.org/10.1007/S10107-003-0467-6
- Belotti et al. [2009] Belotti, P., Lee, J., Liberti, L., Margot, F., Wächter, A.: Branching and bounds tighteningtechniques for non-convex minlp. Optimization Methods and Software 24, 597–634 (2009) https://doi.org/10.1080/10556780903087124
- Achterberg et al. [2005] Achterberg, T., Koch, T., Martin, A.: Branching rules revisited. Operations Research Letters 33, 42–54 (2005) https://doi.org/10.1016/J.ORL.2004.04.002
- Ben-Tal et al. [1994] Ben-Tal, A., Eiger, G., Gershovitz, V.: Global minimization by reducing the duality gap. Mathematical Programming 63, 193–212 (1994) https://doi.org/10.1007/BF01582066
- Sahinidis and Tawarmalani [2005] Sahinidis, N.V., Tawarmalani, M.: Accelerating branch-and-bound through a modeling language construct for relaxation-specific constraints. Journal of Global Optimization 32, 259–280 (2005) https://doi.org/10.1007/S10898-004-2705-8
- Ben-Tal and Nemirovski [2002] Ben-Tal, A., Nemirovski, A.: Robust optimization - methodology and applications. Mathematical Programming 92, 453–480 (2002) https://doi.org/10.1007/S101070100286
- Soyster [1973] Soyster, A.L.: Convex programming with set-inclusive constraints and applications to inexact linear programming. Operations Research 21, 1154–1157 (1973) https://doi.org/10.1287/OPRE.21.5.1154
- Ben-Tal and Nemirovski [2000] Ben-Tal, A., Nemirovski, A.: Robust solutions of linear programming problems contaminated with uncertain data. Mathematical Programming 88, 411–424 (2000) https://doi.org/10.1007/PL00011380
- Bertsimas and Sim [2004] Bertsimas, D., Sim, M.: The price of robustness. Operations Research 52, 35–53 (2004) https://doi.org/10.1287/OPRE.1030.0065
- Bynum et al. [2021] Bynum, M.L., Hackebeil, G.A., Hart, W.E., Laird, C.D., Nicholson, B.L., Siirola, J.D., Watson, J.-P., Woodruff, D.L.: Pyomo–optimization Modeling in Python vol. 67, 3rd edn. Springer, US (2021)
- Huangfu and Hall [2018] Huangfu, Q., Hall, J.A.J.: Parallelizing the dual revised simplex method. Mathematical Programming Computation 10, 119–142 (2018) https://doi.org/10.1007/S12532-017-0130-5
- Gurobi Optimization, LLC [2024] Gurobi Optimization, LLC: Gurobi Optimizer Reference Manual (2024). https://www.gurobi.com
- Mínguez and Casero-Alonso [2019] Mínguez, R., Casero-Alonso, V.: On the convergence of cutting-plane methods for robust optimization with ellipsoidal uncertainty sets. arXiv e-prints (2019) https://doi.org/https://arxiv.org/abs/1904.01244v1