Showing 1–50 of 141 results for author: Neumann, A

Data-driven fingerprint nanomechanical mass spectrometry

Authors: John E. Sader, Alfredo Gomez, Adam P. Neumann, Alexander R. Nunn, Michael L. Roukes

Abstract: Fingerprint analysis is a ubiquitous tool for pattern recognition with applications spanning from geolocation and DNA analysis to facial recognition and forensic identification. Central to its utility is the ability to provide accurate identification without an a priori mathematical model for the pattern. We report a data-driven fingerprint approach for nanoelectromechanical systems mass spectrome… ▽ More Fingerprint analysis is a ubiquitous tool for pattern recognition with applications spanning from geolocation and DNA analysis to facial recognition and forensic identification. Central to its utility is the ability to provide accurate identification without an a priori mathematical model for the pattern. We report a data-driven fingerprint approach for nanoelectromechanical systems mass spectrometry (NEMS-MS) that enables mass measurements of particles and molecules using complex, uncharacterized nanoelectromechanical devices of arbitrary specification. NEMS-MS is based on the frequency shifts of the NEMS vibrational modes induced by analyte adsorption. The sequence of frequency shifts constitutes a fingerprint of this adsorption, which is directly amenable to pattern matching. Two current requirements of NEMS-based mass spectrometry are: (1) a priori knowledge or measurement of the device mode-shapes, and (2) a mode-shape-based model that connects the induced modal frequency shifts to mass adsorption. This may not be possible for advanced NEMS with three-dimensional mode-shapes and nanometer-sized features. The advance reported here eliminates this impediment, thereby allowing device designs of arbitrary specification and size to be employed. This enables the use of advanced NEMS devices with complex vibrational modes, which offer unprecedented prospects for attaining the ultimate detection limits of nanoelectromechanical mass spectrometry. △ Less

Submitted 18 June, 2024; originally announced June 2024.

Comments: 41 pages, 14 figures

Evolving Reliable Differentiating Constraints for the Chance-constrained Maximum Coverage Problem

Authors: Saba Sadeghi Ahouei, Jacob de Nobel, Aneta Neumann, Thomas Bäck, Frank Neumann

Abstract: Chance-constrained problems involve stochastic components in the constraints which can be violated with a small probability. We investigate the impact of different types of chance constraints on the performance of iterative search algorithms and study the classical maximum coverage problem in graphs with chance constraints. Our goal is to evolve reliable chance constraint settings for a given grap… ▽ More Chance-constrained problems involve stochastic components in the constraints which can be violated with a small probability. We investigate the impact of different types of chance constraints on the performance of iterative search algorithms and study the classical maximum coverage problem in graphs with chance constraints. Our goal is to evolve reliable chance constraint settings for a given graph where the performance of algorithms differs significantly not just in expectation but with high confidence. This allows to better learn and understand how different types of algorithms can deal with different types of constraint settings and supports automatic algorithm selection. We develop an evolutionary algorithm that provides sets of chance constraints that differentiate the performance of two stochastic search algorithms with high confidence. We initially use traditional approximation ratio as the fitness function of (1+1)~EA to evolve instances, which shows inadequacy to generate reliable instances. To address this issue, we introduce a new measure to calculate the performance difference for two algorithms, which considers variances of performance ratios. Our experiments show that our approach is highly successful in solving the instability issue of the performance ratios and leads to evolving reliable sets of chance constraints with significantly different performance for various types of algorithms. △ Less

Submitted 29 May, 2024; originally announced May 2024.

Sampling-based Pareto Optimization for Chance-constrained Monotone Submodular Problems

Authors: Xiankun Yan, Aneta Neumann, Frank Neumann

Abstract: Recently surrogate functions based on the tail inequalities were developed to evaluate the chance constraints in the context of evolutionary computation and several Pareto optimization algorithms using these surrogates were successfully applied in optimizing chance-constrained monotone submodular problems. However, the difference in performance between algorithms using the surrogates and those emp… ▽ More Recently surrogate functions based on the tail inequalities were developed to evaluate the chance constraints in the context of evolutionary computation and several Pareto optimization algorithms using these surrogates were successfully applied in optimizing chance-constrained monotone submodular problems. However, the difference in performance between algorithms using the surrogates and those employing the direct sampling-based evaluation remains unclear. Within the paper, a sampling-based method is proposed to directly evaluate the chance constraint. Furthermore, to address the problems with more challenging settings, an enhanced GSEMO algorithm integrated with an adaptive sliding window, called ASW-GSEMO, is introduced. In the experiments, the ASW-GSEMO employing the sampling-based approach is tested on the chance-constrained version of the maximum coverage problem with different settings. Its results are compared with those from other algorithms using different surrogate functions. The experimental findings indicate that the ASW-GSEMO with the sampling-based evaluation approach outperforms other algorithms, highlighting that the performances of algorithms using different evaluation methods are comparable. Additionally, the behaviors of ASW-GSEMO are visualized to explain the distinctions between it and the algorithms utilizing the surrogate functions. △ Less

Submitted 18 April, 2024; originally announced April 2024.

Analysis of Evolutionary Diversity Optimisation for the Maximum Matching Problem

Authors: Jonathan Gadea Harder, Aneta Neumann, Frank Neumann

Abstract: This paper explores the enhancement of solution diversity in evolutionary algorithms (EAs) for the maximum matching problem, concentrating on complete bipartite graphs and paths. We adopt binary string encoding for matchings and use Hamming distance to measure diversity, aiming for its maximization. Our study centers on the $(μ+1)$-EA and $2P-EA_D$, which are applied to optimize diversity. We prov… ▽ More This paper explores the enhancement of solution diversity in evolutionary algorithms (EAs) for the maximum matching problem, concentrating on complete bipartite graphs and paths. We adopt binary string encoding for matchings and use Hamming distance to measure diversity, aiming for its maximization. Our study centers on the $(μ+1)$-EA and $2P-EA_D$, which are applied to optimize diversity. We provide a rigorous theoretical and empirical analysis of these algorithms. For complete bipartite graphs, our runtime analysis shows that, with a reasonably small $μ$, the $(μ+1)$-EA achieves maximal diversity with an expected runtime of $O(μ^2 m^4 \log(m))$ for the small gap case (where the population size $μ$ is less than the difference in the sizes of the bipartite partitions) and $O(μ^2 m^2 \log(m))$ otherwise. For paths, we establish an upper runtime bound of $O(μ^3 m^3)$. The $2P-EA_D$ displays stronger performance, with bounds of $O(μ^2 m^2 \log(m))$ for the small gap case, $O(μ^2 n^2 \log(n))$ otherwise, and $O(μ^3 m^2)$ for paths. Here, $n$ represents the total number of vertices and $m$ the number of edges. Our empirical studies, which examine the scaling behavior with respect to $m$ and $μ$, complement these theoretical insights and suggest potential for further refinement of the runtime bounds. △ Less

Submitted 17 April, 2024; originally announced April 2024.

Runtime Analysis of Evolutionary Diversity Optimization on the Multi-objective (LeadingOnes, TrailingZeros) Problem

Authors: Denis Antipov, Aneta Neumann, Frank Neumann, Andrew M. Sutton

Abstract: The diversity optimization is the class of optimization problems, in which we aim at finding a diverse set of good solutions. One of the frequently used approaches to solve such problems is to use evolutionary algorithms which evolve a desired diverse population. This approach is called evolutionary diversity optimization (EDO). In this paper, we analyse EDO on a 3-objective function LOTZ$_k$, w… ▽ More The diversity optimization is the class of optimization problems, in which we aim at finding a diverse set of good solutions. One of the frequently used approaches to solve such problems is to use evolutionary algorithms which evolve a desired diverse population. This approach is called evolutionary diversity optimization (EDO). In this paper, we analyse EDO on a 3-objective function LOTZ$_k$, which is a modification of the 2-objective benchmark function (LeadingOnes, TrailingZeros). We prove that the GSEMO computes a set of all Pareto-optimal solutions in $O(kn^3)$ expected iterations. We also analyze the runtime of the GSEMO$_D$ (a modification of the GSEMO for diversity optimization) until it finds a population with the best possible diversity for two different diversity measures, the total imbalance and the sorted imbalances vector. For the first measure we show that the GSEMO$_D$ optimizes it asymptotically faster than it finds a Pareto-optimal population, in $O(kn^2\log(n))$ expected iterations, and for the second measure we show an upper bound of $O(k^2n^3\log(n))$ expected iterations. We complement our theoretical analysis with an empirical study, which shows a very similar behavior for both diversity measures that is close to the theory predictions. △ Less

Submitted 18 April, 2024; v1 submitted 17 April, 2024; originally announced April 2024.

Finite State Mean Field Games with Common Shocks

Authors: Berenice Anne Neumann, Frank T. Seifried

Abstract: We present a novel framework for mean field games with finite state space and common noise, where the common noise is given through shocks that occur at random times. We first analyze the game for up to $n$ shocks, in which case we are able to characterize mean field equilibria through a system of parameterized and coupled forward-backward equations. We establish existence and uniqueness of soluti… ▽ More We present a novel framework for mean field games with finite state space and common noise, where the common noise is given through shocks that occur at random times. We first analyze the game for up to $n$ shocks, in which case we are able to characterize mean field equilibria through a system of parameterized and coupled forward-backward equations. We establish existence and uniqueness of solutions to this system for small time horizons. In addition, we show that mean field equilibria for the $n$-shock setting constitute approximate equilibria for the corresponding mean field game with infinitely many common shocks. Our results are illustrated in a corruption detection model with random audits. △ Less

Submitted 12 April, 2024; originally announced April 2024.

Multi-Objective Evolutionary Algorithms with Sliding Window Selection for the Dynamic Chance-Constrained Knapsack Problem

Authors: Kokila Kasuni Perera, Aneta Neumann

Abstract: Evolutionary algorithms are particularly effective for optimisation problems with dynamic and stochastic components. We propose multi-objective evolutionary approaches for the knapsack problem with stochastic profits under static and dynamic weight constraints. The chance-constrained problem model allows us to effectively capture the stochastic profits and associate a confidence level to the solut… ▽ More Evolutionary algorithms are particularly effective for optimisation problems with dynamic and stochastic components. We propose multi-objective evolutionary approaches for the knapsack problem with stochastic profits under static and dynamic weight constraints. The chance-constrained problem model allows us to effectively capture the stochastic profits and associate a confidence level to the solutions' profits. We consider a bi-objective formulation that maximises expected profit and minimises variance, which allows optimising the problem independent of a specific confidence level on the profit. We derive a three-objective formulation by relaxing the weight constraint into an additional objective. We consider the GSEMO algorithm with standard and a sliding window-based parent selection to evaluate the objective formulations. Moreover, we modify fitness formulations and algorithms for the dynamic problem variant to store some infeasible solutions to cater to future changes. We conduct experimental investigations on both problems using the proposed problem formulations and algorithms. Our results show that three-objective approaches outperform approaches that use bi-objective formulations, and they further improve when GSEMO uses sliding window selection. △ Less

Submitted 11 April, 2024; originally announced April 2024.

Using 3-Objective Evolutionary Algorithms for the Dynamic Chance Constrained Knapsack Problem

Authors: Ishara Hewa Pathiranage, Frank Neumann, Denis Antipov, Aneta Neumann

Abstract: Real-world optimization problems often involve stochastic and dynamic components. Evolutionary algorithms are particularly effective in these scenarios, as they can easily adapt to uncertain and changing environments but often uncertainty and dynamic changes are studied in isolation. In this paper, we explore the use of 3-objective evolutionary algorithms for the chance constrained knapsack proble… ▽ More Real-world optimization problems often involve stochastic and dynamic components. Evolutionary algorithms are particularly effective in these scenarios, as they can easily adapt to uncertain and changing environments but often uncertainty and dynamic changes are studied in isolation. In this paper, we explore the use of 3-objective evolutionary algorithms for the chance constrained knapsack problem with dynamic constraints. In our setting, the weights of the items are stochastic and the knapsack's capacity changes over time. We introduce a 3-objective formulation that is able to deal with the stochastic and dynamic components at the same time and is independent of the confidence level required for the constraint. This new approach is then compared to the 2-objective formulation which is limited to a single confidence level. We evaluate the approach using two different multi-objective evolutionary algorithms (MOEAs), namely the global simple evolutionary multi-objective optimizer (GSEMO) and the multi-objective evolutionary algorithm based on decomposition (MOEA/D), across various benchmark scenarios. Our analysis highlights the advantages of the 3-objective formulation over the 2-objective formulation in addressing the dynamic chance constrained knapsack problem. △ Less

Submitted 9 April, 2024; originally announced April 2024.

A Block-Coordinate Descent EMO Algorithm: Theoretical and Empirical Analysis

Authors: Benjamin Doerr, Joshua Knowles, Aneta Neumann, Frank Neumann

Abstract: We consider whether conditions exist under which block-coordinate descent is asymptotically efficient in evolutionary multi-objective optimization, addressing an open problem. Block-coordinate descent, where an optimization problem is decomposed into $k$ blocks of decision variables and each of the blocks is optimized (with the others fixed) in a sequence, is a technique used in some large-scale o… ▽ More We consider whether conditions exist under which block-coordinate descent is asymptotically efficient in evolutionary multi-objective optimization, addressing an open problem. Block-coordinate descent, where an optimization problem is decomposed into $k$ blocks of decision variables and each of the blocks is optimized (with the others fixed) in a sequence, is a technique used in some large-scale optimization problems such as airline scheduling, however its use in multi-objective optimization is less studied. We propose a block-coordinate version of GSEMO and compare its running time to the standard GSEMO algorithm. Theoretical and empirical results on a bi-objective test function, a variant of LOTZ, serve to demonstrate the existence of cases where block-coordinate descent is faster. The result may yield wider insights into this class of algorithms. △ Less

Submitted 10 April, 2024; v1 submitted 4 April, 2024; originally announced April 2024.

Comments: Accepted at GECCO 2024

Evolutionary Multi-Objective Diversity Optimization

Authors: Anh Viet Do, Mingyu Guo, Aneta Neumann, Frank Neumann

Abstract: Creating diverse sets of high quality solutions has become an important problem in recent years. Previous works on diverse solutions problems consider solutions' objective quality and diversity where one is regarded as the optimization goal and the other as the constraint. In this paper, we treat this problem as a bi-objective optimization problem, which is to obtain a range of quality-diversity t… ▽ More Creating diverse sets of high quality solutions has become an important problem in recent years. Previous works on diverse solutions problems consider solutions' objective quality and diversity where one is regarded as the optimization goal and the other as the constraint. In this paper, we treat this problem as a bi-objective optimization problem, which is to obtain a range of quality-diversity trade-offs. To address this problem, we frame the evolutionary process as evolving a population of populations, and present a suitable general implementation scheme that is compatible with existing evolutionary multi-objective search methods. We realize the scheme in NSGA-II and SPEA2, and test the methods on various instances of maximum coverage, maximum cut and minimum vertex cover problems. The resulting non-dominated populations exhibit rich qualitative features, giving insights into the optimization instances and the quality-diversity trade-offs they induce. △ Less

Submitted 14 January, 2024; originally announced January 2024.

Comments: 12 pages, 3 figures, 3 tables

Integrable Magnetic Fluid Hyperthermia Systems for 3D Magnetic Particle Imaging

Authors: André Behrends, Huimin Wei, Alexander Neumann, Thomas Friedrich, Anna C. Bakenecker, Matthias Graeser, Thorsten M. Buzug

Abstract: Background: Combining magnetic particle imaging (MPI) and magnetic fluid hyperthermia (MFH) offers the ability to perform localized hyperthermia and magnetic particle imaging-assisted ther-mometry of hyperthermia treatment. This allows precise regional selective heating inside the body without invasive interventions. In current MPI-MFH platforms, separate systems are used, which require object tra… ▽ More Background: Combining magnetic particle imaging (MPI) and magnetic fluid hyperthermia (MFH) offers the ability to perform localized hyperthermia and magnetic particle imaging-assisted ther-mometry of hyperthermia treatment. This allows precise regional selective heating inside the body without invasive interventions. In current MPI-MFH platforms, separate systems are used, which require object transfer from one system to another. Here, we present the design, development and evaluation process for integrable MFH platforms, which extends a commercial MPI scanner with the functionality of MFH. Methods: The biggest issue of integrating magnetic fluid hyperthermia platforms into a magnetic par-ticle imaging system is the magnetic coupling of the devices, which induces high voltage in the imaging system, and is harming its components. In this paper we use a self-compensation approach derived from heuristic algorithms to protect the magnetic particle imaging scanner. The integrable platforms are evaluated regarding electrical and magnetic characteristics, cooling capability, field strength, the magnetic coupling to a replica of the magnetic particle imaging system's main solenoid and particle heating. Results: The MFH platforms generate suitable magnetic fields for magnetic heating of particles and are compatible with a commercial magnetic particle imaging scanner. In combination with the imaging system, selective heating with a gradient field and steerable heating positioning using the MPI focus fields are possible. Conclusion: The proposed MFH platforms serve as a therapeutic tool to unlock MFH functionality of a commercial magnetic particle imaging scanner, enabling its use in future preclinical trials of MPI-guided, spatially selective magnetic hyperthermia therapy. △ Less

Submitted 21 September, 2023; originally announced September 2023.

Markovian randomized equilibria for general Markovian Dynkin games in discrete time

Authors: Sören Christensen, Kristoffer Lindensjö, Berenice Anne Neumann

Abstract: We study a general formulation of the classical two-player Dynkin game in a Markovian discrete time setting. We show that an appropriate class of mixed, i.e., randomized, strategies in this context are \textit{Markovian randomized stopping times}, which correspond to stopping at any given state with a state-dependent probability. One main result is an explicit characterization of Wald-Bellman type… ▽ More We study a general formulation of the classical two-player Dynkin game in a Markovian discrete time setting. We show that an appropriate class of mixed, i.e., randomized, strategies in this context are \textit{Markovian randomized stopping times}, which correspond to stopping at any given state with a state-dependent probability. One main result is an explicit characterization of Wald-Bellman type for Nash equilibria based on this notion of randomization. In particular, this provides a novel characterization for randomized equilibria for the zero-sum game, which we use, e.g., to establish a new condition for the existence and construction of pure equilibria, to obtain necessary and sufficient conditions for the non-existence of pure strategy equilibria, and to construct an explicit example with a unique mixed, but no pure equilibrium. We also provide existence and characterization results for the symmetric specification of our game. Finally, we establish existence of a characterizable equilibrium in Markovian randomized stopping times for the general game formulation under the assumption that the state space is countable. △ Less

Submitted 25 July, 2023; originally announced July 2023.

MSC Class: 91A55; 60G40; 91A15

Diverse Approximations for Monotone Submodular Maximization Problems with a Matroid Constraint

Authors: Anh Viet Do, Mingyu Guo, Aneta Neumann, Frank Neumann

Abstract: Finding diverse solutions to optimization problems has been of practical interest for several decades, and recently enjoyed increasing attention in research. While submodular optimization has been rigorously studied in many fields, its diverse solutions extension has not. In this study, we consider the most basic variants of submodular optimization, and propose two simple greedy algorithms, which… ▽ More Finding diverse solutions to optimization problems has been of practical interest for several decades, and recently enjoyed increasing attention in research. While submodular optimization has been rigorously studied in many fields, its diverse solutions extension has not. In this study, we consider the most basic variants of submodular optimization, and propose two simple greedy algorithms, which are known to be effective at maximizing monotone submodular functions. These are equipped with parameters that control the trade-off between objective and diversity. Our theoretical contribution shows their approximation guarantees in both objective value and diversity, as functions of their respective parameters. Our experimental investigation with maximum vertex coverage instances demonstrates their empirical differences in terms of objective-diversity trade-offs. △ Less

Submitted 14 July, 2023; originally announced July 2023.

Comments: Preprint of a paper to be published in IJCAI'23

Rigorous Runtime Analysis of Diversity Optimization with GSEMO on OneMinMax

Authors: Denis Antipov, Aneta Neumann, Frank Neumann

Abstract: The evolutionary diversity optimization aims at finding a diverse set of solutions which satisfy some constraint on their fitness. In the context of multi-objective optimization this constraint can require solutions to be Pareto-optimal. In this paper we study how the GSEMO algorithm with additional diversity-enhancing heuristic optimizes a diversity of its population on a bi-objective benchmark p… ▽ More The evolutionary diversity optimization aims at finding a diverse set of solutions which satisfy some constraint on their fitness. In the context of multi-objective optimization this constraint can require solutions to be Pareto-optimal. In this paper we study how the GSEMO algorithm with additional diversity-enhancing heuristic optimizes a diversity of its population on a bi-objective benchmark problem OneMinMax, for which all solutions are Pareto-optimal. We provide a rigorous runtime analysis of the last step of the optimization, when the algorithm starts with a population with a second-best diversity, and prove that it finds a population with optimal diversity in expected time $O(n^2)$, when the problem size $n$ is odd. For reaching our goal, we analyse the random walk of the population, which reflects the frequency of changes in the population and their outcomes. △ Less

Submitted 14 July, 2023; originally announced July 2023.

Comments: The full version of the paper accepted to FOGA 2023 conference

Characterization of transport optimizers via graphs and applications to Stackelberg-Cournot-Nash equilibria

Authors: Beatrice Acciaio, Berenice Anne Neumann

Abstract: We introduce graphs associated to transport problems between discrete marginals, that allow to characterize the set of all optimizers given one primal optimizer. In particular, we establish that connectivity of those graphs is a necessary and sufficient condition for uniqueness of the dual optimizers. Moreover, we provide an algorithm that can efficiently compute the dual optimizer that is the lim… ▽ More We introduce graphs associated to transport problems between discrete marginals, that allow to characterize the set of all optimizers given one primal optimizer. In particular, we establish that connectivity of those graphs is a necessary and sufficient condition for uniqueness of the dual optimizers. Moreover, we provide an algorithm that can efficiently compute the dual optimizer that is the limit, as the regularization parameter goes to zero, of the dual entropic optimizers. Our results find an application in a Stackelberg-Cournot-Nash game, for which we obtain existence and characterization of the equilibria. △ Less

Submitted 6 June, 2023; originally announced June 2023.

Rigorous Runtime Analysis of MOEA/D for Solving Multi-Objective Minimum Weight Base Problems

Authors: Anh Viet Do, Aneta Neumann, Frank Neumann, Andrew M. Sutton

Abstract: We study the multi-objective minimum weight base problem, an abstraction of classical NP-hard combinatorial problems such as the multi-objective minimum spanning tree problem. We prove some important properties of the convex hull of the non-dominated front, such as its approximation quality and an upper bound on the number of extreme points. Using these properties, we give the first run-time analy… ▽ More We study the multi-objective minimum weight base problem, an abstraction of classical NP-hard combinatorial problems such as the multi-objective minimum spanning tree problem. We prove some important properties of the convex hull of the non-dominated front, such as its approximation quality and an upper bound on the number of extreme points. Using these properties, we give the first run-time analysis of the MOEA/D algorithm for this problem, an evolutionary algorithm that effectively optimizes by decomposing the objectives into single-objective components. We show that the MOEA/D, given an appropriate decomposition setting, finds all extreme points within expected fixed-parameter polynomial time in the oracle model, the parameter being the number of objectives. Experiments are conducted on random bi-objective minimum spanning tree instances, and the results agree with our theoretical findings. Furthermore, compared with a previously studied evolutionary algorithm for the problem GSEMO, MOEA/D finds all extreme points much faster across all instances. △ Less

Submitted 6 June, 2023; originally announced June 2023.

Comments: 12 pages

On the Impact of Operators and Populations within Evolutionary Algorithms for the Dynamic Weighted Traveling Salesperson Problem

Authors: Jakob Bossek, Aneta Neumann, Frank Neumann

Abstract: Evolutionary algorithms have been shown to obtain good solutions for complex optimization problems in static and dynamic environments. It is important to understand the behaviour of evolutionary algorithms for complex optimization problems that also involve dynamic and/or stochastic components in a systematic way in order to further increase their applicability to real-world problems. We investiga… ▽ More Evolutionary algorithms have been shown to obtain good solutions for complex optimization problems in static and dynamic environments. It is important to understand the behaviour of evolutionary algorithms for complex optimization problems that also involve dynamic and/or stochastic components in a systematic way in order to further increase their applicability to real-world problems. We investigate the node weighted traveling salesperson problem (W-TSP), which provides an abstraction of a wide range of weighted TSP problems, in dynamic settings. In the dynamic setting of the problem, items that have to be collected as part of a TSP tour change over time. We first present a dynamic setup for the dynamic W-TSP parameterized by different types of changes that are applied to the set of items to be collected when traversing the tour. Our first experimental investigations study the impact of such changes on resulting optimized tours in order to provide structural insights of optimization solutions. Afterwards, we investigate simple mutation-based evolutionary algorithms and study the impact of the mutation operators and the use of populations with dealing with the dynamic changes to the node weights of the problem. △ Less

Submitted 30 May, 2023; originally announced May 2023.

Analysis of the (1+1) EA on LeadingOnes with Constraints

Authors: Tobias Friedrich, Timo Kötzing, Aneta Neumann, Frank Neumann, Aishwarya Radhakrishnan

Abstract: Understanding how evolutionary algorithms perform on constrained problems has gained increasing attention in recent years. In this paper, we study how evolutionary algorithms optimize constrained versions of the classical LeadingOnes problem. We first provide a run time analysis for the classical (1+1) EA on the LeadingOnes problem with a deterministic cardinality constraint, giving… ▽ More Understanding how evolutionary algorithms perform on constrained problems has gained increasing attention in recent years. In this paper, we study how evolutionary algorithms optimize constrained versions of the classical LeadingOnes problem. We first provide a run time analysis for the classical (1+1) EA on the LeadingOnes problem with a deterministic cardinality constraint, giving $Θ(n (n-B)\log(B) + n^2)$ as the tight bound. Our results show that the behaviour of the algorithm is highly dependent on the constraint bound of the uniform constraint. Afterwards, we consider the problem in the context of stochastic constraints and provide insights using experimental studies on how the ($μ$+1) EA is able to deal with these constraints in a sampling-based setting. △ Less

Submitted 29 May, 2023; originally announced May 2023.

Improving Confidence in Evolutionary Mine Scheduling via Uncertainty Discounting

Authors: Michael Stimson, William Reid, Aneta Neumann, Simon Ratcliffe, Frank Neumann

Abstract: Mine planning is a complex task that involves many uncertainties. During early stage feasibility, available mineral resources can only be estimated based on limited sampling of ore grades from sparse drilling, leading to large uncertainty in under-sampled parts of the deposit. Planning the extraction schedule of ore over the life of a mine is crucial for its economic viability. We introduce a new… ▽ More Mine planning is a complex task that involves many uncertainties. During early stage feasibility, available mineral resources can only be estimated based on limited sampling of ore grades from sparse drilling, leading to large uncertainty in under-sampled parts of the deposit. Planning the extraction schedule of ore over the life of a mine is crucial for its economic viability. We introduce a new approach for determining an "optimal schedule under uncertainty" that provides probabilistic bounds on the profits obtained in each period. This treatment of uncertainty within an economic framework reduces previously difficult-to-use models of variability into actionable insights. The new method discounts profits based on uncertainty within an evolutionary algorithm, sacrificing economic optimality of a single geological model for improving the downside risk over an ensemble of equally likely models. We provide experimental studies using Maptek's mine planning software Evolution. Our results show that our new approach is successful for effectively making use of uncertainty information in the mine planning process. △ Less

Submitted 29 May, 2023; originally announced May 2023.

Evolving Reinforcement Learning Environment to Minimize Learner's Achievable Reward: An Application on Hardening Active Directory Systems

Authors: Diksha Goel, Aneta Neumann, Frank Neumann, Hung Nguyen, Mingyu Guo

Abstract: We study a Stackelberg game between one attacker and one defender in a configurable environment. The defender picks a specific environment configuration. The attacker observes the configuration and attacks via Reinforcement Learning (RL trained against the observed environment). The defender's goal is to find the environment with minimum achievable reward for the attacker. We apply Evolutionary Di… ▽ More We study a Stackelberg game between one attacker and one defender in a configurable environment. The defender picks a specific environment configuration. The attacker observes the configuration and attacks via Reinforcement Learning (RL trained against the observed environment). The defender's goal is to find the environment with minimum achievable reward for the attacker. We apply Evolutionary Diversity Optimization (EDO) to generate diverse population of environments for training. Environments with clearly high rewards are killed off and replaced by new offsprings to avoid wasting training time. Diversity not only improves training quality but also fits well with our RL scenario: RL agents tend to improve gradually, so a slightly worse environment earlier on may become better later. We demonstrate the effectiveness of our approach by focusing on a specific application, Active Directory (AD). AD is the default security management system for Windows domain networks. AD environment describes an attack graph, where nodes represent computers/accounts/etc., and edges represent accesses. The attacker aims to find the best attack path to reach the highest-privilege node. The defender can change the graph by removing a limited number of edges (revoke accesses). Our approach generates better defensive plans than the existing approach and scales better. △ Less

Submitted 8 April, 2023; originally announced April 2023.

Fixed Parameter Multi-Objective Evolutionary Algorithms for the W-Separator Problem

Authors: Samuel Baguley, Tobias Friedrich, Aneta Neumann, Frank Neumann, Marcus Pappik, Ziena Zeif

Abstract: Parameterized analysis provides powerful mechanisms for obtaining fine-grained insights into different types of algorithms. In this work, we combine this field with evolutionary algorithms and provide parameterized complexity analysis of evolutionary multi-objective algorithms for the $W$-separator problem, which is a natural generalization of the vertex cover problem. The goal is to remove the mi… ▽ More Parameterized analysis provides powerful mechanisms for obtaining fine-grained insights into different types of algorithms. In this work, we combine this field with evolutionary algorithms and provide parameterized complexity analysis of evolutionary multi-objective algorithms for the $W$-separator problem, which is a natural generalization of the vertex cover problem. The goal is to remove the minimum number of vertices such that each connected component in the resulting graph has at most $W$ vertices. We provide different multi-objective formulations involving two or three objectives that provably lead to fixed-parameter evolutionary algorithms with respect to the value of an optimal solution $OPT$ and $W$. Of particular interest are kernelizations and the reducible structures used for them. We show that in expectation the algorithms make incremental progress in finding such structures and beyond. The current best known kernelization of the $W$-separator uses linear programming methods and requires a non-trivial post-process to extract the reducible structures. We provide additional structural features to show that evolutionary algorithms with appropriate objectives are also capable of extracting them. Our results show that evolutionary algorithms with different objectives guide the search and admit fixed parameterized runtimes to solve or approximate (even arbitrarily close) the $W$-separator problem. △ Less

Submitted 21 March, 2023; v1 submitted 20 March, 2023; originally announced March 2023.

Towards Self-adaptive Mutation in Evolutionary Multi-Objective Algorithms

Authors: Furong Ye, Frank Neumann, Jacob de Nobel, Aneta Neumann, Thomas Bäck

Abstract: Parameter control has succeeded in accelerating the convergence process of evolutionary algorithms. While empirical and theoretical studies have shed light on the behavior of algorithms for single-objective optimization, little is known about how self-adaptation influences multi-objective evolutionary algorithms. In this work, we contribute (1) extensive experimental analysis of the Global Simple… ▽ More Parameter control has succeeded in accelerating the convergence process of evolutionary algorithms. While empirical and theoretical studies have shed light on the behavior of algorithms for single-objective optimization, little is known about how self-adaptation influences multi-objective evolutionary algorithms. In this work, we contribute (1) extensive experimental analysis of the Global Simple Evolutionary Multi-objective Algorithm (GSEMO) variants on classic problems, such as OneMinMax, LOTZ, COCZ, and (2) a novel version of GSEMO with self-adaptive mutation. To enable self-adaptation in GSEMO, we explore three self-adaptive mutation techniques from single-objective optimization and use various performance metrics, such as hypervolume and inverted generational distance, to guide the adaptation. Our experiments show that adapting the mutation rate based on single-objective optimization and hypervolume can speed up the convergence of GSEMO. Moreover, we propose a GSEMO with self-adaptive mutation, which considers optimizing for single objectives and adjusts the mutation rate for each solution individually. Our results demonstrate that the proposed method outperforms the GSEMO with static mutation rates across all the tested problems. This work provides a comprehensive benchmarking study for MOEAs and complements existing theoretical runtime analysis. Our proposed algorithm addresses interesting issues for designing MOEAs for future practical applications. △ Less

Submitted 8 May, 2023; v1 submitted 8 March, 2023; originally announced March 2023.

Comments: submitted to FOGA 2023

Evolutionary Multi-Objective Algorithms for the Knapsack Problems with Stochastic Profits

Authors: Kokila Perera, Aneta Neumann, Frank Neumann

Abstract: Evolutionary multi-objective algorithms have been widely shown to be successful when utilized for a variety of stochastic combinatorial optimization problems. Chance constrained optimization plays an important role in complex real-world scenarios, as it allows decision makers to take into account the uncertainty of the environment. We consider a version of the knapsack problem with stochastic prof… ▽ More Evolutionary multi-objective algorithms have been widely shown to be successful when utilized for a variety of stochastic combinatorial optimization problems. Chance constrained optimization plays an important role in complex real-world scenarios, as it allows decision makers to take into account the uncertainty of the environment. We consider a version of the knapsack problem with stochastic profits to guarantee a certain level of confidence in the profit of the solutions. We introduce the multi-objective formulations of the profit chance constrained knapsack problem and design three bi-objective fitness evaluation methods that work independently of the specific confidence level required. We evaluate our approaches using well-known multi-objective evolutionary algorithms GSEMO and NSGA-II. In addition, we introduce a filtering method for GSEMO that improves the quality of the final population by periodically removing certain solutions from the interim populations based on their confidence level. We show the effectiveness of our approaches on several benchmarks for both settings where the knapsack items have fixed uniform uncertainties and uncertainties that are positively correlated with the expected profit of an item. △ Less

Submitted 2 March, 2023; originally announced March 2023.

Comments: 14 pages, 1 figure

Limited Query Graph Connectivity Test

Authors: Mingyu Guo, Jialiang Li, Aneta Neumann, Frank Neumann, Hung Nguyen

Abstract: We propose a combinatorial optimisation model called Limited Query Graph Connectivity Test. We consider a graph whose edges have two possible states (On/Off). The edges' states are hidden initially. We could query an edge to reveal its state. Given a source s and a destination t, we aim to test s-t connectivity by identifying either a path (consisting of only On edges) or a cut (consisting of only… ▽ More We propose a combinatorial optimisation model called Limited Query Graph Connectivity Test. We consider a graph whose edges have two possible states (On/Off). The edges' states are hidden initially. We could query an edge to reveal its state. Given a source s and a destination t, we aim to test s-t connectivity by identifying either a path (consisting of only On edges) or a cut (consisting of only Off edges). We are limited to B queries, after which we stop regardless of whether graph connectivity is established. We aim to design a query policy that minimizes the expected number of queries. Our model is mainly motivated by a cyber security use case where we need to establish whether an attack path exists in a network, between a source and a destination. Edge query is resolved by manual effort from the IT admin, which is the motivation behind query minimization. Our model is highly related to monotone Stochastic Boolean Function Evaluation (SBFE). There are two existing exact algorithms for SBFE that are prohibitively expensive. We propose a significantly more scalable exact algorithm. While previous exact algorithms only scale for trivial graphs (i.e., past works experimented on at most 20 edges), we empirically demonstrate that our algorithm is scalable for a wide range of much larger practical graphs (i.e., Windows domain network graphs with tens of thousands of edges). We propose three heuristics. Our best-performing heuristic is via reducing the search horizon of the exact algorithm. The other two are via reinforcement learning (RL) and Monte Carlo tree search (MCTS). We also derive an anytime algorithm for computing the performance lower bound. Experimentally, we show that all our heuristics are near optimal. The exact algorithm based heuristic outperforms all, surpassing RL, MCTS and 8 existing heuristics ported from SBFE and related literature. △ Less

Submitted 18 December, 2023; v1 submitted 25 February, 2023; originally announced February 2023.

Journal ref: AAAI 2024

Vanishing of the second $L^p$-cohomology group for most semisimple groups of rank at least 3

Authors: Antonio López Neumann

Abstract: We show vanishing of the second $L^p$-cohomology group for most semisimple algebraic groups of rank at least 3 over local fields. More precisely, we show this result for $\SL(4)$, for simple groups of rank $\geq 4$ that are not of exceptional type or of type $D_4$ and for all semisimple, non-simple groups of rank $\geq 3$. Our methods work for large values of $p$ in the real case and for all… ▽ More We show vanishing of the second $L^p$-cohomology group for most semisimple algebraic groups of rank at least 3 over local fields. More precisely, we show this result for $\SL(4)$, for simple groups of rank $\geq 4$ that are not of exceptional type or of type $D_4$ and for all semisimple, non-simple groups of rank $\geq 3$. Our methods work for large values of $p$ in the real case and for all $p>1$ in the non-Archimedean case. This result points towards a positive answer to Gromov's question on vanishing of $L^p$-cohomology of semisimple groups for all $p>1$ in degrees below the rank. The methods consist in using a spectral sequence à la Bourdon-Rémy, adapting a version of Mautner's phenomenon from Cornulier-Tessera and concluding thanks to a combinatorial case-by-case study of classical simple groups. △ Less

Submitted 13 October, 2023; v1 submitted 18 February, 2023; originally announced February 2023.

Comments: 30 pages, 3 tables. Changes in version 2: some proofs in section 2 have been simplified, some minor typos were corrected and author affiliation is updated

MSC Class: 20F67; 20G07; 22E41; 43A15

Benchmarking Algorithms for Submodular Optimization Problems Using IOHProfiler

Authors: Frank Neumann, Aneta Neumann, Chao Qian, Viet Anh Do, Jacob de Nobel, Diederick Vermetten, Saba Sadeghi Ahouei, Furong Ye, Hao Wang, Thomas Bäck

Abstract: Submodular functions play a key role in the area of optimization as they allow to model many real-world problems that face diminishing returns. Evolutionary algorithms have been shown to obtain strong theoretical performance guarantees for a wide class of submodular problems under various types of constraints while clearly outperforming standard greedy approximation algorithms. This paper introduc… ▽ More Submodular functions play a key role in the area of optimization as they allow to model many real-world problems that face diminishing returns. Evolutionary algorithms have been shown to obtain strong theoretical performance guarantees for a wide class of submodular problems under various types of constraints while clearly outperforming standard greedy approximation algorithms. This paper introduces a setup for benchmarking algorithms for submodular optimization problems with the aim to provide researchers with a framework to enhance and compare the performance of new algorithms for submodular problems. The focus is on the development of iterative search algorithms such as evolutionary algorithms with the implementation provided and integrated into IOHprofiler which allows for tracking and comparing the progress and performance of iterative search algorithms. We present a range of submodular optimization problems that have been integrated into IOHprofiler and show how the setup can be used for analyzing and comparing iterative search algorithms in various settings. △ Less

Submitted 2 February, 2023; originally announced February 2023.

Scalable Edge Blocking Algorithms for Defending Active Directory Style Attack Graphs

Authors: Mingyu Guo, Max Ward, Aneta Neumann, Frank Neumann, Hung Nguyen

Abstract: Active Directory (AD) is the default security management system for Windows domain networks. An AD environment naturally describes an attack graph where nodes represent computers/accounts/security groups, and edges represent existing accesses/known exploits that allow the attacker to gain access from one node to another. Motivated by practical AD use cases, we study a Stackelberg game between one… ▽ More Active Directory (AD) is the default security management system for Windows domain networks. An AD environment naturally describes an attack graph where nodes represent computers/accounts/security groups, and edges represent existing accesses/known exploits that allow the attacker to gain access from one node to another. Motivated by practical AD use cases, we study a Stackelberg game between one attacker and one defender. There are multiple entry nodes for the attacker to choose from and there is a single target (Domain Admin). Every edge has a failure rate. The attacker chooses the attack path with the maximum success rate. The defender can block a limited number of edges (i.e., revoke accesses) from a set of blockable edges, limited by budget. The defender's aim is to minimize the attacker's success rate. We exploit the tree-likeness of practical AD graphs to design scalable algorithms. We propose two novel methods that combine theoretical fixed parameter analysis and practical optimisation techniques. For graphs with small tree widths, we propose a tree decomposition based dynamic program. We then propose a general method for converting tree decomposition based dynamic programs to reinforcement learning environments, which leads to an anytime algorithm that scales better, but loses the optimality guarantee. For graphs with small numbers of non-splitting paths (a parameter we invent specifically for AD graphs), we propose a kernelization technique that significantly downsizes the model, which is then solved via mixed-integer programming. Experimentally, our algorithms scale to handle synthetic AD graphs with tens of thousands of nodes. △ Less

Submitted 2 December, 2022; originally announced December 2022.

Solidarity in natural gas storage: A potential allocation mechanism of stored quantities among several players during times of crisis

Authors: Dávid Csercsik, Anne Neumann

Abstract: The recently experienced disruptions in the EU's energy supply pointed out that supply crises pose a real thread and the member states must be better prepared do deal with the related challenges. According to the current practice, member states fill their gas storages independently, while it is not clear how solidarity could be put into practice in the future, i.e. how the accumulated reserves of… ▽ More The recently experienced disruptions in the EU's energy supply pointed out that supply crises pose a real thread and the member states must be better prepared do deal with the related challenges. According to the current practice, member states fill their gas storages independently, while it is not clear how solidarity could be put into practice in the future, i.e. how the accumulated reserves of one or more members may be potentially redistributed to help others in need. In this paper we propose some possible guidelines for a potential solidarity framework, and formalize a game-theoretic model in order to capture the basic features of the problem, considering the related uncertainty of the future conditions related to gas storage levels and possible transmission bottlenecks as well. The proposed mechanism of supply-security related cooperation is based on voluntary participation, and may contribute to the more efficient utilization of storage capacities. Via the computational model we demonstrate the operation of the proposed framework on a simple example and show that under the assumption of risk-averse participants, the concept exhibits potential. △ Less

Submitted 21 August, 2023; v1 submitted 12 September, 2022; originally announced September 2022.

Diffusion Processes: entropy, Gibbs states and the continuous time Ruelle operator

Authors: A. O. Lopes, G. Muller, A. Neumann

Abstract: We consider a Riemmaniann compact manifold $M$, the associated Laplacian $Δ$ and the corresponding Brownian motion $X_t$, $t\geq 0.$ Given a Lipschitz function $V:M\to\mathbb R$ we consider the operator $\frac{1}{2}Δ+V$, which acts on differentiable functions $f: M\to\mathbb R$ via the operator $$\frac{1}{2} Δf(x)+\,V(x)f(x) ,$$ for all $x\in M$. Denote by $P_t^V$, $t \geq 0,$ the semigroup ac… ▽ More We consider a Riemmaniann compact manifold $M$, the associated Laplacian $Δ$ and the corresponding Brownian motion $X_t$, $t\geq 0.$ Given a Lipschitz function $V:M\to\mathbb R$ we consider the operator $\frac{1}{2}Δ+V$, which acts on differentiable functions $f: M\to\mathbb R$ via the operator $$\frac{1}{2} Δf(x)+\,V(x)f(x) ,$$ for all $x\in M$. Denote by $P_t^V$, $t \geq 0,$ the semigroup acting on functions $f: M\to\mathbb R$ given by $$P_{t}^V (f)(x)\,:=\, \mathbb E_{x} \big[e^{\int_0^{t} V(X_r)\,dr} f(X_t)\big].\,$$ We will show that this semigroup is a continuous-time version of the discrete-time Ruelle operator. Consider the positive differentiable eigenfunction $F: M \to \mathbb{R}$ associated to the main eigenvalue $λ$ for the semigroup $P_t^V$, $t \geq 0$. From the function $F$, in a procedure similar to the one used in the case of discrete-time Thermodynamic Formalism, we can associate via a coboundary procedure a certain stationary Markov semigroup. The probability on the Skhorohod space obtained from this new stationary Markov semigroup can be seen as a stationary Gibbs state associated with the potential $V$. We define entropy, pressure, the continuous-time Ruelle operator and we present a variational principle of pressure for such a setting. △ Less

Submitted 3 August, 2022; originally announced August 2022.

MSC Class: 60J25; 60J60; 60J65; 58J65; 37D35

Thermodynamic Formalism on the Skorokhod space: the continuous time Ruelle operator, entropy, pressure, entropy production and expansiveness

Authors: J. Knorst, A. O. Lopes, G. Muller, A. Neumann

Abstract: Consider the semi-flow given by the continuous time shift $Θ_t:\mathcal{D} \to \mathcal{D} $, $t \geq 0$, acting on the $\mathcal{D} $ of \textit{càdlàg} paths $w: [0,\infty) \to S^1$, where $S^1$ is the unitary circle. We equip the space $\mathcal{D} $ with the Skorokhod metric, and we show that the semi-flow is expanding. We also introduce a stochastic semi-group $e^{t\, L}$, $t \geq 0,$ where… ▽ More Consider the semi-flow given by the continuous time shift $Θ_t:\mathcal{D} \to \mathcal{D} $, $t \geq 0$, acting on the $\mathcal{D} $ of \textit{càdlàg} paths $w: [0,\infty) \to S^1$, where $S^1$ is the unitary circle. We equip the space $\mathcal{D} $ with the Skorokhod metric, and we show that the semi-flow is expanding. We also introduce a stochastic semi-group $e^{t\, L}$, $t \geq 0,$ where $L$ acts linearly on continuous functions $f:S^1\to\mathbb{R}$. This stochastic semigroup and an initial vector of probability $π$ define an associated stationary shift-invariant probability $\mathbb{P}$ on the Polish space $\mathcal{D} $. Given such $\mathbb{P}$ and an Hölder potential $V:S^1 \to \mathbb{R}$, we define a continuous time Ruelle operator, which is described by a family of linear operators $ \mathbb{L}^t_V$, $t\geq 0,$ acting on continuous functions $\varphi: S^1 \to \mathbb{R}$. More precisely, given any Hölder $V$ and $t\geq 0$, the operator $ \mathbb{L}^t_V$, is defined by $\varphi \to ψ(y) = \mathbb{L}^t_V(\varphi)(y)= \int_{w(t)=y} e^{ \int_0^t V(w(s)) ds} \varphi (w(0)) d \mathbb{P}(w).$ For some specific parameters we show the existence of an eigenvalue $λ_V$ and an associated Hölder eigenfunction $\varphi_V>0$.After a coboundary procedure we obtain another stochastic semigroup, with infinitesimal generator $L_V$, and this will define a new probability $\mathbb{P}_V$ on $\mathcal{D}$, which we call the Gibbs (or, equilibrium) probability for the potential $V$. In this case, we define entropy for some shift-invariant probabilities on $\mathcal{D}$, and we consider a variational problem of pressure. Finally, we define entropy production and present our main result: we analyze its relation with time-reversal and symmetry of $L$. We also show that the continuous-time shift $Θ_t$, acting on the Skorohod space $D$, is expanding. △ Less

Submitted 27 February, 2024; v1 submitted 3 August, 2022; originally announced August 2022.

Comments: We made some changes to the material from the last submission

MSC Class: 37A50; 37A10; 37A60; 37D35; 60G10; 60J25; 82B05; 82B30

Computing High-Quality Solutions for the Patient Admission Scheduling Problem using Evolutionary Diversity Optimisation

Authors: Adel Nikfarjam, Amirhossein Moosavi, Aneta Neumann, Frank Neumann

Abstract: Diversification in a set of solutions has become a hot research topic in the evolutionary computation community. It has been proven beneficial for optimisation problems in several ways, such as computing a diverse set of high-quality solutions and obtaining robustness against imperfect modeling. For the first time in the literature, we adapt the evolutionary diversity optimisation for a real-world… ▽ More Diversification in a set of solutions has become a hot research topic in the evolutionary computation community. It has been proven beneficial for optimisation problems in several ways, such as computing a diverse set of high-quality solutions and obtaining robustness against imperfect modeling. For the first time in the literature, we adapt the evolutionary diversity optimisation for a real-world combinatorial problem, namely patient admission scheduling. We introduce an evolutionary algorithm to achieve structural diversity in a set of solutions subjected to the quality of each solution. We also introduce a mutation operator biased towards diversity maximisation. Finally, we demonstrate the importance of diversity for the aforementioned problem through a simulation. △ Less

Submitted 28 July, 2022; originally announced July 2022.

Comments: To appear at PPSN 2022

Co-Evolutionary Diversity Optimisation for the Traveling Thief Problem

Authors: Adel Nikfarjam, Aneta Neumann, Jakob Bossek, Frank Neumann

Abstract: Recently different evolutionary computation approaches have been developed that generate sets of high quality diverse solutions for a given optimisation problem. Many studies have considered diversity 1) as a mean to explore niches in behavioural space (quality diversity) or 2) to increase the structural differences of solutions (evolutionary diversity optimisation). In this study, we introduce a… ▽ More Recently different evolutionary computation approaches have been developed that generate sets of high quality diverse solutions for a given optimisation problem. Many studies have considered diversity 1) as a mean to explore niches in behavioural space (quality diversity) or 2) to increase the structural differences of solutions (evolutionary diversity optimisation). In this study, we introduce a co-evolutionary algorithm to simultaneously explore the two spaces for the multi-component traveling thief problem. The results show the capability of the co-evolutionary algorithm to achieve significantly higher diversity compared to the baseline evolutionary diversity algorithms from the the literature. △ Less

Submitted 28 July, 2022; originally announced July 2022.

Comments: To appear at PPSN 2022

The Development of Energy-Recovery Linacs

Authors: Chris Adolphsen, Kevin Andre, Deepa Angal-Kalinin, Michaela Arnold, Kurt Aulenbacher, Steve Benson, Jan Bernauer, Alex Bogacz, Maarten Boonekamp, Reinhard Brinkmann, Max Bruker, Oliver Brüning, Camilla Curatolo, Patxi Duthill, Oliver Fischer, Georg Hoffstaetter, Bernhard Holzer, Ben Hounsell, Andrew Hutton, Erk Jensen, Walid Kaabi, Dmitry Kayran, Max Klein, Jens Knobloch, Geoff Krafft , et al. (24 additional authors not shown)

Abstract: Energy-recovery linacs (ERLs) have been emphasised by the recent (2020) update of the European Strategy for Particle Physics as one of the most promising technologies for the accelerator base of future high-energy physics. The current paper has been written as a base document to support and specify details of the recently published European roadmap for the development of energy-recovery linacs. Th… ▽ More Energy-recovery linacs (ERLs) have been emphasised by the recent (2020) update of the European Strategy for Particle Physics as one of the most promising technologies for the accelerator base of future high-energy physics. The current paper has been written as a base document to support and specify details of the recently published European roadmap for the development of energy-recovery linacs. The paper summarises the previous achievements on ERLs and the status of the field and its basic technology items. The main possible future contributions and applications of ERLs to particle and nuclear physics as well as industrial developments are presented. The paper includes a vision for the further future, beyond 2030, as well as a comparative data base for the main existing and forthcoming ERL facilities. A series of continuous innovations, such as on intense electron sources or high-quality superconducting cavity technology, will massively contribute to the development of accelerator physics at large. Industrial applications are potentially revolutionary and may carry the development of ERLs much further, establishing another shining example of the impact of particle physics on society and its technical foundation with a special view on sustaining nature. △ Less

Submitted 27 September, 2022; v1 submitted 5 July, 2022; originally announced July 2022.

Evolutionary Time-Use Optimization for Improving Children's Health Outcomes

Authors: Yue Xie, Aneta Neumann, Ty Stanford, Charlotte Lund Rasmussen, Dorothea Dumuid, Frank Neumann

Abstract: How someone allocates their time is important to their health and well-being. In this paper, we show how evolutionary algorithms can be used to promote health and well-being by optimizing time usage. Based on data from a large population-based child cohort, we design fitness functions to explain health outcomes and introduce constraints for viable time plans. We then investigate the performance of… ▽ More How someone allocates their time is important to their health and well-being. In this paper, we show how evolutionary algorithms can be used to promote health and well-being by optimizing time usage. Based on data from a large population-based child cohort, we design fitness functions to explain health outcomes and introduce constraints for viable time plans. We then investigate the performance of evolutionary algorithms to optimize time use for four individual health outcomes with hypothetical children with different day structures. As the four health outcomes are competing for time allocations, we study how to optimize multiple health outcomes simultaneously in the form of a multi-objective optimization problem. We optimize one-week time-use plans using evolutionary multi-objective algorithms and point out the trade-offs achievable with respect to different health outcomes. △ Less

Submitted 23 June, 2022; originally announced June 2022.

Comments: Has been accepted by PPSN2022

Top degree $\ell^p$-homology and conformal dimension of buildings

Authors: Antonio López Neumann

Abstract: For a non-compact finite thickness building whose Davis apartment is an orientable pseudomanifold, we compute the supremum of the set of $p>1$ such that its top dimensional reduced $\ell^p$-cohomology is nonzero. We adapt the non-vanishing assertion of this result to any finite thickness building using the Bestvina realization. Using similar techniques, we generalize bounds obtained by Clais on th… ▽ More For a non-compact finite thickness building whose Davis apartment is an orientable pseudomanifold, we compute the supremum of the set of $p>1$ such that its top dimensional reduced $\ell^p$-cohomology is nonzero. We adapt the non-vanishing assertion of this result to any finite thickness building using the Bestvina realization. Using similar techniques, we generalize bounds obtained by Clais on the conformal dimension of some Gromov-hyperbolic buildings to any such building. △ Less

Submitted 12 April, 2022; originally announced April 2022.

MSC Class: 20J06; 20F67; 22E41; 30L10; 43A15; 51E24

Evolutionary Algorithms for Limiting the Effect of Uncertainty for the Knapsack Problem with Stochastic Profits

Authors: Aneta Neumann, Yue Xie, Frank Neumann

Abstract: Evolutionary algorithms have been widely used for a range of stochastic optimization problems in order to address complex real-world optimization problems. We consider the knapsack problem where the profits involve uncertainties. Such a stochastic setting reflects important real-world scenarios where the profit that can be realized is uncertain. We introduce different ways of dealing with stochast… ▽ More Evolutionary algorithms have been widely used for a range of stochastic optimization problems in order to address complex real-world optimization problems. We consider the knapsack problem where the profits involve uncertainties. Such a stochastic setting reflects important real-world scenarios where the profit that can be realized is uncertain. We introduce different ways of dealing with stochastic profits based on tail inequalities such as Chebyshev's inequality and Hoeffding bounds that allow to limit the impact of uncertainties. We examine simple evolutionary algorithms and the use of heavy tail mutation and a problem-specific crossover operator for optimizing uncertain profits. Our experimental investigations on different benchmarks instances show the results of different approaches based on tail inequalities as well as improvements achievable through heavy tail mutation and the problem specific crossover operator. △ Less

Submitted 12 April, 2022; originally announced April 2022.

Coevolutionary Pareto Diversity Optimization

Authors: Aneta Neumann, Denis Antipov, Frank Neumann

Abstract: Computing diverse sets of high quality solutions for a given optimization problem has become an important topic in recent years. In this paper, we introduce a coevolutionary Pareto Diversity Optimization approach which builds on the success of reformulating a constrained single-objective optimization problem as a bi-objective problem by turning the constraint into an additional objective. Our new… ▽ More Computing diverse sets of high quality solutions for a given optimization problem has become an important topic in recent years. In this paper, we introduce a coevolutionary Pareto Diversity Optimization approach which builds on the success of reformulating a constrained single-objective optimization problem as a bi-objective problem by turning the constraint into an additional objective. Our new Pareto Diversity optimization approach uses this bi-objective formulation to optimize the problem while also maintaining an additional population of high quality solutions for which diversity is optimized with respect to a given diversity measure. We show that our standard co-evolutionary Pareto Diversity Optimization approach outperforms the recently introduced DIVEA algorithm which obtains its initial population by generalized diversifying greedy sampling and improving the diversity of the set of solutions afterwards. Furthermore, we study possible improvements of the Pareto Diversity Optimization approach. In particular, we show that the use of inter-population crossover further improves the diversity of the set of solutions. △ Less

Submitted 11 April, 2022; originally announced April 2022.

Defending Active Directory by Combining Neural Network based Dynamic Program and Evolutionary Diversity Optimisation

Authors: Diksha Goel, Max Ward, Aneta Neumann, Frank Neumann, Hung Nguyen, Mingyu Guo

Abstract: Active Directory (AD) is the default security management system for Windows domain networks. We study a Stackelberg game model between one attacker and one defender on an AD attack graph. The attacker initially has access to a set of entry nodes. The attacker can expand this set by strategically exploring edges. Every edge has a detection rate and a failure rate. The attacker aims to maximize thei… ▽ More Active Directory (AD) is the default security management system for Windows domain networks. We study a Stackelberg game model between one attacker and one defender on an AD attack graph. The attacker initially has access to a set of entry nodes. The attacker can expand this set by strategically exploring edges. Every edge has a detection rate and a failure rate. The attacker aims to maximize their chance of successfully reaching the destination before getting detected. The defender's task is to block a constant number of edges to decrease the attacker's chance of success. We show that the problem is #P-hard and, therefore, intractable to solve exactly. We convert the attacker's problem to an exponential sized Dynamic Program that is approximated by a Neural Network (NN). Once trained, the NN provides an efficient fitness function for the defender's Evolutionary Diversity Optimisation (EDO). The diversity emphasis on the defender's solution provides a diverse set of training samples, which improves the training accuracy of our NN for modelling the attacker. We go back and forth between NN training and EDO. Experimental results show that for R500 graph, our proposed EDO based defense is less than 1% away from the optimal defense. △ Less

Submitted 4 January, 2023; v1 submitted 7 April, 2022; originally announced April 2022.

Comments: Added reference [12] on page 3 and 4. Corrected spelling EVC to VEC on page 10

Journal ref: Proceedings of the Genetic and Evolutionary Computation Conference, 2022, Pages 1191 to 1199

Evolutionary Diversity Optimisation for The Traveling Thief Problem

Authors: Adel Nikfarjam, Aneta Neumann, Frank Neumann

Abstract: There has been a growing interest in the evolutionary computation community to compute a diverse set of high-quality solutions for a given optimisation problem. This can provide the practitioners with invaluable information about the solution space and robustness against imperfect modelling and minor problems' changes. It also enables the decision-makers to involve their interests and choose betwe… ▽ More There has been a growing interest in the evolutionary computation community to compute a diverse set of high-quality solutions for a given optimisation problem. This can provide the practitioners with invaluable information about the solution space and robustness against imperfect modelling and minor problems' changes. It also enables the decision-makers to involve their interests and choose between various solutions. In this study, we investigate for the first time a prominent multi-component optimisation problem, namely the Traveling Thief Problem (TTP), in the context of evolutionary diversity optimisation. We introduce a bi-level evolutionary algorithm to maximise the structural diversity of the set of solutions. Moreover, we examine the inter-dependency among the components of the problem in terms of structural diversity and empirically determine the best method to obtain diversity. We also conduct a comprehensive experimental investigation to examine the introduced algorithm and compare the results to another recently introduced framework based on the use of Quality Diversity (QD). Our experimental results show a significant improvement of the QD approach in terms of structural diversity for most TTP benchmark instances. △ Less

Submitted 6 April, 2022; originally announced April 2022.

Comments: To appear at GECCO 2022

Dynamical large deviations for the boundary driven symmetric exclusion process with Robin boundary conditions

Authors: T. Franco, P. Gonçalves, C. Landim, A. Neumann

Abstract: In this article, we consider a one-dimensional symmetric exclusion process in weak contact with reservoirs at the boundary. In the diffusive time-scaling the empirical measure evolves according to the heat equation with Robin boundary conditions. We prove the associated dynamical large deviations principle. In this article, we consider a one-dimensional symmetric exclusion process in weak contact with reservoirs at the boundary. In the diffusive time-scaling the empirical measure evolves according to the heat equation with Robin boundary conditions. We prove the associated dynamical large deviations principle. △ Less

Submitted 27 March, 2022; originally announced March 2022.

Niching-based Evolutionary Diversity Optimization for the Traveling Salesperson Problem

Authors: Anh Viet Do, Mingyu Guo, Aneta Neumann, Frank Neumann

Abstract: In this work, we consider the problem of finding a set of tours to a traveling salesperson problem (TSP) instance maximizing diversity, while satisfying a given cost constraint. This study aims to investigate the effectiveness of applying niching to maximize diversity rather than simply maintaining it. To this end, we introduce a 2-stage approach where a simple niching memetic algorithm (NMA), der… ▽ More In this work, we consider the problem of finding a set of tours to a traveling salesperson problem (TSP) instance maximizing diversity, while satisfying a given cost constraint. This study aims to investigate the effectiveness of applying niching to maximize diversity rather than simply maintaining it. To this end, we introduce a 2-stage approach where a simple niching memetic algorithm (NMA), derived from a state-of-the-art for multi-solution TSP, is combined with a baseline diversifying algorithm. The most notable feature of the proposed NMA is the use of randomized improvement-first local search instead of 2-opt. Our experiment on TSPLIB instances shows that while the populations evolved by our NMA tend to contain clusters at tight quality constraints, they frequently occupy distant basins of attraction rather than close-by regions, improving on the baseline diversification in terms of sum-sum diversity. Compared to the original NMA, ours, despite its simplicity, finds more distant solutions of higher quality within less running time, by a large margin. △ Less

Submitted 18 April, 2022; v1 submitted 25 January, 2022; originally announced January 2022.

Comments: 14 pages

European Strategy for Particle Physics -- Accelerator R&D Roadmap

Authors: C. Adolphsen, D. Angal-Kalinin, T. Arndt, M. Arnold, R. Assmann, B. Auchmann, K. Aulenbacher, A. Ballarino, B. Baudouy, P. Baudrenghien, M. Benedikt, S. Bentvelsen, A. Blondel, A. Bogacz, F. Bossi, L. Bottura, S. Bousson, O. Brüning, R. Brinkmann, M. Bruker, O. Brunner, P. N. Burrows, G. Burt, S. Calatroni, K. Cassou , et al. (111 additional authors not shown)

Abstract: The 2020 update of the European Strategy for Particle Physics emphasised the importance of an intensified and well-coordinated programme of accelerator R&D, supporting the design and delivery of future particle accelerators in a timely, affordable and sustainable way. This report sets out a roadmap for European accelerator R&D for the next five to ten years, covering five topical areas identified… ▽ More The 2020 update of the European Strategy for Particle Physics emphasised the importance of an intensified and well-coordinated programme of accelerator R&D, supporting the design and delivery of future particle accelerators in a timely, affordable and sustainable way. This report sets out a roadmap for European accelerator R&D for the next five to ten years, covering five topical areas identified in the Strategy update. The R&D objectives include: improvement of the performance and cost-performance of magnet and radio-frequency acceleration systems; investigations of the potential of laser / plasma acceleration and energy-recovery linac techniques; and development of new concepts for muon beams and muon colliders. The goal of the roadmap is to document the collective view of the field on the next steps for the R&D programme, and to provide the evidence base to support subsequent decisions on prioritisation, resourcing and implementation. △ Less

Submitted 30 March, 2022; v1 submitted 19 January, 2022; originally announced January 2022.

Comments: 270 pages, 58 figures. Editor: N. Mounet. LDG chair: D. Newbold. Panel chairs: P. Védrine (HFM), S. Bousson (RF), R. Assmann (plasma), D. Schulte (muon), M. Klein (ERL). Panel editors: B. Baudouy (HFM), L. Bottura (HFM), S. Bousson (RF), G. Burt (RF), R. Assmann (plasma), E. Gschwendtner (plasma), R. Ischebeck (plasma), C. Rogers (muon), D. Schulte (muon), M. Klein (ERL)

Report number: CERN-2022-001

Journal ref: European Strategy for Particle Physics - Accelerator R&D Roadmap, N. Mounet (ed.), CERN Yellow Reports: Monographs, CERN-2022-001 (CERN, Geneva, 2022)

Practical Fixed-Parameter Algorithms for Defending Active Directory Style Attack Graphs

Authors: Mingyu Guo, Jialiang Li, Aneta Neumann, Frank Neumann, Hung Nguyen

Abstract: Active Directory is the default security management system for Windows domain networks. We study the shortest path edge interdiction problem for defending Active Directory style attack graphs. The problem is formulated as a Stackelberg game between one defender and one attacker. The attack graph contains one destination node and multiple entry nodes. The attacker's entry node is chosen by nature.… ▽ More Active Directory is the default security management system for Windows domain networks. We study the shortest path edge interdiction problem for defending Active Directory style attack graphs. The problem is formulated as a Stackelberg game between one defender and one attacker. The attack graph contains one destination node and multiple entry nodes. The attacker's entry node is chosen by nature. The defender chooses to block a set of edges limited by his budget. The attacker then picks the shortest unblocked attack path. The defender aims to maximize the expected shortest path length for the attacker, where the expectation is taken over entry nodes. We observe that practical Active Directory attack graphs have small maximum attack path lengths and are structurally close to trees. We first show that even if the maximum attack path length is a constant, the problem is still $W[1]$-hard with respect to the defender's budget. Having a small maximum attack path length and a small budget is not enough to design fixed-parameter algorithms. If we further assume that the number of entry nodes is small, then we derive a fixed-parameter tractable algorithm. We then propose two other fixed-parameter algorithms by exploiting the tree-like features. One is based on tree decomposition and requires a small tree width. The other assumes a small number of splitting nodes (nodes with multiple out-going edges). Finally, the last algorithm is converted into a graph convolutional neural network based heuristic, which scales to larger graphs with more splitting nodes. △ Less

Submitted 24 December, 2021; originally announced December 2021.

On the Use of Quality Diversity Algorithms for The Traveling Thief Problem

Authors: Adel Nikfarjam, Aneta Neumann, Frank Neumann

Abstract: In real-world optimisation, it is common to face several sub-problems interacting and forming the main problem. There is an inter-dependency between the sub-problems, making it impossible to solve such a problem by focusing on only one component. The traveling thief problem~(TTP) belongs to this category and is formed by the integration of the traveling salesperson problem~(TSP) and the knapsack p… ▽ More In real-world optimisation, it is common to face several sub-problems interacting and forming the main problem. There is an inter-dependency between the sub-problems, making it impossible to solve such a problem by focusing on only one component. The traveling thief problem~(TTP) belongs to this category and is formed by the integration of the traveling salesperson problem~(TSP) and the knapsack problem~(KP). In this paper, we investigate the inter-dependency of the TSP and the KP by means of quality diversity~(QD) approaches. QD algorithms provide a powerful tool not only to obtain high-quality solutions but also to illustrate the distribution of high-performing solutions in the behavioural space. We introduce a MAP-Elite based evolutionary algorithm using well-known TSP and KP search operators, taking the TSP and KP score as the behavioural descriptor. Afterwards, we conduct comprehensive experimental studies that show the usefulness of using the QD approach applied to the TTP. First, we provide insights regarding high-quality TTP solutions in the TSP/KP behavioural space. Afterwards, we show that better solutions for the TTP can be obtained by using our QD approach and it can improve the best-known solution for a number of TTP instances used for benchmarking in the literature. △ Less

Submitted 3 January, 2023; v1 submitted 16 December, 2021; originally announced December 2021.

TecCoBot: Technology-aided support for self-regulated learning

Authors: Norbert Pengel, Anne Martin, Roy Meissner, Tamar Arndt, Alexander Tobias Neumann, Peter de Lange, Heinz-Werner Wollersheim

Abstract: In addition to formal learning at universities, like in lecture halls and seminar rooms, students are regularly confronted with self-study activities. Instead of being left to their own devices, students might benefit from a proper design of such activities, including pedagogical interventions. Such designs can increase the degree of activity and the contribution of self-study activities to the ac… ▽ More In addition to formal learning at universities, like in lecture halls and seminar rooms, students are regularly confronted with self-study activities. Instead of being left to their own devices, students might benefit from a proper design of such activities, including pedagogical interventions. Such designs can increase the degree of activity and the contribution of self-study activities to the achievement of learning outcomes. Especially in times of a global pandemic, self-study activities are increasingly executed at home, where students already use technology-enhanced materials, processes, and digital platforms. Thus we pick up these building blocks and introduce TecCoBot within this paper. TecCoBot is not only a chatbot, supporting students in reading texts by offering writing assignments and providing automated feedback on these, but also implements a design for self-study activities, typically only offered to a few students as face-to-face mentoring. △ Less

Submitted 23 November, 2021; originally announced November 2021.

Comments: 8 pages, 1 figure, presented at the Workshop Intelligence Support for Mentoring Processes in Higher Education (IMHE) at ITS 2020, to be published in CEUR-WS Proceedings

Computing Diverse Sets of High Quality TSP Tours by EAX-Based Evolutionary Diversity Optimisation

Authors: Adel Nikfarjam, Jakob Bossek, Aneta Neumann, Frank Neumann

Abstract: Evolutionary algorithms based on edge assembly crossover (EAX) constitute some of the best performing incomplete solvers for the well-known traveling salesperson problem (TSP). Often, it is desirable to compute not just a single solution for a given problem, but a diverse set of high quality solutions from which a decision maker can choose one for implementation. Currently, there are only a few ap… ▽ More Evolutionary algorithms based on edge assembly crossover (EAX) constitute some of the best performing incomplete solvers for the well-known traveling salesperson problem (TSP). Often, it is desirable to compute not just a single solution for a given problem, but a diverse set of high quality solutions from which a decision maker can choose one for implementation. Currently, there are only a few approaches for computing a diverse solution set for the TSP. Furthermore, almost all of them assume that the optimal solution is known. In this paper, we introduce evolutionary diversity optimisation (EDO) approaches for the TSP that find a diverse set of tours when the optimal tour is known or unknown. We show how to adopt EAX to not only find a high-quality solution but also to maximise the diversity of the population. The resulting EAX-based EDO approach, termed EAX-EDO is capable of obtaining diverse high-quality tours when the optimal solution for the TSP is known or unknown. A comparison to existing approaches shows that they are clearly outperformed by EAX-EDO. △ Less

Submitted 11 August, 2021; v1 submitted 10 August, 2021; originally announced August 2021.

Comments: To appear at FOGA 2021

Large Deviations for the SSEP with slow boundary: the non-critical case

Authors: Tertuliano Franco, Patrícia Gonçalves, Adriana Neumann

Abstract: We prove a large deviations principle for the empirical measure of the one dimensional symmetric simple exclusion process in contact with reservoirs. The dynamics of the reservoirs is slowed down with respect to the dynamics of the system, that is, the rate at which the system exchanges particles with the boundary reservoirs is of order $n^{-θ}$, where $n$ is number of sites in the system, $θ$ is… ▽ More We prove a large deviations principle for the empirical measure of the one dimensional symmetric simple exclusion process in contact with reservoirs. The dynamics of the reservoirs is slowed down with respect to the dynamics of the system, that is, the rate at which the system exchanges particles with the boundary reservoirs is of order $n^{-θ}$, where $n$ is number of sites in the system, $θ$ is a non negative parameter, and the system is taken in the diffusive time scaling. Two regimes are studied here, the subcritical $θ\in(0,1)$ whose hydrodynamic equation is the heat equation with Dirichlet boundary conditions and the supercritical $θ\in(1,+\infty)$ whose hydrodynamic equation is the heat equation with Neumann boundary conditions. In the subcritical case $θ\in(0,1)$, the rate function that we obtain matches the rate function corresponding to the case $θ=0$ which was derived on previous works (see \cite{blm,flm}), but the challenges we faced here are much trickier. In the supercritical case $θ\in(1,+\infty)$, the rate function is equal to infinity outside the set of trajectories which preserve the total mass, meaning that, despite the discrete system exchanges particles with the reservoirs, this phenomena has super-exponentially small probability in the diffusive scaling limit. △ Less

Submitted 14 July, 2021; originally announced July 2021.

Comments: 32 pages, 1 figure

Exact Counting and Sampling of Optima for the Knapsack Problem

Authors: Jakob Bossek, Aneta Neumann, Frank Neumann

Abstract: Computing sets of high quality solutions has gained increasing interest in recent years. In this paper, we investigate how to obtain sets of optimal solutions for the classical knapsack problem. We present an algorithm to count exactly the number of optima to a zero-one knapsack problem instance. In addition, we show how to efficiently sample uniformly at random from the set of all global optima.… ▽ More Computing sets of high quality solutions has gained increasing interest in recent years. In this paper, we investigate how to obtain sets of optimal solutions for the classical knapsack problem. We present an algorithm to count exactly the number of optima to a zero-one knapsack problem instance. In addition, we show how to efficiently sample uniformly at random from the set of all global optima. In our experimental study, we investigate how the number of optima develops for classical random benchmark instances dependent on their generator parameters. We find that the number of global optima can increase exponentially for practically relevant classes of instances with correlated weights and profits which poses a justification for the considered exact counting problem. △ Less

Submitted 14 June, 2021; originally announced June 2021.

Entropy-Based Evolutionary Diversity Optimisation for the Traveling Salesperson Problem

Authors: Adel Nikfarjam, Jakob Bossek, Aneta Neumann, Frank Neumann

Abstract: Computing diverse sets of high-quality solutions has gained increasing attention among the evolutionary computation community in recent years. It allows practitioners to choose from a set of high-quality alternatives. In this paper, we employ a population diversity measure, called the high-order entropy measure, in an evolutionary algorithm to compute a diverse set of high-quality solutions for th… ▽ More Computing diverse sets of high-quality solutions has gained increasing attention among the evolutionary computation community in recent years. It allows practitioners to choose from a set of high-quality alternatives. In this paper, we employ a population diversity measure, called the high-order entropy measure, in an evolutionary algorithm to compute a diverse set of high-quality solutions for the Traveling Salesperson Problem. In contrast to previous studies, our approach allows diversifying segments of tours containing several edges based on the entropy measure. We examine the resulting evolutionary diversity optimisation approach precisely in terms of the final set of solutions and theoretical properties. Experimental results show significant improvements compared to a recently proposed edge-based diversity optimisation approach when working with a large population of solutions or long segments. △ Less

Submitted 27 April, 2021; originally announced April 2021.

Breeding Diverse Packings for the Knapsack Problem by Means of Diversity-Tailored Evolutionary Algorithms

Authors: Jakob Bossek, Aneta Neumann, Frank Neumann

Abstract: In practise, it is often desirable to provide the decision-maker with a rich set of diverse solutions of decent quality instead of just a single solution. In this paper we study evolutionary diversity optimization for the knapsack problem (KP). Our goal is to evolve a population of solutions that all have a profit of at least $(1-\varepsilon)\cdot OPT$, where OPT is the value of an optimal solutio… ▽ More In practise, it is often desirable to provide the decision-maker with a rich set of diverse solutions of decent quality instead of just a single solution. In this paper we study evolutionary diversity optimization for the knapsack problem (KP). Our goal is to evolve a population of solutions that all have a profit of at least $(1-\varepsilon)\cdot OPT$, where OPT is the value of an optimal solution. Furthermore, they should differ in structure with respect to an entropy-based diversity measure. To this end we propose a simple $(μ+1)$-EA with initial approximate solutions calculated by a well-known FPTAS for the KP. We investigate the effect of different standard mutation operators and introduce biased mutation and crossover which puts strong probability on flipping bits of low and/or high frequency within the population. An experimental study on different instances and settings shows that the proposed mutation operators in most cases perform slightly inferior in the long term, but show strong benefits if the number of function evaluations is severely limited. △ Less

Submitted 27 April, 2021; originally announced April 2021.