Multi-objective genetic programming for symbolic regression with the adaptive weighted splines representation
Pages 165 - 166
Abstract
Genetic Programming (GP) for symbolic regression often generates over-complex models, which overfit the training data and have poor generalization onto unseen data. One recent work investigated controlling model complexity by using a new GP representation called Adaptive Weighted Splines (AWS), which is a semi-structured representation that can control the model complexity explicitly. This work extends this previous work by incorporating a new parsimony pressure objective to further control the model complexity. Experimental results demonstrate that the new multi-objective GP method consistently obtains superior fronts and produces better generalizing models compared to single-objective GP with both the tree-based and AWS representation as well a multi-objective tree-based GP method with parsimony pressure.
References
[1]
Harith Al-Sahaf, Ying Bi, Qi Chen, Andrew Lensen, Yi Mei, Yanan Sun, Binh Tran, Bing Xue, and Mengjie Zhang. 2019. A survey on evolutionary machine learning. Journal of the Royal Society of New Zealand 49, 2 (2019), 205--228.
[2]
Qi Chen, Bing Xue, and Mengjie Zhang. 2020. Improving symbolic regression based on correlation between residuals and variables. In Proceedings of the 2020 Genetic and Evolutionary Computation Conference. 922--930.
[3]
Carlos M Fonseca, Luís Paquete, and Manuel López-Ibánez. 2006. An improved dimension-sweep algorithm for the hypervolume indicator. In 2006 IEEE international conference on evolutionary computation. IEEE, 1157--1163.
[4]
John R Koza and John R Koza. 1992. Genetic programming: on the programming of computers by means of natural selection. Vol. 1. MIT press.
[5]
Sean Luke and Liviu Panait. 2002. Fighting Bloat with Nonparametric Parsimony Pressure. In International Conference on Parallel Problem Solving from Nature. Springer, 411--421.
[6]
Christian Raymond, Qi Chen, Bing Xue, and Mengjie Zhang. 2019. Genetic Programming with Rademacher Complexity for Symbolic Regression. In 2019 IEEE Congress on Evolutionary Computation (CEC). IEEE, 2657--2664.
[7]
Christian Raymond, Qi Chen, Bing Xue, and Mengjie Zhang. 2020. Adaptive weighted splines: a new representation to genetic programming for symbolic regression. In Proceedings of the 2020 Genetic and Evolutionary Computation Conference. 1003--1011.
[8]
Bing Xue, Mengjie Zhang, Will N Browne, and Xin Yao. 2015. A survey on evolutionary computation approaches to feature selection. IEEE Transactions on Evolutionary Computation 20, 4 (2015), 606--626.
Recommendations
A Comparison of three evolutionary strategies for multiobjective genetic programming
We report what we believe to be the first comparative study of multi-objective genetic programming (GP) algorithms on benchmark symbolic regression and machine learning problems. We compare the Strength Pareto Evolutionary Algorithm (SPEA2), the Non-...
Multi-objective Genetic Programming with the Adaptive Weighted Splines Representation for Symbolic Regression
Genetic ProgrammingAbstractGenetic Programming (GP) based symbolic regression is prone to generating complex models which often overfit the training data and generalise poorly onto unseen data. To address this issue, many pieces of research have been devoted to controlling ...
Multi-Objective Memetic Algorithms with Tree-Based Genetic Programming and Local Search for Symbolic Regression
AbstractSymbolic regression is to search the space of mathematical expressions to find a model that best fits a given dataset. As genetic programming (GP) with the tree representation can represent solutions as expression trees, it is popularly-used for ...
Comments
Information & Contributors
Information
Published In
July 2021
2047 pages
Copyright © 2021 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 08 July 2021
Check for updates
Author Tags
Qualifiers
- Poster
Conference
GECCO '21
Sponsor:
Acceptance Rates
Overall Acceptance Rate 1,669 of 4,410 submissions, 38%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 95Total Downloads
- Downloads (Last 12 months)13
- Downloads (Last 6 weeks)2
Reflects downloads up to 09 Nov 2024
Other Metrics
Citations
Cited By
View allView Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in