Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2463372.2463500acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
research-article

Extending learning classifier system with cyclic graphs for scalability on complex, large-scale boolean problems

Published: 06 July 2013 Publication History

Abstract

Evolutionary computational techniques have had limited capabilities in solving large-scale problems, due to the large search space demanding large memory and much longer training time. Recently work has begun on automously reusing learnt building blocks of knowledge to scale from low dimensional problems to large-scale ones. An XCS-based classifier system has been shown to be scalable, through the addition of tree-like code fragments, to a limit beyond standard learning classifier systems. Self-modifying cartesian genetic programming (SMCGP) can provide general solutions to a number of problems, but the obtained solutions for large-scale problems are not easily interpretable. A limitation in both techniques is the lack of a cyclic representation, which is inherent in finite state machines. Hence this work introduces a state-machine based encoding scheme into scalable XCS, for the first time, in an attempt to develop a general scalable classifier system producing easily interpretable classifier rules. The proposed system has been tested on four different Boolean problem domains, i.e. even-parity, majority-on, carry, and multiplexer problems. The proposed approach outperformed standard XCS in three of the four problem domains. In addition, the evolved machines provide general solutions to the even-parity and carry problems that are easily interpretable as compared with the solutions obtained using SMCGP.

References

[1]
M. Ahluwalia and L. Bull. A Genetic Programming Based Classifier System. In Genetic and Evolutionary Computation Conference, pages 11--18, 1999.
[2]
J. A. Anderson. Automata Theory with Modern Applications. Cambridge University Press, 2006.
[3]
K. Benson. Evolving finite state machines with embedded genetic programming for automatic target detection. In Congress on Evolutionary Computation, pages 1543--1549, 2000.
[4]
M. V. Butz, T. Kovacs, P. L. Lanzi, and S. W. Wilson. Toward a Theory of Generalization and Learning in XCS. IEEE Transactions on Evolutionary Computation, 8(1):28--46, 2004.
[5]
M. V. Butz, P. L. Lanzi, and S. W. Wilson. Function Approximation With XCS: Hyperellipsoidal Conditions, Recursive Least Squares, and Compaction. IEEE Transactions on Evolutionary Computation, 12(3):355--376, 2008.
[6]
M. V. Butz, M. Pelikan, X. Llorà, and D. E. Goldberg. Automated Global Structure Extraction for Effective Local Building Block Processing in XCS. Evolutionary Computation, 14(3):345--380, 2006.
[7]
M. V. Butz and S. W. Wilson. An Algorithmic Description of XCS. Soft Computing, 6(3--4):144--153, 2002.
[8]
H. H. Dam, H. A. Abbass, C. Lokan, and X. Yao. Neural-based learning classifier systems. IEEE Transactions on Knowledge and Data Engineering, 20(1):26--39, 2008.
[9]
S. Harding, J. F. Miller, and W. Banzhaf. Self-Modifying Cartesian Genetic Programming. In Genetic and Evolutionary Computation Conference, pages 1021--1028, 2007.
[10]
S. Harding, J. F. Miller, and W. Banzhaf. Developments in Cartesian Genetic Programming: self-modifying CGP. Genetic Programming and Evolvable Machines, 11(3--4):397--439, 2010.
[11]
C. Ioannides and W. N. Browne. Investigating Scaling of an Abstracted LCS Utilising Ternary and S-Expression Alphabets. In Genetic and Evolutionary Computation Conference, pages 2759--2764, 2007.
[12]
M. Iqbal, W. N. Browne, and M. Zhang. Extracting and Using Building Blocks of Knowledge in Learning Classifier Systems. In Genetic and Evolutionary Computation Conference, pages 863--870, 2012.
[13]
M. Iqbal, W. N. Browne, and M. Zhang. XCSR with Computed Continuous Action. In Australasian Joint Conference on Artificial Intelligence, pages 350--361, 2012.
[14]
M. Iqbal, W. N. Browne, and M. Zhang. Evolving Optimum Populations with XCS Classifier Systems. Soft Computing, 17(3):503--518, 2013.
[15]
M. Iqbal, W. N. Browne, and M. Zhang. Reusing Building Blocks of Extracted Knowledge to Solve Complex, Large-Scale Boolean Problems. IEEE Transactions on Evolutionary Computation, 2013. under review.
[16]
M. Iqbal, M. Zhang, and W. N. Browne. Automatically Defined Functions for Learning Classifier Systems. In Genetic and Evolutionary Computation Conference (Companion), pages 375--382, 2011.
[17]
D. Jackson and A. P. Gibbons. Layered Learning in Boolean GP Problems. In European Conference on Genetic Programming, pages 148--159, 2007.
[18]
T. Kovacs. Evolving Optimal Populations with XCS Classifier Systems. Technical Report CSR-96--17 and CSRP-9617, University of Birmingham, UK, 1996.
[19]
P. L. Lanzi. XCS with Stack-Based Genetic Programming. In Congress on Evolutionary Computation, pages 1186--1191, 2003.
[20]
D. Loiacono, A. Marelli, and P. Lanzi. Support Vector Machines for Computing Action Mappings in Learning Classifier Systems. In Congress on Evolutionary Computation, pages 2141--2148, 2007.
[21]
S. M. Lucas and T. J. Reynolds. Learning finite-state transducers: Evolution versus heuristic state merging. IEEE Transactions on Evolutionary Computation, 11(3):308--325, 2007.
[22]
J. F. Miller and P. Thomson. Cartesian Genetic Programming. In European Conference on Genetic Programming, pages 121--132, 2000.
[23]
E. F. Moore. Gedanken-experiments on Sequential Machines. In Automata Studies: Annals of Mathematics Studies, pages 129--153. Princeton University Press, 1956.
[24]
W. M. Spears and D. F. Gordon-Spears. Evolution of strategies for resource protection problems. In Advances in Evolutionary Computing: Theory and Applications, pages 367--392. Springer, 2003.
[25]
S. W. Wilson. Classifier Fitness Based on Accuracy. Evolutionary Computation, 3(2):149--175, 1995.
[26]
S. W. Wilson. Classifiers that Approximate Functions. Natural Computing, 1:211--233, 2002.

Cited By

View all
  • (2023)ConCS: A Continual Classifier System for Continual Learning of Multiple Boolean ProblemsIEEE Transactions on Evolutionary Computation10.1109/TEVC.2022.321087227:4(1057-1071)Online publication date: Aug-2023
  • (2023)Lateralized Learning to Solve Complex Boolean ProblemsIEEE Transactions on Cybernetics10.1109/TCYB.2022.316611953:11(6761-6775)Online publication date: Nov-2023
  • (2021)Learning classifier systemsProceedings of the Genetic and Evolutionary Computation Conference Companion10.1145/3449726.3461414(498-527)Online publication date: 7-Jul-2021
  • Show More Cited By

Index Terms

  1. Extending learning classifier system with cyclic graphs for scalability on complex, large-scale boolean problems

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      GECCO '13: Proceedings of the 15th annual conference on Genetic and evolutionary computation
      July 2013
      1672 pages
      ISBN:9781450319638
      DOI:10.1145/2463372
      • Editor:
      • Christian Blum,
      • General Chair:
      • Enrique Alba
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 06 July 2013

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. XCS
      2. finite state machines
      3. genetic programming
      4. learning classifier systems
      5. pattern recognition
      6. scalability

      Qualifiers

      • Research-article

      Conference

      GECCO '13
      Sponsor:
      GECCO '13: Genetic and Evolutionary Computation Conference
      July 6 - 10, 2013
      Amsterdam, The Netherlands

      Acceptance Rates

      GECCO '13 Paper Acceptance Rate 204 of 570 submissions, 36%;
      Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)2
      • Downloads (Last 6 weeks)1
      Reflects downloads up to 03 Oct 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2023)ConCS: A Continual Classifier System for Continual Learning of Multiple Boolean ProblemsIEEE Transactions on Evolutionary Computation10.1109/TEVC.2022.321087227:4(1057-1071)Online publication date: Aug-2023
      • (2023)Lateralized Learning to Solve Complex Boolean ProblemsIEEE Transactions on Cybernetics10.1109/TCYB.2022.316611953:11(6761-6775)Online publication date: Nov-2023
      • (2021)Learning classifier systemsProceedings of the Genetic and Evolutionary Computation Conference Companion10.1145/3449726.3461414(498-527)Online publication date: 7-Jul-2021
      • (2021)Learning Optimality Theory for Accuracy-Based Learning Classifier SystemsIEEE Transactions on Evolutionary Computation10.1109/TEVC.2020.299431425:1(61-74)Online publication date: Feb-2021
      • (2020)Learning classifier systemsProceedings of the 2020 Genetic and Evolutionary Computation Conference Companion10.1145/3377929.3389860(561-589)Online publication date: 8-Jul-2020
      • (2019)Learning classifier systemsProceedings of the Genetic and Evolutionary Computation Conference Companion10.1145/3319619.3323393(747-769)Online publication date: 13-Jul-2019
      • (2019)A Co-evolutionary Cartesian Genetic Programming with Adaptive Knowledge Transfer2019 IEEE Congress on Evolutionary Computation (CEC)10.1109/CEC.2019.8790352(2665-2672)Online publication date: Jun-2019
      • (2019)Implications of the curse of dimensionality for supervised learning classifier systemsPattern Analysis & Applications10.1007/s10044-017-0649-022:2(519-536)Online publication date: 1-May-2019
      • (2018)Integrating anticipatory classifier systems with OpenAI gymProceedings of the Genetic and Evolutionary Computation Conference Companion10.1145/3205651.3208241(1410-1417)Online publication date: 6-Jul-2018
      • (2018)Introducing learning classifier systemsProceedings of the Genetic and Evolutionary Computation Conference Companion10.1145/3205651.3207869(619-648)Online publication date: 6-Jul-2018
      • Show More Cited By

      View Options

      Get Access

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media