Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2908812.2908813acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
research-article

Human-inspired Scaling in Learning Classifier Systems: Case Study on the n-bit Multiplexer Problem Set

Published: 20 July 2016 Publication History

Abstract

Learning classifier systems (LCSs) originated from artificial cognitive systems research, but migrated such that LCS became powerful classification techniques. Modern LCSs can be used to extract building blocks of knowledge in order to solve more difficult problems in the same or a related domain. The past work showed that the reuse of knowledge through the adoption of code fragments, GP-like sub-trees, into the XCS learning classifier system framework could provide advances in scaling. However, unless the pattern underlying the complete domain can be described by the selected LCS representation of the problem, a limit of scaling will eventually be reached. This is due to LCSs' 'divide and conquer' approach utilizing rule-based solutions, which entails an increasing number of rules (subclauses) to describe a problem as it scales. Inspired by human problem solving abilities, the novel work in this paper seeks to reuse learned knowledge and learned functionality to scale to complex problems by transferring them from simpler problems. Progress is demonstrated on the benchmark Multiplexer (Mux) domain, albeit the developed approach is applicable to other scalable domains. The fundamental axioms necessary for learning are proposed. The methods for transfer learning in LCSs are developed. Also, learning is recast as a decomposition into a series of sub-problems. Results show that from a conventional tabula rasa, with only a vague notion of what subordinate problems might be relevant, it is possible to learn a general solution to any n-bit Mux problem for the first time. This is verified by tests on the 264, 521 and 1034 bit Mux problems.

References

[1]
I. M. Alvarez, W. N. Browne, and M. Zhang. Reusing learned functionality in XCS: code fragments with constructed functionality and constructed features. In D. V. Arnold and E. Alba, editors, GECCO '14, Vancouver, BC, Canada, July 12--16, 2014, Companion Material Proceedings, pages 969--976. ACM, 2014.
[2]
M. T. Banich and A. Belger. Interhemispheric interaction: How do the hemispheres divide and conquer a task? Cortex, 26(1):77--94, 1990.
[3]
L. Bull. A brief history of learning classifier systems: from CS-1 to XCS and its variants. Evolutionary Intelligence, 8(2--3):55--70, 2015.
[4]
M. Butz. Rule-Based Evolutionary Online Learning Systems: A Principal Approach to LCS Analysis and Design. Springer, Berlin, Germany, 2006.
[5]
J. Doucette, P. Lichodzijewski, and M. I. Heywood. Hierarchical task decomposition through symbiosis in reinforcement learning. In T. Soule and J. H. Moore, editors, GECCO '12, GECCO '12, Philadelphia, PA, USA, July 7--11, 2012, pages 97--104. ACM, 2012.
[6]
N. J. G. Falkner, R. J. Vivian, and K. E. Falkner. Computer science education: The first threshold concept. In LaTiCE, pages 39--46. IEEE Computer Society, 2013.
[7]
L. Feng, Y.-S. Ong, A.-H. Tan, and I. W. Tsang. Memes as building blocks: a case study on evolutionary optimization
[8]
transfer learning for routing problems. Memetic Computing, 7(3):159--180, 2015.
[9]
L. Festinger. A Theory of Cognitive Dissonance. Stanford University Press, Stanford, California, 1957.
[10]
J. Holland. Adaptation. In R. Rosen and F. M. Snell, editors, Progress in Theoretical Biology, volume 4, pages 263--293, New York, 1976. Academic Press.
[11]
J. H. Holland. Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence. The University of Michigan Press, Ann Arbor, 1975.
[12]
L. Huelsbergen. Finding general solutions to the parity problem by evolving machine-language representations. In Conference on Genetic Programming, pages 158--166, July 1998.
[13]
C. Ioannides and W. Browne. Investigating scaling of an abstracted LCS utilising ternary and S-expression alphabets. In J. Bacardit, E. Bernadó-Mansilla, M. Butz, T. Kovacs, X. Llorà, and K. Takadama, editors, Learning Classifier Systems. 10th and 11th International Workshops (2006--2007), volume 4998/2008 of Lecture Notes in Computer Science, pages 46--56. Springer, 2008.
[14]
M. Iqbal, W. N. Browne, and M. Zhang. XCSR with computed continuous action. Proceedings of the Australasian Joint Conference on Artificial Intelligence, pages 350--361, 2012.
[15]
M. Iqbal, W. N. Browne, and M. Zhang. Extending learning classifier system with cyclic graphs for scalability on complex, large-scale boolean problems. Proceedings of GECCO '13, pages 1045--1052, 2013.
[16]
M. Iqbal, W. N. Browne, and M. Zhang. Learning overlapping natured and niche imbalance boolean problems using XCS classifier systems. Proceedings of the IEEE Congress on Evolutionary Computation, pages 1818--1825, 2013.
[17]
M. Iqbal, W. N. Browne, and M. Zhang. Reusing building blocks of extracted knowledge to solve complex, large-scale boolean problems. IEEE Transactions on Evolutionary Computation, 2013.
[18]
M. Keijzer, C. Ryan, and M. Cattolico. Run transferable libraries - learning functional bias in problem domains. In K. Deb, R. Poli, W. Banzhaf, H.-G. Beyer, E. K. Burke, P. J. Darwen, D. Dasgupta, D. Floreano, J. A. Foster, M. Harman, O. Holland, P. L. Lanzi, L. Spector, A. Tettamanzi, D. Thierens, and A. M. Tyrrell, editors, GECCO 2004, GECCO, Seattle, WA, USA, June 26--30, 2004, Proceedings, Part II, volume 3103 of Lecture Notes in Computer Science, pages 531--542. Springer, 2004.
[19]
J. R. Koza. A hierarchical approach to learning the boolean multiplexer function. In G. J. E. Rawlins, editor, Foundations of Genetic Algorithms, pages 171--192, San Mateo, 1991. Morgan Kaufmann.
[20]
P. Lanzi and A. Perrucci. Extending the representation of classifier conditions part ii : From messy coding to s-expressions. Proceedings of the Genetic and Evolutionary Computation Conference (GECCO-1999), 1:345--352, July 1999.
[21]
P. L. Lanzi and R. L. Riolo. A roadmap to the last decade of learning classifier system research (from 1989 to 1999). In P. L. Lanzi, W. Stolzmann, and S. W. Wilson, editors, Learning Classifier Systems. From Foundations to Applications, volume 1813 of LNAI, pages 33--62, Berlin, 2000. Springer-Verlag.
[22]
A. E. Lawson. The developmental learning paradigm. Journal of Research in Science Teaching, 16(6):501--515, 1979.
[23]
J. H. Meyer and R. Land. Overcoming barriers to student understanding: Threshold concepts and troublesome knowledge. Routledge, New York, NY, 2006.
[24]
S. J. Pan and Q. Yang. A survey on transfer learning. IEEE Trans. Knowl. Data Eng, 22(10):1345--1359, 2010.
[25]
C. J. Price and K. J. Friston. Functional ontologies for cognition: The systematic definition of structure and function. Cognitive Neuropsychology, 22(3--4):262--275, 2007.
[26]
J. D. Schaffer. Learning multiclass pattern discrimination. In J. J. Grefenstette, editor, Proceedings of the 1st International Conference on Genetic Algorithms and their Applications (ICGA85), pages 74--79. Lawrence Erlbaum Associates: Pittsburgh, PA, July 1985.
[27]
P. Stone and M. Veloso. Layered learning. In R. L. de Mántaras and E. Plaza, editors, ECML, volume 1810 of Lecture Notes in Computer Science, pages 369--381. Springer, 2000.
[28]
R. J. Urbanowicz, A. Granizo-Mackenzie, and J. H. Moore. Instance-linked attribute tracking and feedback for michigan-style supervised learning classifier systems. In T. Soule and J. H. Moore, editors, Genetic and Evolutionary Computation Conference, GECCO '12, Philadelphia, PA, USA, July 7--11, 2012, pages 927--934. ACM, 2012.
[29]
S. W. Wilson. Classifier fitness based on accuracy. Evolutionary Computation, 3(2):149--175, 1995.

Cited By

View all
  • (2024)A Learning Classifier System Approach to Time-Critical Decision-Making in Dynamic Alternate Airport Selection2024 IEEE Congress on Evolutionary Computation (CEC)10.1109/CEC60901.2024.10612016(1-8)Online publication date: 30-Jun-2024
  • (2023)ConCS: A Continual Classifier System for Continual Learning of Multiple Boolean ProblemsIEEE Transactions on Evolutionary Computation10.1109/TEVC.2022.321087227:4(1057-1071)Online publication date: Aug-2023
  • (2023)Lateralized Learning to Solve Complex Boolean ProblemsIEEE Transactions on Cybernetics10.1109/TCYB.2022.316611953:11(6761-6775)Online publication date: Nov-2023
  • Show More Cited By

Index Terms

  1. Human-inspired Scaling in Learning Classifier Systems: Case Study on the n-bit Multiplexer Problem Set

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    GECCO '16: Proceedings of the Genetic and Evolutionary Computation Conference 2016
    July 2016
    1196 pages
    ISBN:9781450342063
    DOI:10.1145/2908812
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 20 July 2016

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. XCS
    2. genetic programming
    3. learning classifier systems
    4. scalability
    5. transfer learning

    Qualifiers

    • Research-article

    Conference

    GECCO '16
    Sponsor:
    GECCO '16: Genetic and Evolutionary Computation Conference
    July 20 - 24, 2016
    Colorado, Denver, USA

    Acceptance Rates

    GECCO '16 Paper Acceptance Rate 137 of 381 submissions, 36%;
    Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)10
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 30 Aug 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)A Learning Classifier System Approach to Time-Critical Decision-Making in Dynamic Alternate Airport Selection2024 IEEE Congress on Evolutionary Computation (CEC)10.1109/CEC60901.2024.10612016(1-8)Online publication date: 30-Jun-2024
    • (2023)ConCS: A Continual Classifier System for Continual Learning of Multiple Boolean ProblemsIEEE Transactions on Evolutionary Computation10.1109/TEVC.2022.321087227:4(1057-1071)Online publication date: Aug-2023
    • (2023)Lateralized Learning to Solve Complex Boolean ProblemsIEEE Transactions on Cybernetics10.1109/TCYB.2022.316611953:11(6761-6775)Online publication date: Nov-2023
    • (2022)Frames-of-Reference-Based Learning: Overcoming Perceptual Aliasing in Multistep Decision-Making TasksIEEE Transactions on Evolutionary Computation10.1109/TEVC.2021.310224126:1(174-187)Online publication date: Feb-2022
    • (2022)An Initial Investigation of Data-Lean Transfer Evolutionary Optimization with Probabilistic Priors2022 IEEE Congress on Evolutionary Computation (CEC)10.1109/CEC55065.2022.9870407(1-9)Online publication date: 18-Jul-2022
    • (2022)Theoretical Analysis of Accuracy-Based Fitness on Learning Classifier SystemsIEEE Access10.1109/ACCESS.2022.318361810(64862-64872)Online publication date: 2022
    • (2021)Learning Optimality Theory for Accuracy-Based Learning Classifier SystemsIEEE Transactions on Evolutionary Computation10.1109/TEVC.2020.299431425:1(61-74)Online publication date: Feb-2021
    • (2021)Constructing Complexity-efficient Features in XCS with Tree-based Rule Conditions2021 IEEE Congress on Evolutionary Computation (CEC)10.1109/CEC45853.2021.9504784(296-303)Online publication date: 28-Jun-2021
    • (2020)Relatedness measures to aid the transfer of building blocks among multiple tasksProceedings of the 2020 Genetic and Evolutionary Computation Conference10.1145/3377930.3390169(377-385)Online publication date: 25-Jun-2020
    • (2020)Learning classifier systemsProceedings of the 2020 Genetic and Evolutionary Computation Conference Companion10.1145/3377929.3398101(1807-1815)Online publication date: 8-Jul-2020
    • Show More Cited By

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media