Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/1388969.1389015acmconferencesArticle/Chapter ViewAbstractPublication PagesgeccoConference Proceedingsconference-collections
demonstration

A new approach for multi-label classification based on default hierarchies and organizational learning

Published: 12 July 2008 Publication History
  • Get Citation Alerts
  • Abstract

    Learning Classifier Systems (LCSs) are a class of expert systems that use a knowledge base of decision rules and a genetic algorithm (GA) [9] as a discovery mechanism. The set of decision rules allows the LCS to represent and learn control strategies, while the robust search ability of the GA allows it to search for new rules based on the performance of existing rules. LCS were first designed to solve machine learning problems, especially classification problems. Classification problems are problems where instances of a data set belong to a set of classes, and the system needs to infer, based on past experience, the correct class (or classes) of new, previously unseen, instances. However, the features of LCSs are also very useful for solving reinforcement learning problems, a class of problems where the system should learn to operate in the environment based only on performance feedback. This paper considers LCSs as an approach to classification problems, more specifically a more complex kind of classification called multi-label classification. This paper analyses the default hierarchy formation theory presented by [14] as a way of favoring the hierarchical arrangement of rules, and also the organizational learning theory [17] for adjusting the degree of individual and collective behaviors. We suggest a new method, combining both organizational learning and default hierarchy formation, for solving multi-label problems. The preliminary results with a simple multi-label problem show the potential of this method. Final discussion presents the conclusions and directions for further research.

    References

    [1]
    F. Aiolli, F. Portera, and A. Sperduti. Speeding up the solution of multilabel problems with Support Vector Machines. In Supplementary Proc. of the Joint 13th International Conference on Artificial Neural Networks and 10th International Conference on Neural Information Processing), pages 118--121, 2003.
    [2]
    J. Bacardit and J. M. Garrell. Bloat control and generalization pressure using the minimum description length principle for a pittsburgh approach learning classifier system. In Proceedings of the 6th International Workshop on Learning Classifier Systems, 2003.
    [3]
    E. Bernadó-Mansilla, X. Llorá, and I. Traus. Multiobjective Learning Classifier Systems: An Overview. Technical report, University of Illinois at Urbana Champaign, Urbana, IL, 2005.
    [4]
    P. Bonelli, A. Parodi, S. Sen, and S. W. Wilson. NEWBOOLE: A fast GBML System. In Seventh International Conference on Machine Learning, pages 153--159. Morgan Kaufmann, 1990.
    [5]
    M. Boutell, J. Luo, X. Shen, and C. Brown. Learning multi-label scene classification. Pattern Recognition, 37(9):17571771, 2004.
    [6]
    A. Chan and A. A. Freitas. A New Ant Colony Algorithm for Multi-Label Classification with Applications in Bioinformatics. In Proceedings of the Genetic and Evolutionary Computation Conference, pages 27--34, 2006.
    [7]
    R. H. Coase. The firm, the market, and the law. University of Chicago Press, Chicago, 1988.
    [8]
    J. H. Holland. Processing and Processors for schemata, contributed chapter in Associative Information Processing, EL jacks editor, 127--146, 1971.
    [9]
    J. H. Holland. Adaptation in Natural and Artificial Systems. The MIT Press, 1975.
    [10]
    J. H. Holland and J. S. Reitman. Cognitive systems based on adaptive algorithms. Pattern directed inference systems, pages 313--329, 1978.
    [11]
    A. Karalic and V. Pirnat. Significance level based multiple tree classification. Informatica, 15(5), 1991.
    [12]
    X. Llorà, K. Sastry, and D. E. Goldberg. The Compact Classifier System: Scalability Analysis and First Results. Technical report, University of Illinois at Urbana-Champaign, Urbana, IL, 2005.
    [13]
    J. Mendel and R. McLaren. Reinforcement learning control and pattern recognition systems, Adaptive, Learning and Pattern Recognition Systems: Theory and Applications, 1970.
    [14]
    R. Smith and D. Goldberg. Adaptive Default Hierarchy Formation. Applied Artificial Intelligence, 6(1):79--102, 1992.
    [15]
    G. Tsoumakas and I. Katakis. Multi-Label Classification: An Overview. International Journal of Data Warehousing and Mining, 3:1--13, 2007.
    [16]
    G. Tsoumakas and I. Katakis. Multi-Label Classification: An Overview. International Journal of Data Warehousing and Mining, 3:1--13, 2007.
    [17]
    J. R. Wilcox. Organizational learning within a learning classifier system. Master's thesis, University of Illinois at Urbana-Champaign, 1995. Illigal Report No.95003.
    [18]
    S. W. Wilson. Classifier Fitness Based on Accuracy. Evolutionary Computation, 3(2):149--175, 1995.
    [19]
    M.-L. Zhang and Z.-H. Zhou. A k-nearest neighbor based algorithm for multi-label classification. In Proceedings of the 1st IEEE International Conference on Granular Computing (GrC'05)), pages 718--721, 2005.

    Cited By

    View all
    • (2021)An effective action covering for multi-label learning classifier systemsProceedings of the Genetic and Evolutionary Computation Conference10.1145/3449639.3459372(340-348)Online publication date: 26-Jun-2021
    • (2017)Multilabel Classification with Weighted Labels Using Learning Classifier Systems2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA)10.1109/ICMLA.2017.0-147(275-280)Online publication date: Dec-2017
    • (2014)Knowledge in Memetic Algorithms for Stock ClassificationInternational Journal of Artificial Life Research10.4018/ijalr.20140101024:1(13-29)Online publication date: 1-Jan-2014
    • Show More Cited By

    Index Terms

    1. A new approach for multi-label classification based on default hierarchies and organizational learning

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      GECCO '08: Proceedings of the 10th annual conference companion on Genetic and evolutionary computation
      July 2008
      1182 pages
      ISBN:9781605581316
      DOI:10.1145/1388969
      • Conference Chair:
      • Conor Ryan,
      • Editor:
      • Maarten Keijzer
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 12 July 2008

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. LCS
      2. default hierarchies
      3. organizational sizing

      Qualifiers

      • Demonstration

      Conference

      GECCO08
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 1,669 of 4,410 submissions, 38%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)5
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 10 Aug 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2021)An effective action covering for multi-label learning classifier systemsProceedings of the Genetic and Evolutionary Computation Conference10.1145/3449639.3459372(340-348)Online publication date: 26-Jun-2021
      • (2017)Multilabel Classification with Weighted Labels Using Learning Classifier Systems2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA)10.1109/ICMLA.2017.0-147(275-280)Online publication date: Dec-2017
      • (2014)Knowledge in Memetic Algorithms for Stock ClassificationInternational Journal of Artificial Life Research10.4018/ijalr.20140101024:1(13-29)Online publication date: 1-Jan-2014
      • (2011)Voting based learning classifier system for multi-label classificationProceedings of the 13th annual conference companion on Genetic and evolutionary computation10.1145/2001858.2002019(355-360)Online publication date: 12-Jul-2011
      • (2009)A niching algorithm to learn discriminant functions with multi-label patternsProceedings of the 10th international conference on Intelligent data engineering and automated learning10.5555/1789574.1789648(570-577)Online publication date: 23-Sep-2009
      • (2009)The multi-label OCS with a genetic algorithm for rule discoveryProceedings of the 11th Annual conference on Genetic and evolutionary computation10.1145/1569901.1570078(1323-1330)Online publication date: 8-Jul-2009
      • (2009)A Niching Algorithm to Learn Discriminant Functions with Multi-Label PatternsIntelligent Data Engineering and Automated Learning - IDEAL 200910.1007/978-3-642-04394-9_69(570-577)Online publication date: 2009
      • (2009)A Tutorial on Multi-label Classification TechniquesFoundations of Computational Intelligence Volume 510.1007/978-3-642-01536-6_8(177-195)Online publication date: 2009

      View Options

      Get Access

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media