Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

A three-way confirmatory approach to formal concept analysis in classification

Published: 02 July 2024 Publication History
  • Get Citation Alerts
  • Abstract

    Formal concept analysis (FCA) has demonstrated its effectiveness in classification through various studies. A few types of FCA-based classifiers, such as rule-based, concept-cognitive-learning-based, and hypothesis-based models, have been introduced for different purposes and distinct contexts. Nevertheless, these diverse models share fundamental principles that underlie the construction of effective FCA-based classifiers. This study contributes to the field in at least two aspects. Firstly, we present a general framework of FCA-based classification by reviewing, reformulating, and generalizing the existing models. The framework consists of four essential steps: intent learning, intent grouping, rule induction, and rule application. Secondly, following the presented framework, we integrate Bayesian confirmation theory and propose a novel three-way confirmatory approach to FCA-based classification. The proposed approach provides a fresh lens of formulating, analyzing, and interpreting results from FCA-based classifiers. Moreover, this approach can also be used to re-interpret existing hypothesis-based models, potentially leading to new insights and advancements in the field. The integration of Bayesian confirmation theory enriches the theoretical foundation of FCA-based classifiers, fostering the exploration of promising avenues for future research and development.

    Highlights

    We review, reformulate, and generalize the existing formal-concept-analysis-based classification models.
    We present a general framework for formal-concept-analysis-based classification.
    We propose a three-way confirmatory approach to constructing effective and interpretable formal-concept-analysis-based classifiers.

    References

    [1]
    Wille R., Restructuring lattice theory: an approach based on hierarchies of concepts, in: Rival I. (Ed.), Ordered Sets, Vol. 83 of ASIC, Springer Netherlands, Dordrecht, 1982, pp. 445–470,.
    [2]
    Ganter B., Wille R., Formal Concept Analysis: Mathematical Foundations, Springer, Berlin, 1999.
    [3]
    van der Merwe D., Obiedkov S., Kourie D., AddIntent: A new incremental algorithm for constructing concept lattices, in: Peter E. (Ed.), Concept Lattices (ICFCA 2004), Vol. 2961 of LNCS, Springer, 2004, pp. 372–385,.
    [4]
    Zou L., Zhang Z., Long J., A fast incremental algorithm for constructing concept lattices, Expert Syst. Appl. 42 (2015) 4474–4481,.
    [5]
    Zhang W., Wei L., Qi J., Attribute reduction theory and approach to concept lattice, Sci. China Ser. F: Inf. Sci. 48 (2005) 713–726,.
    [6]
    Wei L., Qi J., Zhang W., Attribute reduction theory of concept lattice based on decision formal contexts, Sci. China Ser. F: Inf. Sci. 51 (2008) 910–923,.
    [7]
    Wu W., Leung Y., Mi J., Granular computing and knowledge reduction in formal contexts, IEEE Trans. Knowl. Data Eng. 21 (2009) 1461–1474,.
    [8]
    Wang Z., Shi C., Wei L., Yao Y., Tri-granularity attribute reduction of three-way concept lattices, Knowl.-Based Syst. 276 (2023),.
    [9]
    Li J., Ren Y., Mei C., Qian Y., Yang X., A comparative study of multigranulation rough sets and concept lattices via rule acquisition, Knowl.-Based Syst. 91 (2016) 152–164,.
    [10]
    Qi J., Qian T., Wei L., The connections between three-way and classical concept lattices, Knowl.-Based Syst. 91 (2016) 143–151,.
    [11]
    Wang Z., Qi J., Shi C., Ren R., Wei L., Multiview granular data analytics based on three-way concept analysis, Appl. Intell. 53 (2023) 14645–14667,.
    [12]
    Bělohlávek R., Concept lattices and order in fuzzy logic, Ann. Pure Appl. Logic 128 (2004) 277–298,.
    [13]
    Chen X., Qi J., Zhu X., Wang X., Wang Z., Unlabelled text mining methods based on two extension models of concept lattices, Int. J. Mach. Learn. Cybern. 11 (2020) 475–490,.
    [14]
    Xie J., Yang M., Li J., Zheng Z., Rule acquisition and optimal scale selection in multi-scale formal decision contexts and their applications to smart city, Future Gener. Comput. Syst. 83 (2018) 564–581,.
    [15]
    Roscoe S., Khatri M., Voshall A., Batra S., Kaur S., Deogun J., Formal concept analysis applications in bioinformatics, ACM Comput. Surv. 55 (2022) 1–40,.
    [16]
    Chen J., Zheng H., Wei L., Wan Z., Ren R., Li J., Li H., Bian W., Gao M., Bai Y., Factor diagnosis and future governance of dangerous goods accidents in China’s ports, Environ. Pollut. 257 (2020),.
    [17]
    Hanika T., Hirth J., Conceptual views on tree ensemble classifiers, Internat. J. Approx. Reason. 159 (2023),.
    [18]
    Niu J., Chen D., Li J., Wang H., A dynamic rule-based classification model via granular computing, Inform. Sci. 584 (2022) 325–341,.
    [19]
    Niu J., Chen D., Li J., Wang H., Fuzzy rule-based classification method for incremental rule learning, IEEE Trans. Fuzzy Syst. 30 (9) (2022) 3748–3761,.
    [20]
    Shi Y., Mi Y., Li J., Liu W., Concept-cognitive learning model for incremental concept learning, IEEE Trans. Syst. Man Cybern.: Syst. 51 (2021) 809–821,.
    [21]
    Mi Y., Liu W., Shi Y., Li J., Semi-supervised concept learning by concept-cognitive learning and concept space, IEEE Trans. Knowl. Data Eng. 34 (2022) 2429–2442,.
    [22]
    Mi Y., Wang Z., Liu H., Qu Y., Yu G., Shi Y., Divide and conquer: A granular concept-cognitive computing system for dynamic classification decision making, European J. Oper. Res. 308 (2023) 255–273,.
    [23]
    Ganter B., Kuznetsov S.O., Hypotheses and version spaces, in: Ganter B., de Moor A., Lex W. (Eds.), Conceptual Structures for Knowledge Creation and Communication (ICCS 2003), Vol. LNCS of 2746, Springer, Heidelberg, 2003, pp. 83–95,.
    [24]
    Ganter B., Kuznetsov S.O., Formalizing hypotheses with concepts, in: Ganter B., Mineau G.W. (Eds.), Conceptual Structures: Logical, Linguistic, and Computational Issues, Vol. 1867 of LNCS, Springer, Heidelberg, 2000, pp. 342–356,.
    [25]
    Kuznetsov S.O., Complexity of learning in concept lattices from positive and negative examples, Discrete Appl. Math. 142 (2004) 111–125,.
    [26]
    Kuznetsov S.O., Machine learning and formal concept analysis, in: Eklund P. (Ed.), Concept Lattices (ICFCA 2004), Vol. 2961 of LNCS, Springer, Heidelberg, 2004, pp. 287–312,.
    [27]
    Kuznetsov S.O., Makhazhanov N., Ushakov M., On neural network architecture based on concept lattices, in: Kryszkiewicz M., Appice A., Ślęzak D., Rybinski H., Skowron Z.W., Raś Andrzejand (Eds.), Foundations of Intelligent Systems (ISMIS 2017), vol. 10352 of LNCS, Springer International Publishing, Cham, 2017, pp. 653–663,.
    [28]
    Zhang X., Chen D., Mi J., Online rule fusion model based on formal concept analysis, Int. J. Mach. Learn. Cybern. 14 (2023) 2483–2497,.
    [29]
    Mi Y., Quan P., Shi Y., Wang Z., Concept-cognitive computing system for dynamic classification, European J. Oper. Res. 301 (2022) 287–299,.
    [30]
    Zhang C., Tsang E.C.C., Xu W., Lin Y., Yang L., Incremental concept-cognitive learning approach for concept classification oriented to weighted fuzzy concepts, Knowl.-Based Syst. 260 (2023),.
    [31]
    Li J., Mei C., Kumar C.A., Zhang X., On rule acquisition in decision formal contexts, Int. J. Mach. Learn. Cybern. 4 (2013) 721–731,.
    [32]
    Zhang X., Chen D., Mi J., Fuzzy decision rule-based online classification algorithm in fuzzy formal decision contexts, IEEE Trans. Fuzzy Syst. 31 (2023) 3263–3277,.
    [33]
    Yao Y., An outline of a theory of three-way decisions, in: Yao J., Yang Y., Słowiński R., Greco S., Li H., Mitra S., Polkowski L. (Eds.), Rough Sets and Current Trends in Computing, Vol. 7413 of LNCS, Springer, Heidelberg, 2012, pp. 1–17,.
    [34]
    Yao Y., Set-theoretic models of three-way decision, Granul. Comput. 6 (2021) 133–148,.
    [35]
    Liu D., The effectiveness of three-way classification with interpretable perspective, Inform. Sci. 567 (2021) 237–255,.
    [36]
    Festa R., Bayesian confirmation, in: Galavotti M.C., Pagnini A. (Eds.), Experience, Reality, and Scientific Explanation, vol. 61 of WONS, Springer, Dordrecht, 1999, pp. 55–87,.
    [37]
    Fitelson B., Ph.d. thesis University of Wisconsin, 2001, URL http://fitelson.org/thesis.pdf.
    [38]
    Shao M., Guo L., Wang C., Connections between two-universe rough sets and formal concepts, Int. J. Mach. Learn. Cybern. 9 (2018) 1869–1877,.
    [39]
    Wei L., Qi J., Relation between concept lattice reduction and rough set reduction, Knowl.-Based Syst. 23 (2010) 934–938,.
    [40]
    Yao Y., Three-way granular computing, rough sets, and formal concept analysis, Internat. J. Approx. Reason. 116 (2020) 106–125,.
    [41]
    Zheng A., Casari A., Feature Engineering for Machine Learning: Principles and Techniques for Data Scientists, O’Reilly Media, Inc., 2018.
    [42]
    Harris D., Harris S.L., Digital Design and Computer Architecture, second ed., Elsevier Science, 2013.
    [43]
    Suits D.B., Use of dummy cariables in regression equations, J. Amer. Statist. Assoc. 52 (1957) 548–551,.
    [44]
    Düntsch I., Gediga D., Modal-style operators in qualitative data analysis, in: Proceedings of 2002 IEEE International Conference on Data Mining, IEEE, 2002, pp. 155–162,.
    [45]
    Chen Y., Yao Y., A multiview approach for intelligent data analysis based on data operators, Inform. Sci. 178 (2008) 1–20,.
    [46]
    Buroker J., Port-Royal Logic, Stanford Encyclopedia of Philosophy, 2023, https://plato.stanford.edu/entries/port-royal-logic/ (Accessed 2023).
    [47]
    Poelmans J., Kuznetsov S.O., Ignatov D.I., Dedene G., Formal concept analysis in knowledge processing: A survey on models and techniques, Expert Syst. Appl. 40 (2013) 6601–6623,.
    [48]
    Pawlak Z., Rough Sets: Theoretical Aspects of Reasoning About Data, Kluwer Academic Publishers, 1991.
    [49]
    Yao Y., Three-way decision and granular computing, Internat. J. Approx. Reason. 103 (2018) 107–123,.
    [50]
    Yao Y., Tri-level thinking: models of three-way decision, Int. J. Mach. Learn. Cybern. 11 (2020) 947–959,.
    [51]
    Yao Y., The dao of three-way decision and three-world thinking, Internat. J. Approx. Reason. 126 (2023).
    [52]
    Carnap R., Logical Foundations of Probability, second ed., University of Chicago Press, Chicago, US, 1962.
    [53]
    Hu M., Deng X., Yao Y., An application of Bayesian confirmation theory for three-way decision, in: Mihálydeák T., Min F., Wang G., Banerjee M., Düntsch I., Suraj Z., Ciucci D. (Eds.), Rough Sets (IJCRS 2019), Vol. 11499 of LNCS, Springer, Cham, 2019, pp. 3–15,.
    [54]
    Hu M., Three-way Bayesian confirmation in classifications, Cogn. Comput. 14 (2022) 2020–2039,.
    [55]
    Hu M., Modeling relationships in three-way conflict analysis with subsethood measures, Knowl.-Based Syst. 260 (2023),.
    [56]
    Lang G., Yao Y., Formal concept analysis perspectives on three-way conflict analysis, Internat. J. Approx. Reason. 152 (2023) 160–182,.
    [57]
    Pawlak Z., An inquiry into anatomy of conflicts, Inform. Sci. 109 (1998) 65–78,.
    [58]
    Suo L., Yang H., Three-way conflict analysis based on incomplete situation tables: A tentative study, Internat. J. Approx. Reason. 145 (2022) 51–74,.
    [59]
    Hu M., Lang G., A probabilistic approach to analyzing agent relations in three-way conflict analysis based on Bayesian confirmation, in: Yao J., Fujita H., Yue X., Miao D., Grzymala-Busse J., Li F. (Eds.), Rough Sets (IJCRS 2022), Vol. 13633 of LNCS, Springer Nature Switzerland, Cham, 2022, pp. 319–333,.
    [60]
    Deng X., Yao Y., Yao J., On interpreting three-way decisions through two-way decisions, in: Andreasen T., Christiansen H., Cubero J.-C., Raś Z.W. (Eds.), Foundations of Intelligent Systems (ISMIS 2014), Vol. 8502 of LNCS, Springer International Publishing, Cham, 2014, pp. 73–82,.
    [61]
    Luo J., Hu M., A bipolar three-way decision model and its application in analyzing incomplete data, Internat. J. Approx. Reason. 152 (2023) 94–123,.
    [62]
    Luo J., Hu M., Lang G., Yang X., Qin K., Three-way conflict analysis based on alliance and conflict functions, Inform. Sci. 594 (2022) 322–359,.
    [63]
    Kaur H., Pannu H.S., Malhi A.K., A systematic review on imblanaced data challenges in machine learning: Applications and solutions, ACM Comput. Surv. 52 (2020) 1–36,.
    [64]
    López V., Fernández A., García S., Palade V., Herrera F., An insight into classification with imbalanced data: Empirical results and current trends on using data intrinsic characteristics, Inform. Sci. 250 (2013) 113–141,.
    [65]
    Sun Y., Kamel M.S., Wong A.K., Wang Y., Cost-sensitive boosting for classification of imbalanced data, Pattern Recognit. 40 (2007) 3358–3378,.
    [66]
    Sun Y., Wong A.K., Kamel M.S., Classification of imbalanced data: A review, Int. J. Pattern Recognit. Artif. Intell. 23 (2009) 687–719,.

    Cited By

    View all

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image Applied Soft Computing
    Applied Soft Computing  Volume 155, Issue C
    Apr 2024
    860 pages

    Publisher

    Elsevier Science Publishers B. V.

    Netherlands

    Publication History

    Published: 02 July 2024

    Author Tags

    1. Three-way Bayesian confirmation
    2. Formal concept analysis
    3. Three-way classification
    4. Positive intent
    5. Negative intent

    Qualifiers

    • Research-article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 0
      Total Downloads
    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 11 Aug 2024

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    View options

    Get Access

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media