Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3546932.3546991acmconferencesArticle/Chapter ViewAbstractPublication PagessplcConference Proceedingsconference-collections
research-article
Open access

Adaptive behavioral model learning for software product lines

Published: 12 September 2022 Publication History

Abstract

Behavioral models enable the analysis of the functionality of software product lines (SPL), e.g., model checking and model-based testing. Model learning aims to construct behavioral models. Due to the commonalities among the products of an SPL, it is possible to reuse the previously-learned models during the model learning process. In this paper, an adaptive approach, called PL*, for learning the product models of an SPL is presented based on the well-known L* algorithm. In this method, after learning each product, the sequences in the final observation table are stored in a repository which is used to initialize the observation table of the remaining products. The proposed algorithm is evaluated on two open-source SPLs and the learning cost is measured in terms of the number of rounds, resets, and input symbols. The results show that for complex SPLs, the total learning cost of PL* is significantly lower than that of the non-adaptive method in terms of all three metrics. Furthermore, it is observed that the order of learning products affects the efficiency of PL*. We introduce a heuristic to determine an ordering which reduces the total cost of adaptive learning.

References

[1]
Ra'Fat Al-Msie'deen, Marianne Huchard, Abdelhak Seriai, Christelle Urtado, and Sylvain Vauttier. 2014. Reverse Engineering Feature Models from Software Configurations using Formal Concept Analysis. In Proceedings of the Eleventh International Conference on Concept Lattices and Their Applications, Košice, Slovakia, October 7--10, 2014 (CEUR Workshop Proceedings, Vol. 1252), Karell Bertet and Sebastian Rudolph (Eds.). CEUR-WS.org, 95--106. http://ceur-ws.org/Vol-1252/cla2014_submission_13.pdf
[2]
Dana Angluin. 1987. Learning Regular Sets from Queries and Counterexamples. Inf. Comput. 75, 2 (1987), 87--106.
[3]
Sven Apel, Don Batory, Christian Kästner, and Gunter Saake. 2013. A Development Process for Feature-Oriented Product Lines. In Feature-Oriented Software Product Lines: Concepts and Implementation. Springer, Berlin, Heidelberg, 17--44.
[4]
David Benavides, Sergio Segura, and Antonio Ruiz-Cortés. 2010. Automated analysis of feature models 20 years later: A literature review. Information Systems 35, 6 (2010), 615--636.
[5]
Sagar Chaki, Edmund Clarke, Natasha Sharygina, and Nishant Sinha. 2008. Verification of evolving software via component substitutability analysis. Formal Methods in System Design 32, 3 (01 Jun 2008), 235--266.
[6]
Vasek Chvátal. 1979. A Greedy Heuristic for the Set-Covering Problem. Math. Oper. Res. 4, 3 (1979), 233--235.
[7]
Andreas Classen. 2010. Modelling with FTS: a Collection od Illustrative Examples, Technical Report, University of Namur. (2010).
[8]
Andreas Classen et al. 2011. Modelling and model checking variability-intensive systems. Ph. D. dissertation (2011).
[9]
Paul Clements and Linda M. Northrop. 2002. Software product lines - practices and patterns. Addison-Wesley.
[10]
Carlos Diego Nascimento Damasceno, Mohammad Reza Mousavi, and Adenilso da Silva Simão. 2019. Learning from difference: an automated approach for learning family models from software product lines. In Proceedings of the 23rd International Systems and Software Product Line Conference, SPLC 2019, Volume A, Paris, France, September 9--13, 2019, Thorsten Berger, Philippe Collet, Laurence Duchien, Thomas Fogdal, Patrick Heymans, Timo Kehrer, Jabier Martinez, Raúl Mazo, Leticia Montalvillo, Camille Salinesi, Xhevahire Tërnava, Thomas Thüm, and Tewfik Ziadi (Eds.). ACM, 10:1--10:12.
[11]
Carlos Diego Nascimento Damasceno, Mohammad Reza Mousavi, and Adenilso da Silva Simão. 2019. Learning to Reuse: Adaptive Model Learning for Evolving Systems. In Integrated Formal Methods - 15th International Conference, IFM 2019, Bergen, Norway, December 2--6, 2019, Proceedings (Lecture Notes in Computer Science, Vol. 11918), Wolfgang Ahrendt and Silvia Lizeth Tapia Tarifa (Eds.). Springer, 138--156.
[12]
Carlos Diego Nascimento Damasceno, Mohammad Reza Mousavi, and Adenilso da Silva Simão. 2021. Learning by sampling: learning behavioral family models from software product lines. Empir. Softw. Eng. 26, 1 (2021), 4.
[13]
Sophie Fortz. 2021. LIFTS: Learning Featured Transition Systems. Association for Computing Machinery, New York, NY, USA, 1--6.
[14]
Vanderson H. Fragal, Adenilso Simão, and Mohammad Reza Mousavi. 2016. Validated Test Models for Software Product Lines: Featured Finite State Machines. In Formal Aspects of Component Software - 13th International Conference, FACS 2016, Besançon, France, October 19--21, 2016, Revised Selected Papers (Lecture Notes in Computer Science, Vol. 10231), Olga Kouchnarenko and Ramtin Khosravi (Eds.). 210--227.
[15]
Matthias Galster, Danny Weyns, Dan Tofan, Bartosz Michalik, and Paris Avgeriou. 2014. Variability in Software Systems - A Systematic Literature Review. IEEE Trans. Software Eng. 40, 3 (2014), 282--306.
[16]
Arthur Gill et al. 1962. Introduction to the theory of finite-state machines. (1962).
[17]
Alex Groce, Doron Peled, and Mihalis Yannakakis. 2002. Adaptive Model Checking. In Proceedings of the 8th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS '02). Springer-Verlag, Berlin, Heidelberg, 357--370.
[18]
Roland Groz, Adenilso da Silva Simão, Alexandre Petrenko, and Catherine Oriat. 2015. Inferring Finite State Machines Without Reset Using State Identification Sequences. In Testing Software and Systems - 27th IFIP WG 6.1 International Conference, ICTSS 2015, Sharjah and Dubai, United Arab Emirates, November 23--25, 2015, Proceedings (Lecture Notes in Computer Science, Vol. 9447), Khaled El-Fakih, Gerassimos D. Barlas, and Nina Yevtushenko (Eds.). Springer, 161--177.
[19]
Roland Groz, Adenilso da Silva Simão, Alexandre Petrenko, and Catherine Oriat. 2018. Inferring FSM Models of Systems Without Reset. In Machine Learning for Dynamic Software Analysis: Potentials and Limits - International Dagstuhl Seminar 16172, Dagstuhl Castle, Germany, April 24--27, 2016, Revised Papers (Lecture Notes in Computer Science, Vol. 11026), Amel Bennaceur, Reiner Hähnle, and Karl Meinke (Eds.). Springer, 178--201.
[20]
Evelyn Nicole Haslinger, Roberto E. Lopez-Herrejon, and Alexander Egyed. 2011. Reverse Engineering Feature Models from Programs' Feature Sets. In 2011 18th Working Conference on Reverse Engineering. IEEE, 308--312.
[21]
David Huistra, Jeroen Meijer, and Jaco van de Pol. 2018. Adaptive Learning for Learn-Based Regression Testing. In Formal Methods for Industrial Critical Systems (Lecture Notes in Computer Science), Falk Howar and Jiri Barnat (Eds.). Springer, Switzerland, 162--177.
[22]
J. D. Hunter. 2007. Matplotlib: A 2D graphics environment. Computing in Science & Engineering 9, 3 (2007), 90--95.
[23]
Muhammad-Naeem Irfan, Catherine Oriat, and Roland Groz. 2013. Model Inference and Testing. Adv. Comput. 89 (2013), 89--139.
[24]
Martin Fagereng Johansen, Øystein Haugen, and Franck Fleurey. 2011. Properties of Realistic Feature Models Make Combinatorial Testing of Product Lines Feasible. In Model Driven Engineering Languages and Systems, 14th International Conference, MODELS 2011, Wellington, New Zealand, October 16--21, 2011. Proceedings (Lecture Notes in Computer Science, Vol. 6981), Jon Whittle, Tony Clark, and Thomas Kühne (Eds.). Springer, 638--652.
[25]
Eric Jones, Travis Oliphant, Pearu Peterson, et al. 2001--. SciPy: Open source scientific tools for Python. http://www.scipy.org/
[26]
Kyo C Kang, Sholom G Cohen, James A Hess, William E Novak, and A Spencer Peterson. 1990. Feature-oriented domain analysis (FODA) feasibility study. Technical Report. Carnegie-Mellon Univ Pittsburgh Pa Software Engineering Inst.
[27]
Daniel Le Berre and Anne Parrain. 2010. The SAT4J library, Release 2.2, System Description. Journal on Satisfiability, Boolean Modeling and Computation 7 (2010), 59--64. http://satassociation.org/jsat/index.php/jsat/article/view/82
[28]
Luc Lesoil, Mathieu Acher, Arnaud Blouin, and Jean-Marc Jézéquel. 2021. Deep Software Variability: Towards Handling Cross-Layer Configuration. In 15th International Working Conference on Variability Modelling of Software-Intensive Systems (Krems, Austria) (VaMoS'21). Association for Computing Machinery, New York, NY, USA, Article 10, 8 pages.
[29]
Sascha Lity, Remo Lachmann, Malte Lochau, and Ina Schaefer. 2012. Delta-oriented software product line test models-the body comfort system case study. Technical Report 2012-07. TU Braunschweig.
[30]
Sebastian Oster. 2012. Feature Model-based Software Product Line Testing. Ph.D. Dissertation. Technische Universität. [Online] http://tuprints.ulb.tu-darmstadt.de/2881/.
[31]
Juliana Alves Pereira, Mathieu Acher, Hugo Martin, Jean-Marc Jézéquel, Goetz Botterweck, and Anthony Ventresque. 2021. Learning software configuration spaces: A systematic literature review. Journal of Systems and Software 182 (2021), 111044.
[32]
Gilles Perrouin, Sagar Sen, Jacques Klein, Benoit Baudry, and Yves Le Traon. 2010. Automated and Scalable T-wise Test Case Generation Strategies for Software Product Lines. In Third International Conference on Software Testing, Verification and Validation, ICST 2010, Paris, France, April 7--9, 2010. IEEE Computer Society, 459--468.
[33]
Harald Raffelt and Bernhard Steffen. 2006. LearnLib: A Library for Automata Learning and Experimentation. In Fundamental Approaches to Software Engineering, 9th International Conference, FASE 2006, Held as Part of the Joint European Conferences on Theory and Practice of Software, ETAPS 2006, Vienna, Austria, March 27--28, 2006, Proceedings (Lecture Notes in Computer Science, Vol. 3922), Luciano Baresi and Reiko Heckel (Eds.). Springer, 377--380.
[34]
Uwe Ryssel, Joern Ploennigs, and Klaus Kabitzsch. 2011. Extraction of Feature Models from Formal Contexts. In Proceedings of the 15th International Software Product Line Conference, Volume 2 (Munich, Germany) (SPLC '11). ACM, New York, NY, USA, 1--8.
[35]
Pierre-Yves Schobbens, Patrick Heymans, and Jean-Christophe Trigaux. 2006. Feature Diagrams: A Survey and a Formal Semantics. In 14th IEEE International Conference on Requirements Engineering (RE 2006), 11--15 September 2006, Minneapolis/St.Paul, Minnesota, USA. IEEE Computer Society, 136--145.
[36]
Muzammil Shahbaz and Roland Groz. 2009. Inferring Mealy Machines. In FM 2009: Formal Methods, Second World Congress, Eindhoven, The Netherlands, November 2--6, 2009. Proceedings (Lecture Notes in Computer Science, Vol. 5850), Ana Cavalcanti and Dennis Dams (Eds.). Springer, 207--222.
[37]
Joshua Sprey, Chico Sundermann, Sebastian Krieter, Michael Nieke, Jacopo Mauro, Thomas Thüm, and Ina Schaefer. 2020. SMT-based variability analyses in FeatureIDE. In Proceedings of the 14th International Working Conference on Variability Modelling of Software-Intensive Systems (VAMOS '20). Association for Computing Machinery, New York, NY, USA, 1--9.
[38]
Paul Temple, Gilles Perrouin, Mathieu Acher, Battista Biggio, Jean-Marc Jézéquel, and Fabio Roli. 2021. Empirical assessment of generating adversarial configurations for software product lines. Empir. Softw. Eng. 26, 1 (2021), 6.
[39]
Thomas Thüm, Sven Apel, Christian Kästner, Ina Schaefer, and Gunter Saake. 2014. A Classification and Survey of Analysis Strategies for Software Product Lines. ACM Comput. Surv. 47, 1 (2014), 6:1--6:45.
[40]
Thomas Thüm, Christian Kästner, Fabian Benduhn, Jens Meinicke, Gunter Saake, and Thomas Leich. 2014. FeatureIDE: An extensible framework for feature-oriented software development. Sci. Comput. Program. 79 (2014), 70--85.
[41]
Frits W. Vaandrager. 2017. Model learning. Commun. ACM 60, 2 (2017), 86--95.
[42]
Frank van der Linden, Klaus Schmid, and Eelco Rommes. 2007. Software product lines in action - the best industrial practice in product line engineering. Springer.
[43]
Jilles van Gurp, Jan Bosch, and Mikael Svahnberg. 2001. On the Notion of Variability in Software Product Lines. In 2001 Working IEEE / IFIP Conference on Software Architecture (WICSA 2001), 28--31 August 2001, Amsterdam, The Netherlands. IEEE Computer Society, 45--54.
[44]
Mahsa Varshosaz, Mustafa Al-Hajjaji, Thomas Thüm, Tobias Runge, Mohammad Reza Mousavi, and Ina Schaefer. 2018. A classification of product sampling for software product lines. In Proceeedings of the 22nd International Systems and Software Product Line Conference - Volume 1, SPLC 2018, Gothenburg, Sweden, September 10--14, 2018, Thorsten Berger, Paulo Borba, Goetz Botterweck, Tomi Männistö, David Benavides, Sarah Nadi, Timo Kehrer, Rick Rabiser, Christoph Elsner, and Mukelabai Mukelabai (Eds.). ACM, 1--13.
[45]
Stephan Windmüller, Johannes Neubauer, Bernhard Steffen, Falk Howar, and Oliver Bauer. 2013. Active Continuous Quality Control. In Proceedings of the 16th International ACM Sigsoft Symposium on Component-based Software Engineering (Vancouver, British Columbia, Canada) (CBSE '13). ACM, New York, NY, USA, 111--120.
[46]
Nan Yang, K. Aslam, R.R.H. Schiffelers, Leonard Lensink, D. Hendriks, L.G.W.A. Cleophas, and A. Serebrenik. 2019. Improving model inference in industry by combining active and passive learning. In 26th IEEE International Conference on Software Analysis, Evolution, and Reengineering (SANER 2019). Institute of Electrical and Electronics Engineers (IEEE), United States, 253--263.

Cited By

View all
  • (2024)Efficient construction of family-based behavioral models from adaptively learned modelsSoftware and Systems Modeling10.1007/s10270-024-01199-5Online publication date: 7-Aug-2024
  • (2022)Family-Based Fingerprint Analysis: A Position PaperA Journey from Process Algebra via Timed Automata to Model Learning10.1007/978-3-031-15629-8_8(137-150)Online publication date: 7-Sep-2022

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SPLC '22: Proceedings of the 26th ACM International Systems and Software Product Line Conference - Volume A
September 2022
266 pages
ISBN:9781450394437
DOI:10.1145/3546932
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 September 2022

Permissions

Request permissions for this article.

Check for updates

Badges

Author Tags

  1. adaptive model learning
  2. automata learning
  3. finite state machines
  4. software product lines

Qualifiers

  • Research-article

Funding Sources

  • The work of Mohammad Reza Mousavi was partially supported by the UKRI Trustworthy Autonomous Systems Node in Verifiability

Conference

SPLC '22
Sponsor:

Acceptance Rates

SPLC '22 Paper Acceptance Rate 14 of 41 submissions, 34%;
Overall Acceptance Rate 167 of 463 submissions, 36%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)136
  • Downloads (Last 6 weeks)18
Reflects downloads up to 25 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Efficient construction of family-based behavioral models from adaptively learned modelsSoftware and Systems Modeling10.1007/s10270-024-01199-5Online publication date: 7-Aug-2024
  • (2022)Family-Based Fingerprint Analysis: A Position PaperA Journey from Process Algebra via Timed Automata to Model Learning10.1007/978-3-031-15629-8_8(137-150)Online publication date: 7-Sep-2022

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media