research-article

Testing Tools for Configurable Software Systems: A Review-based Empirical Study

Authors:

Fischer Ferreira,

João P. Diniz,

Eduardo FigueiredoAuthors Info & Claims

VaMoS '19: Proceedings of the 13th International Workshop on Variability Modelling of Software-Intensive Systems

Article No.: 6, Pages 1 - 10

https://doi.org/10.1145/3302333.3302344

Published: 06 February 2019 Publication History

Abstract

Configurable software systems are software systems that can be adapted or configured according to a set of features with the goal of increasing reuse and productivity. However, testing configurable systems is very challenging due to the number of configurations to run with each test, leading to a combinatorial explosion in the number of configurations and tests. Currently, several testing techniques and tools have been proposed to deal with this challenge, but their potential practical application remains mostly unexplored. The lack of studies to explore the tools that apply those techniques motivated us to investigate the literature to find testing tools for configurable software systems and to understand how they work. In this paper, we conducted a systematic mapping and identified 34 testing tools for configurable software systems. We first summarized and discussed their main characteristics. We then designed and performed a comparative empirical study of the main sound testing tools found: VarexJ and SPLat. They are considered sound testing techniques because they explore all reachable configurations from a given test. Overall, we observed that VarexJ and SPLat presented distinct results for efficiency while testing the target systems and that, although VarexJ found more errors than SPLat for the majority of the target systems, such result deserves a more in-depth investigation because we expected a higher intersection of errors encountered by them.

References

[1]

{n. d.}. CASA Tool. ({n. d.}). http://cse.unl.edu/~citportal/citportal/loadTool?page=casa&id=1, Accessed 15-nov-2018.

[2]

{n. d.}. cpatiger Tool. ({n. d.}). http://forsyte.at/software/cpatiger/, Accessed 15-nov-2018.

[3]

{n. d.}. featureide Tool. ({n. d.}). https://featureide.github.io/, Accessed 15-nov- 2018.

[4]

{n. d.}. Firefox web browser. ({n. d.}). http://hg.mozilla.org, Accessed 22-Oct-2018.

[5]

{n. d.}. Guidsl Tool. ({n. d.}). https://www.cs.utexas.edu/~schwartz/ATS/fopdocs/guidsl.html, Accessed 22-Oct-2018.

[6]

{n. d.}. Henard Tool. ({n. d.}). http://research.henard.net/SPL/SSBSE_2014/, Accessed 15-nov-2018.

[7]

{n. d.}. ICPL Tool. ({n. d.}). https://martinfjohansen.com/splc2012/, Accessed 15-nov-2018.

[8]

{n. d.}. IncLing Tool. ({n. d.}). http://www.tinyurl.com/IncrementalSampling, Accessed 15-nov-2018.

[9]

{n. d.}. Linux kernel. ({n. d.}). http://www.kernel.org, Accessed 22-Oct-2018.

[10]

{n. d.}. MPLM Tool. ({n. d.}). http://people.irisa.fr/Hamza.Samih/mplm, Accessed 15-nov-2018.

[11]

{n. d.}. Pacogen Tool. ({n. d.}). http://www.irisa.fr/lande/gotlieb/resources/Pacogen/Pacogen.html, Accessed 15-nov-2018.

[12]

{n. d.}. ParTeg Tool. ({n. d.}). http://parteg.sourceforge.net, Accessed 15-nov-2018.

[13]

{n. d.}. PLEDGE Tool. ({n. d.}). https://github.com/christopherhenard/pledge, Accessed 15-nov-2018.

[14]

{n. d.}. REFRACT Tool. ({n. d.}). http://cse.unl.edu/~myra/artifacts/Refract_2014/, Accessed 15-nov-2018.

[15]

{n. d.}. S-SPLAT Tool. ({n. d.}). https://github.com/sabrinadfs/splat-sampling, Accessed 15-nov-2018.

[16]

{n. d.}. SPLAT Tool. ({n. d.}). https://github.com/sabrinadfs/splat-sampling, Accessed 15-nov-2018.

[17]

{n. d.}. SPLtool Tool. ({n. d.}). http://martinfjohansen.com/models2011/spltool/, Accessed 15-nov-2018.

[18]

{n. d.}. SPLVerifier Tool. ({n. d.}). http://fosd.net/FAV, Accessed 15-nov-2018.

[19]

{n. d.}. TEMSA Tool. ({n. d.}). http://zen-tools.com/TEMSA/, Accessed 15-nov-2018.

[20]

{n. d.}. TESALIA Tool. ({n. d.}). http://tesalia.github.io, Accessed 15-nov-2018.

[21]

{n. d.}. VarexJ Tool. ({n. d.}). http://meinicke.github.io/VarexJ/, Accessed 15-nov-2018.

[22]

M. Krieter S. Thüm T. Lochau M. Saake G Al-Hajjaji. 2016. IncLing: efficient product-line testing using incremental pairwise sampling. In 15th Proceedings of the ACM SIGPLAN International Conference on Generative Programming: Concepts and Experiences (GPCE). 144--155.

Digital Library

[23]

M. Meinicke J. Krieter S. Schröter R. Thüm T. Thomas Al-Hajjaji and Gunter Saake. 2016. Tool Demo: Testing Configurable Systems with FeatureIDE. In 12th Proceedings of the International Conference on Generative Programming: Concepts and Experiences (GPCE). 173--177.

Digital Library

[24]

Sven Apel, Don Batory, Christian Kästner, and Gunter Saake. 2013. Feature-Oriented Software Product Lines: Concepts and Implementation. Berlin/Heidelberg. http://www.springer.com/computer/swe/book/978-3-642-37520-0 308 pages, ISBN 978-3-642-37520-0.

Digital Library

[25]

Sven Apel, Don S. Batory, Christian Kästner, and Gunter Saake. 2013. Feature-Oriented Software Product Lines -- Concepts and Implementation. Springer.

Digital Library

[26]

Sven Apel, Alexander von Rhein, Philipp Wendler, Armin Grosslinger, and Dirk Beyer. 2013. Strategies for Product-line Verification: Case Studies and Experiments. In Proceedings of the 2013 International Conference on Software Engineering (ICSE '13). 482--491.

Digital Library

[27]

Sven Apel, Hendrik Speidel, Philipp Wendler, Alexander Von Rhein, and Dirk Beyer. 2011. Detection of Feature Interactions Using Feature-aware Verification. In 26th Proceedings of the International Conference on Automated Software Engineering (ASE). 372--375.

Digital Library

[28]

Don Batory. 2005. Feature models, grammars, and propositional formulas. In International Conference on Software Product Lines (SPLC). Springer, 7--20.

Digital Library

[29]

Dirk Beyer and M Erkan Keremoglu. 2011. CPAchecker: A tool for configurable software verification. In 23th International Conference on Computer Aided Verification (CAV). 184--190.

Digital Library

[30]

Johannes Bürdek, Malte Lochau, Stefan Bauregger, Andreas Holzer, Alexander Von Rhein, Sven Apel, and Dirk Beyer. 2015. Facilitating Reuse in Multi-goal Test-Suite Generation for Software Product Lines. In 18th International Conference on Fundamental Approaches to Software Engineering (FASE). 84--99.

[31]

Glenn Cavarlé, Alain Plantec, Steven Costiou, and Vincent Ribaud. 2018. A feature-oriented model-driven engineering approach for the early validation of feature-based applications. Science of Computer Programming 161 (2018), 18--33.

Digital Library

[32]

Lianping Chen and Muhammad Ali Babar. 2011. A systematic review of evaluation of variability management approaches in software product lines. Information and Software Technology (IST) 53, 4 (2011), 344--362.

Digital Library

[33]

Myra B. Cohen, Peter B. Gibbons, Warwick B. Mugridge, and Charles J. Colbourn. 2003. Constructing test suites for interaction testing. In Proceedings of the International Conference on Software Engineering. IEEE, 38--48.

Digital Library

[34]

K. Czarnecki and U.W. Eisenecker. 2000. Generative programming: methods, tools, and applications. Addison-Wesley.

Digital Library

[35]

Ivan do Carmo Machado, John D. Mcgregor, Yguaratã Cerqueira Cavalcanti, and Eduardo Santana De Almeida. 2014. On strategies for testing software product lines: A systematic literature review. Information and Software Technology (IST) 56, 10 (2014), 1183--1199.

Digital Library

[36]

Y. Feng, X. Liu, and J. Kerridge. 2007. A product line based aspect-oriented generative unit testing approach to building quality components. In 31st Annual International Computer Software and Applications Conference (COMPSAC). 403--408.

Digital Library

[37]

Fabiano Cutigi Ferrari, Alessandro Viola Pizzoleto, and Jeff Offutt. 2018. A Systematic Review of Cost Reduction Techniques for Mutation Testing: Preliminary Results. In 11th IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW). 1--10.

[38]

Fischer Ferreira, João Paulo Diniz, Cleiton Silva, and Eduardo Figueiredo. {n. d.}. Testing Tools for Configurable Software Systems: A Review-based Empirical Study. ({n. d.}). http://labsoft.dcc.ufmg.br/doku.php?id=about:testing_tools.

[39]

Fischer Ferreira, João Paulo Diniz, Cleiton Silva, and Eduardo Figueiredo. {n. d.}. Testing Tools for Configurable Software Systems: A Review-based Empirical Study. Empirical Study:https://github.com/fischerJF/ConfigurableSotwareSystems.git.

[40]

Johnny Maikeo Ferreira, Silvia Regina Vergilio, and Marcos Quinaia. 2017. Software Product Line Testing Based on Feature Model Mutation. International Journal of Software Engineering and Knowledge Engineering (SEKE) 27, 05 (2017), 817--839.

[41]

José A. Galindo, Hamilton Turner, David Benavides, and Jules White. 2016. Testing Variability-intensive Systems Using Automated Analysis: An Application to Android. Software Quality Journal 24, 2 (June 2016), 365--405.

Digital Library

[42]

José A. Galindo, Hamilton Turner, David Benavides, and Jules White. 2016. Testing variability-intensive systems using automated analysis: an applicationto Android. Software Quality Journal (SQJ) 24, 2 (2016), 365--405.

Digital Library

[43]

B.J. Garvin and M.B. Cohen. 2011. Feature Interaction Faults Revisited: An Exploratory Study. In International Symposium on Software Reliability Engineering (ISSRE). 90--99.

Digital Library

[44]

Brady J. Garvin, Myra B. Cohen, and Matthew B. Dwyer. 2011. Evaluating improvements to a meta-heuristic search for constrained interaction testing. Empirical Software Engineering(ESE) 16, 1 (2011), 61--102.

Digital Library

[45]

Michaela Greiler, Arie van Deursen, and Margaret-Anne Storey. 2012. Test Confessions: A Study of Testing Practices for Plugin Systems. In Proceedings of the International Conference on Software Engineering. IEEE, 244--254.

Digital Library

[46]

Christopher Henard, Mike Papadakis, Gilles Perrouin, Jacques Klein, and Yves Le Traon. 2013. PLEDGE: A Product Line Editor and Test Generation Tool. In 17th Proceedings of the International Software Product Line Conference Co-located Workshops (SPLC). 126--129.

Digital Library

[47]

Christopher Henard, Mike Papadakis, and Yves Le Traon. 2014. Mutation-based generation of software product line test configurations. In 6th International Symposium on Search Based Software Engineering (SSBSE). 92--106.

[48]

Aymeric Hervieu, Benoit Baudry, and Arnaud Gotlieb. 2011. PACOGEN: Automatic Generation of Pairwise Test Configurations from Feature Models. In 22th International Symposium on Software Reliability Engineering(ISSRE). 120--129.

Digital Library

[49]

M. F. Haugen Ø. Fleurey F. Johansen. 2011. Properties of Realistic Feature Models Make Combinatorial Testing of Product Lines Feasible. In 14th Model Driven Engineering Languages and Systems (MODELS). 638--652.

Digital Library

[50]

M. F. Haugen Ø. Fleurey F. Johansen. 2012. An Algorithm for Generating T-wise Covering Arrays from Large Feature Models. In 16th Proceedings of the International Software Product Line Conference - Volume 1 (SPLC). 46--55.

Digital Library

[51]

C. Kastner. 2010. Virtual Separation of Concerns: Toward Preprocessors 2.0. Ph.D. Dissertation. Otto-von-Guericke-Universitat Magdeburg.

[52]

Chang Hwan Peter Kim, Don S. Batory, and Sarfraz Khurshid. 2011. Reducing Combinatorics in Testing Product Lines. In 10th Proceedings of the International Conference on Aspect-oriented Software Development (AOSD). 57--68.

Digital Library

[53]

Chang Hwan Peter Kim, Eric Bodden, Don Batory, and Sarfraz Khurshid. 2010. Reducing Configurations to Monitor in a Software Product Line. In 18th International Conference on Runtime Verification. 285--299.

Digital Library

[54]

Chang Hwan Peter Kim, Sarfraz Khurshid, and Don Batory. 2012. Shared Execution for Efficiently Testing Product Lines. In Proceedings of the International Symposium on Software Reliability Engineering. IEEE, 221--230.

Digital Library

[55]

Chang Hwan Peter Kim, Sarfraz Khurshid, and Don Batory. 2012. Shared Execution for Efficiently Testing Product Lines. In 23th International Symposium on Software Reliability Engineering (ISSRE). 221--230.

Digital Library

[56]

Chang Hwan Peter Kim, Darko Marinov, Sarfraz Khurshid, Don Batory, Sabrina Souto, Paulo Barros, and Marcelo d'Amorim. 2013. SPLat: Lightweight Dynamic Analysis for Reducing Combinatorics in Testing Configurable Systems. In ESEC/FSE. 257--267.

Digital Library

[57]

Chang Hwan Peter Kim, Darko Marinov, Sarfraz Khurshid, Don Batory, Sabrina Souto, Paulo Barros, and Marcelo d'Amorim. 2013. SPLat: lightweight dynamic analysis for reducing combinatorics in testing configurable systems. In 9th Proceedings of the Joint Meeting on Foundations of Software Engineering (ESEC/FSE). 257--267.

Digital Library

[58]

Kyungseok Kim, Hyejung Kim, Miyoung Ahn, Minseok Seo, Yeop Chang, and Kyo C. Kang. 2006. ASADAL: a tool system for co-development of software and test environment based on product line engineering. In 28th Proceedings of the International Conference on Software Engineering (ICSE). 783--786.

Digital Library

[59]

Barbara Kitchenham and S Charters. 2007. Guidelines for performing Systematic Literature Reviews in Software Engineering. Engineering. In Technical report, Ver. 2.3 Technical Report (EBSE) MISSING, MISSING (2007), MISSING.

[60]

D. Richard Kuhn, Raghu N. Kacker, and Yu Lei. 2010. Practical Combinatorial Testing. Technical Report SP 800--142. National Institute of Standards & Technology, Gaithersburg, MD, United States.

[61]

D. Richard Kuhn, Dolores R. Wallace, and Albert M. Gallo Jr. 2004. Software Fault Interactions and Implications for Software Testing. IEEE Transactions on Software Engineering 30, 6 (2004), 418--421.

Digital Library

[62]

Beatriz Pérez Lamancha, Macario Polo, and Mario Piattini. 2015. PROW: A Pairwise algorithm with constRaints, Order and Weight. Journal of Systems and Software (JSS) 99, MISSING (2015), 1--19.

[63]

Hyesun Lee, Jin-seok Yang, and Kyo C Kang. 2012. VULCAN: architecture-model-based workbench for product line engineering. In Proceedings of the 16th International Software Product Line Conference-Volume 2. ACM, 260--264.

Digital Library

[64]

Li Li, Jabier Martinez, Tewfik Ziadi, Tegawendé F. Bissyandé, Jacques Klein, and Yves Le Traon. 2016. Mining Families of Android Applications for Extractive SPL Adoption. In Proceedings of the 20th International Systems and Software Product Line Conference (SPLC '16). ACM, New York, NY, USA, 271--275.

Digital Library

[65]

Jörg Liebig, Alexander von Rhein, Christian Kästner, Sven Apel, Jens Dörre, and Christian Lengauer. 2013. Scalable Analysis of Variable Software. In Proceedings of the Foundations of Software Engineering. ACM, 81--91.

Digital Library

[66]

Roberto E. Lopez-Herrejon, Stefan Fischer, Rudolf Ramler, and Alexander Egyed. 2015. A first systematic mapping study on combinatorial interaction testing for software product lines. In 8th IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW). 1--10.

[67]

Ivan do Carmo Machado, John D. Mcgregor, Yguaratã Cerqueira Cavalcanti, and Eduardo Santana de Almeida. 2014. On Strategies for Testing Software Product Lines: A Systematic Literature Review. Information and Software Technology 56, 10 (2014), 1183--1199.

Digital Library

[68]

D. Gotlieb A. Sen S. Hervieu A. Marijan. 2013. Practical pairwise testing for software product lines. In 17th Proceedings of the International Software Product Line Conference (SPLC). 227--235.

Digital Library

[69]

Flávio Medeiros, Christian Kästner, Márcio Ribeiro, Rohit Gheyi, and Sven Apel. 2016. A Comparison of 10 Sampling Algorithms for Configurable Systems. In Proceedings of the International Conference on Software Engineering. ACM, 643--654.

Digital Library

[70]

Jens Meinicke, Thomas Thüm, Reimar Schröter, Fabian Benduhn, and Gunter Saake. 2014. An overview on analysis tools for software product lines. In 18th Proceedings of the International Software Product Line Conference: Companion Volume for Workshops, Demonstrations and Tools-Volume 2 (SPLC). 94--101.

Digital Library

[71]

Jens Meinicke, Chu-Pan Wong, Christian Kästner, Thomas Thüm, and Gunter Saake. 2016. On essential configuration complexity: measuring interactions in highly-configurable systems. In 31st Proceedings of the International Conference on Automated Software Engineering (ASE). 483--494.

Digital Library

[72]

Hung Viet Nguyen, Christian Kästner, and Tien N. Nguyen. 2014. Exploring Variability-aware Execution for Testing Plugin-based Web Applications. In Proceedings of the International Conference on Software Engineering. ACM, 907--918.

Digital Library

[73]

H. V. Kästner C Nguyen T. N. Nguyen. 2014. Exploring Variability-aware Execution for Testing Plugin-based Web Applications. In 36th Proceedings of the International Conference on Software Engineering (ICSE). 907--918.

Digital Library

[74]

Changhai Nie and Hareton Leung. 2011. A survey of combinatorial testing. ACM Computing Surveys 43, 2 (2011), 11:1--11:29.

Digital Library

[75]

Sebastian Oster, Marius Zink, Malte Lochau, and Mark Grechanik. 2011. Pairwise feature-interaction testing for SPLs: potentials and limitations. In 15th Proceedings of the International Software Product Line Conference, Volume 2 (ISPLC). 6.

Digital Library

[76]

José A. Parejo, Ana B. Sánchez, Sergio Segura, Antonio Ruiz-Cortés, Roberto E. Lopez-Herrejon, and Alexander Egyed. 2016. Multi-objective test case prioritization in highly configurable systems: A case study. Journal of Systems and Software (JSS) 122, MISSING (2016), 287--310.

Digital Library

[77]

Juliana Alves Pereira, Kattiana Constantino, and Eduardo Figueiredo. 2015. A systematic literature review of software product line management tools. In 14th International Conference on Software Reuse (ICSR). 73--89.

[78]

H. Post and C. Sinz. 2008. Configuration Lifting: Verification Meets Software Configuration. In Proceedings of the 2008 23rd IEEE/ACM International Conference on Automated Software Engineering (ASE '08). IEEE Computer Society, Washington, DC, USA, 347--350.

Digital Library

[79]

Hamza Samih and Ralf Bogusch. 2014. MPLM-MaTeLo product line manager:{relating variability modelling and model-based testing}. In 18th Proceedings of the International Software Product Line Conference: Companion Volume for Workshops, Demonstrations and Tools-Volume 2 (SPLC). 138--142.

Digital Library

[80]

Ana B. Sánchez, Sergio Segura, and Antonio Ruiz-Cortés. 2014. A comparison of test case prioritization criteria for software product lines. In 17th Proceedings of the International Conference Software Testing, Verification and Validation (ICST). 41--50.

Digital Library

[81]

Ronny Seiger and Thomas Schlegel. 2012. Test modeling for context-aware ubiquitous applications with feature petri nets. In 2th Proceedings of the Workshop on Model-based Interactive Ubiquitous Systems (MODIQUITOUS). MISSING.

[82]

Jiangfan Shi, Myra B. Cohen, and Matthew B. Dwyer. 2012. Integration testing of software product lines using compositional symbolic execution. In 15th International Conference on Fundamental Approaches to Software Engineering (FASE). 270--284.

Digital Library

[83]

Sabrina Souto, Marcelo d'Amorim, and Rohit Gheyi. 2017. Balancing soundness and efficiency for practical testing of configurable systems. In 39th Proceedings of the International Conference on Software Engineering (ICSE). 632--642.

Digital Library

[84]

M. Oster S. Lochau M. Fogdal T. Steffens. 2012. Industrial Evaluation of Pairwise SPL Testing with MoSo-PoLiTe. In 6th Proceedings of the International Workshop on Variability Modeling of Software-Intensive Systems (VaMoS). 55--62.

Digital Library

[85]

Mikael Svahnberg, Jilles Van Gurp, and Jan Bosch. 2005. A taxonomy of variability realization techniques. Software: Practice and experience 35, 8 (2005), 705--754.

Digital Library

[86]

Jacob Swanson, Myra B. Cohen, Matthew B. Dwyer, Brady J. Garvin, and Justin Firestone. 2014. Beyond the rainbow: self-adaptive failure avoidance in configurable systems. In 22th Proceedings of the International Symposium on Foundations of Software Engineering (SIGSOFT). 377--388.

Digital Library

[87]

Thomas Thüm, Christian Kästner, Fabian Benduhn, Jens Meinicke, Gunter Saake, and Thomas Leich. 2014. FeatureIDE: An extensible framework for feature-oriented software development. Science of Computer Programming (SCP) 79, MISSING (2014), 70--85.

Digital Library

[88]

E. Uzuncaova, D. Garcia, S. Khurshid, and D. Batory. 2008. Testing Software Product Lines Using Incremental Test Generation. In 19th International Symposium on Software Reliability Engineering (ISSRE). 249--258.

Digital Library

[89]

E. Khurshid S. Batory D. Uzuncaova. 2010. Incremental Test Generation for Software Product Lines. IEEE Transactions on Software Engineering (TSE) 36, 3 (2010), 309--322.

Digital Library

[90]

Shuai Wang, Shaukat Ali, and Arnaud Gotlieb. 2013. Minimizing test suites in software product lines using weight-based genetic algorithms. In 15th Proceedings of the annual conference on Genetic and evolutionary computation (GECCO). 1493--1500.

Digital Library

[91]

Shuai Wang, Shaukat Ali, and Arnaud Gotlieb. 2015. Cost-effective test suite minimization in product lines using search techniques. Journal of Systems and Software (JSS) 103, 3 (2015), 370--391.

Digital Library

[92]

Stephan Weißleder, Dehla Sokenou, and Bernd-Holger Schlingloff. 2008. Reusing state machines for automatic test generation in product lines. In 1st workshop on model-based testing in practice (MoTiP). 19.

[93]

Pamela Zave. 2003. An experiment in feature engineering. In Programming methodology. Springer, 353--377.

Digital Library

Cited By

Mendonça WAssunção WVergilio S(2024)Feature-oriented test case selection and prioritization during the evolution of highly-configurable systemsJournal of Systems and Software10.1016/j.jss.2024.112157217(112157)Online publication date: Nov-2024
https://doi.org/10.1016/j.jss.2024.112157
Xiang YHuang HLi SLi MLuo CYang X(2023)Automated Test Suite Generation for Software Product Lines Based on Quality-Diversity OptimizationACM Transactions on Software Engineering and Methodology10.1145/362815833:2(1-52)Online publication date: 22-Dec-2023
https://dl.acm.org/doi/10.1145/3628158
Mendonça WAssunção WVergilio S(2023)Feature-oriented Test Case Selection during Evolution of Highly-Configurable SystemsProceedings of the 27th ACM International Systems and Software Product Line Conference - Volume A10.1145/3579027.3608979(76-86)Online publication date: 28-Aug-2023
https://dl.acm.org/doi/10.1145/3579027.3608979
Show More Cited By

Recommendations

Testing configurable software systems: the failure observation challenge
SPLC '20: Proceedings of the 24th ACM Conference on Systems and Software Product Line: Volume A - Volume A

Configurable software systems can be adapted or configured according to a set of features to increase reuse and productivity. The testing process is essential because configurations that fail may potentially hurt user experience and degrade the ...
A firewall model for testing user-configurable software systems
Testing of User-Configurable Software Systems Using Firewalls
ISSRE '08: Proceedings of the 2008 19th International Symposium on Software Reliability Engineering

User-configurable software systems present many challenges to software testers. These systems are created to address a large number of possible uses, each of which is based on a specific configuration. As configurations are made up of groups of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

VaMoS '19: Proceedings of the 13th International Workshop on Variability Modelling of Software-Intensive Systems

February 2019

116 pages

ISBN:9781450366489

DOI:10.1145/3302333

Conference Chair:
Danny Weyns,
Program Chairs:
Gilles Perrouin,
Danny Weyns

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

FWO: Fund for Scientific Research - Flanders (Belgium)
FNRS: Fonds National de la Recherche Scientifique

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 February 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

VAMOS '19

VAMOS '19: 13th International Workshop on Variability Modelling of Software-Intensive Systems

February 6 - 8, 2019

Leuven, Belgium

Acceptance Rates

VaMoS '19 Paper Acceptance Rate 14 of 24 submissions, 58%;

Overall Acceptance Rate 66 of 147 submissions, 45%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
157
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Mendonça WAssunção WVergilio S(2024)Feature-oriented test case selection and prioritization during the evolution of highly-configurable systemsJournal of Systems and Software10.1016/j.jss.2024.112157217(112157)Online publication date: Nov-2024
https://doi.org/10.1016/j.jss.2024.112157
Xiang YHuang HLi SLi MLuo CYang X(2023)Automated Test Suite Generation for Software Product Lines Based on Quality-Diversity OptimizationACM Transactions on Software Engineering and Methodology10.1145/362815833:2(1-52)Online publication date: 22-Dec-2023
https://dl.acm.org/doi/10.1145/3628158
Mendonça WAssunção WVergilio S(2023)Feature-oriented Test Case Selection during Evolution of Highly-Configurable SystemsProceedings of the 27th ACM International Systems and Software Product Line Conference - Volume A10.1145/3579027.3608979(76-86)Online publication date: 28-Aug-2023
https://dl.acm.org/doi/10.1145/3579027.3608979
Gwasem IDu WMcAllister A(2023)Goal-Oriented Prioritized Non-Functional Testing with Stakeholders' Priorities2023 IEEE 8th International Conference on Engineering Technologies and Applied Sciences (ICETAS)10.1109/ICETAS59148.2023.10346293(1-8)Online publication date: 25-Oct-2023
https://doi.org/10.1109/ICETAS59148.2023.10346293
Bons AMarín BAho PVos T(2023)Scripted and scriptless GUI testing for web applications: An industrial caseInformation and Software Technology10.1016/j.infsof.2023.107172158(107172)Online publication date: Jun-2023
https://doi.org/10.1016/j.infsof.2023.107172
Mendonça WVergilio SMichelon GEgyed AAssunção WFelfernig AFuentes L(2022)Test2FeatureProceedings of the 26th ACM International Systems and Software Product Line Conference - Volume B10.1145/3503229.3547031(62-65)Online publication date: 12-Sep-2022
https://doi.org/10.1145/3503229.3547031
Xiang YHuang HLi MLi SYang X(2022)Looking For Novelty in Search-Based Software Product Line TestingIEEE Transactions on Software Engineering10.1109/TSE.2021.305785348:7(2317-2338)Online publication date: 1-Jul-2022
https://doi.org/10.1109/TSE.2021.3057853
Ferreira FVale GDiniz JFigueiredo E(2021)Evaluating T-wise testing strategies in a community-wide dataset of configurable software systemsJournal of Systems and Software10.1016/j.jss.2021.110990179(110990)Online publication date: Sep-2021
https://doi.org/10.1016/j.jss.2021.110990

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents