Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3646548.3672587acmconferencesArticle/Chapter ViewAbstractPublication PagessplcConference Proceedingsconference-collections
research-article
Open access

Not Quite There Yet: Remaining Challenges in Systems and Software Product Line Engineering as Perceived by Industry Practitioners

Published: 02 September 2024 Publication History

Abstract

Research on system and software product line engineering (SPLE) and the community around it have been inspired by industrial applications. However, despite decades of research, industry is still struggling with adopting product line approaches and more generally with managing system variability. We argue that it is essential to better understand why this is the case. Particularly, we need to understand the current challenges industry is facing wrt. adopting SPLE practices, how far existing research helps industry practitioners to cope with their challenges, and where additional research would be required. We conducted a hybrid workshop at the 2023 Systems and Software Product Line Conference (SPLC) with over 30 participants from industry and academia. 9 companies from diverse domains and in different phases of SPLE adoption presented their context and perceived challenges. We grouped, discussed, and rated the relevance of the articulated challenges. We then formed clusters of relevant research topics to discuss existing literature as well as research opportunities. In this paper, we report the industry cases, the identified challenges and clusters of research topics, provide pointers to existing work, and discuss research opportunities. With this, we want to enable industry practitioners to become aware of typical challenges and find their way into the existing body of knowledge and to relevant fields of research.

References

[1]
Mathieu Acher, José Galindo Duarte, and Jean-Marc Jézéquel. 2023. On Programming Variability with Large Language Model-based Assistant. In Proc. of the 27th ACM International Systems and Software Product Line Conference-Volume A. ACM, 8–14.
[2]
Sven Apel, Don Batory, Christian Kästner, and Gunter Saake. 2013. Feature-oriented software product lines. (2013).
[3]
Sven Apel, Alexander von Rhein, Philipp Wendler, Armin Größlinger, and Dirk Beyer. 2013. Strategies for product-line verification: case studies and experiments. In ICSE. 482–491.
[4]
Wesley KG Assunção, Silvia R Vergilio, and Roberto E Lopez-Herrejon. 2020. Automatic extraction of product line architecture and feature models from UML class diagram variants. Information and Software Technology 117 (2020), 106198.
[5]
Wesley K. G. Assunção, Roberto E. Lopez-Herrejon, Lukas Linsbauer, Silvia R. Vergilio, and Alexander Egyed. 2017. Reengineering legacy applications into software product lines: a systematic mapping. Empir. Softw. Eng. 22, 6 (2017), 2972–3016.
[6]
Rabih Bashroush, Muhammad Garba, Rick Rabiser, Iris Groher, and Goetz Botterweck. 2017. Case tool support for variability management in software product lines. ACM Computing Surveys (CSUR) 50, 1 (2017), 1–45.
[7]
Maurice H ter Beek, Klaus Schmid, and Holger Eichelberger. 2019. Textual variability modeling languages: an overview and considerations. In Proc. of the 23rd International Systems and Software Product Line Conference-Volume B. ACM, 151–157.
[8]
Grischa Beier, Asmus Figge, Robert Müller, Uwe Rothenburg, and Rainer Stark. 2013. Supporting product development through cross-discipline dependency-modeling–novel approaches for traceability-usage. Lecture Notes on Information Theory Vol 1, 1 (2013).
[9]
Thorsten Berger, Ralf Rublack, Divya Nair, Joanne M Atlee, Martin Becker, Krzysztof Czarnecki, and Andrzej Wąsowski. 2013. A survey of variability modeling in industrial practice. In Proc. of the 7th International Workshop on Variability Modelling of Software-intensive Systems. ACM, 1–8.
[10]
Thorsten Berger, Jan-Philipp Steghöfer, Tewfik Ziadi, Jacques Robin, and Jabier Martinez. 2020. The state of adoption and the challenges of systematic variability management in industry. Empir. Softw. Eng. 25, 3 (2020), 1755–1797.
[11]
Jan Bosch. 1999. Product-line architectures in industry: a case study. In Proc. of the 21st international conference on Software engineering. 544–554.
[12]
Jan Bosch. 2000. Design and Use of Software Architectures: Adopting and Evolving a Product-Line Approach. Addison-Wesley.
[13]
Goetz Botterweck and Andreas Pleuss. 2014. Evolution of Software Product Lines. In Evolving Software Systems, Tom Mens, Alexander Serebrenik, and Anthony Cleve (Eds.). Springer, 265–295.
[14]
Virginia Braun and Victoria Clarke. 2012. Thematic analysis. American Psychological Association.
[15]
Marta Cecilia Camacho, Francisco Álvarez, César A. Collazos, Paul Leger, Julián Dario Bermúdez, and Julio Ariel Hurtado. 2021. A Collaborative Method for Scoping Software Product Lines: A Case Study in a Small Software Company. Applied Sciences 11, 15 (July 2021), 6820.
[16]
Lianping Chen and Muhammad Ali Babar. 2010. Variability management in software product lines: an investigation of contemporary industrial challenges. In International Conference on Software Product Lines. Springer, 166–180.
[17]
Paul Clements and Linda M. Northrop. 2002. Software product lines - practices and patterns. Addison-Wesley.
[18]
Daniela S. Cruzes and Tore Dybå. 2011. Recommended Steps for Thematic Synthesis in Software Engineering. In Proc. of the 5th International Symposium on Empirical Software Engineering and Measurement, ESEM 2011, Banff, AB, Canada, September 22-23, 2011. IEEE Computer Society, 275–284.
[19]
Krzysztof Czarnecki, Paul Grünbacher, Rick Rabiser, Klaus Schmid, and Andrzej Wąsowski. 2012. Cool features and tough decisions: a comparison of variability modeling approaches. In Proc. of the 6th International workshop on variability modeling of software-intensive systems. ACM, 173–182.
[20]
Ivonei Freitas da Silva, Paulo Anselmo da Mota Silveira Neto, Pádraig O’Leary, Eduardo Santana de Almeida, and Silvio Romero de Lemos Meira. [n. d.]. Software product line scoping and requirements engineering in a small and medium-sized enterprise: An industrial case study. 88 ([n. d.]), 189–206.
[21]
Sybren Deelstra, Marco Sinnema, and Jan Bosch. 2005. Product derivation in software product families: a case study. JSS 74, 2 (2005), 173–194.
[22]
Ivan do Carmo Machado, John D. McGregor, Yguaratã Cerqueira Cavalcanti, and Eduardo Santana De Almeida. 2014. On strategies for testing software product lines: A systematic literature review. Information and Software Technology 56, 10 (2014), 1183–1199.
[23]
Dominik Domis, Stephan Sehestedt, Thomas Gamer, Markus Aleksy, and Heiko Koziolek. 2014. Customizing domain analysis for assessing the reuse potential of industrial software systems: experience report. In Proc. of the 18th International Software Product Line Conference - Volume 1. ACM, Florence Italy, 310–319.
[24]
Yael Dubinsky, Julia Rubin, Thorsten Berger, Slawomir Duszynski, Martin Becker, and Krzysztof Czarnecki. 2013. An Exploratory Study of Cloning in Industrial Software Product Lines. In Proc. of CSMR 2013. 25–34.
[25]
Gunnar Erixon. 1998. Modular function deployment. https://swepub.kb.se/showrecord?q=onr%3A%22swepub%3Aoai%3ADiVA.org%3Akth-2619%22&n=1&d=swepub&noredirect=true&tab2=absamp%3Blanguage%3Den
[26]
Hafiyyan Sayyid Fadhlillah, Antonio M Gutiérrez Fernández, Rick Rabiser, and Alois Zoitl. 2023. Managing Cyber-Physical Production Systems Variability using V4rdiac: Industrial Experiences. In Proc. of the 27th ACM International Systems and Software Product Line Conference-Volume A. ACM, 223–233.
[27]
Miao Fang, Georg Leyh, Joerg Doerr, and Christoph Elsner. 2016. Multi-variability modeling and realization for software derivation in industrial automation management. In Proc. of the ACM/IEEE 19th International Conference on Model Driven Engineering Languages and Systems. 2–12.
[28]
FeatureIDE. 2024. FeatureIDE. https://featureide.github.io Accessed on 2024-04-24.
[29]
Antonio Wagner Forti, César Coutinho Ramos, and Jorge Muniz Jr. 2023. Integration of design structure matrix and modular function deployment for mass customization and product modularization: a case study on heavy vehicles. The International Journal of Advanced Manufacturing Technology 125, 3 (2023), 1987–2002. Publisher: Springer.
[30]
José A Galindo, Antonio J Dominguez, Jules White, and David Benavides. 2023. Large Language Models to generate meaningful feature model instances. In Proc. of the 27th ACM International Systems and Software Product Line Conference-Volume A. ACM, 15–26.
[31]
Hassan Gomaa. 2005. Designing software product lines with UML. In 29th Annual IEEE/NASA Software Engineering Workshop-Tutorial Notes (SEW’05). IEEE, 160–216.
[32]
Øystein Haugen, Andrzej Wąsowski, and Krzysztof Czarnecki. 2012. CVL: common variability language. In Proc. of the 16th International Software Product Line Conference-Volume 2. ACM, 266–267.
[33]
Wolfgang Heider, Rick Rabiser, Paul Grünbacher, and Daniela Lettner. 2012. Using regression testing to analyze the impact of changes to variability models on products. In SPLC. 196–205.
[34]
Christopher Henard, Mike Papadakis, Gilles Perrouin, Jacques Klein, and Yves Le Traon. 2013. Assessing Software Product Line Testing Via Model-Based Mutation: An Application to Similarity Testing. In Sixth IEEE International Conference on Software Testing, Verification and Validation, ICST 2013 Workshops Proceedings, Luxembourg, Luxembourg, March 18-22, 2013. IEEE Computer Society, 188–197.
[35]
Scott A. Hendrickson and Andre van der Hoek. 2007. Modeling Product Line Architectures through Change Sets and Relationships. In ICSE. 189–198.
[36]
ISO 26550:2015(E) 2015. Software And Systems Engineering - Reference Model For Product Line Engineering And Management. Standard. International Organization for Standardization, Geneva, CH.
[37]
Martin Fagereng Johansen, Øystein Haugen, and Franck Fleurey. 2011. A Survey of Empirics of Strategies for Software Product Line Testing. In Fourth IEEE International Conference on Software Testing, Verification and Validation, ICST 2012, Berlin, Germany, 21-25 March, 2011, Workshop Proceedings. IEEE Computer Society, 266–269.
[38]
Isabel John and Michael Eisenbarth. [n. d.]. A decade of scoping: a survey. In Proc. of the 13th International Software Product Line Conference. 31–40.
[39]
Isabel John, Jens Knodel, Theresa Lehner, and Dirk Muthig. [n. d.]. A practical guide to product line scoping. In 10th International Software Product Line Conference (SPLC’06). IEEE, 3–12.
[40]
Christian Kästner, Alexander Dreiling, and Klaus Ostermann. 2013. Variability mining: Consistent semi-automatic detection of product-line features. IEEE Transactions on Software Engineering 40, 1 (2013), 67–82.
[41]
Miguel A Laguna and Yania Crespo. 2013. A systematic mapping study on software product line evolution: From legacy system reengineering to product line refactoring. Science of Computer Programming 78, 8 (2013), 1010–1034.
[42]
Thorsten Lammers, Matthias Guertler, and Henning Skirde. 2022. Can product modularization approaches help address challenges in technical project portfolio management?–Laying the foundations for a methodology transfer. International Journal of Information Systems and Project Management 10, 2 (2022), 26–42.
[43]
Mark W. Lange and Andrea Imsdahl. 2014. Modular Function Deployment: Using Module Drivers to Impart Strategies to a Product Architecture. In Advances in Product Family and Product Platform Design. New York, NY, 91–118.
[44]
Jihyun Lee, Sungwon Kang, and Danhyung Lee. 2010. A Comparison of Software Product Line Scoping Approaches. Int. J. Softw. Eng. Knowl. Eng. 20, 5 (2010), 637–663.
[45]
Jihyun Lee, Sungwon Kang, and Danhyung Lee. 2012. A survey on software product line testing. In Proc. of the 16th International Software Product Line Conference - Volume 1. ACM, Salvador Brazil, 31–40.
[46]
Meir Lehman and Juan C. Fernáandez-Ramil. 2006. Software Evolution. Wiley, Chapter 1, 7–40.
[47]
Malte Lochau, Sebastian Oster, Ursula Goltz, and Andy Schürr. 2012. Model-based pairwise testing for feature interaction coverage in software product line engineering. Softw. Qual. J. 20, 3-4 (2012), 567–604.
[48]
Luciano Marchezan, Elder Rodrigues, Wesley Klewerton Guez Assunção, Maicon Bernardino, Fábio Paulo Basso, and João Carbonell. 2022. Software product line scoping: A systematic literature review. Journal of Systems and Software 186 (April 2022), 111189.
[49]
Dusica Marijan, Arnaud Gotlieb, Sagar Sen, and Aymeric Hervieu. 2013. Practical pairwise testing for software product lines. In Proc. of the 17th International Software Product Line Conference. ACM, Tokyo Japan, 227–235.
[50]
Maíra Marques, Jocelyn Simmonds, Pedro O Rossel, and María Cecilia Bastarrica. 2019. Software product line evolution: A systematic literature review. Information and Software Technology 105 (2019), 190–208.
[51]
Jabier Martinez, Wesley KG Assunção, and Tewfik Ziadi. 2017. Espla: A catalog of extractive spl adoption case studies. In Proc. of the 21st International Systems and Software Product Line Conference-Volume B. ACM, 38–41.
[52]
Jabier Martinez, Wesley K. Assunção, and Tewfik Ziadi. 2017. ESPLA: A Catalog of Extractive SPL Adoption Case Studies. https://but4reuse.github.io/espla_catalog/ Accessed on 2024-04-27.
[53]
Andreas Metzger and Klaus Pohl. 2014. Software product line engineering and variability management: achievements and challenges. Future of software engineering proceedings (2014), 70–84.
[54]
Miro. 2024. Miro online whiteboard. https://miro.com/online-whiteboard/ Accessed 2024-04-24.
[55]
Mukelabai Mukelabai, Damir Nešić, Salome Maro, Thorsten Berger, and Jan-Philipp Steghöfer. 2018. Tackling combinatorial explosion: a study of industrial needs and practices for analyzing highly configurable systems. In Proc. of the 33rd ACM/IEEE International Conference on Automated Software Engineering. 155–166.
[56]
Muhammad Asim Noor, Rick Rabiser, and Paul Grünbacher. [n. d.]. A collaborative approach for reengineering-based product line scoping. In 1st International Workshop on Agile Product Line Engineering (APLE’06), Maryland, USA.
[57]
Sebastian Oster, Florian Markert, and Philipp Ritter. 2010. Automated Incremental Pairwise Testing of Software Product Lines. In Software Product Lines: Going Beyond. Vol. 6287. 196–210. Series Title: Lecture Notes in Computer Science.
[58]
Sebastian Oster, Andreas Wübbeke, Gregor Engels, and Andy Schürr. 2011. A Survey of Model-Based Software Product Lines Testing.
[59]
David Lorge Parnas. 1976. On the Design and Development of Program Families. IEEE Trans. Software Eng. 2, 1 (1976), 1–9.
[60]
Gilles Perrouin, Sebastian Oster, Sagar Sen, Jacques Klein, Benoit Baudry, and Yves Le Traon. 2012. Pairwise testing for software product lines: comparison of two approaches. Softw. Qual. J. 20, 3-4 (2012), 605–643.
[61]
Andreas Pleuss, Goetz Botterweck, Deepak Dhungana, Andreas Polzer, and Stefan Kowalewski. 2012. Model-driven Support for Product Line Evolution on Feature Level. Journal of Systems and Software 85, 10 (October 2012), 2261–2274.
[62]
Klaus Pohl, Günter Böckle, and Frank Van Der Linden. 2005. Software product line engineering: foundations, principles, and techniques. Vol. 1. Springer.
[63]
pure systems. 2024. pure::variants. https://www.pure-systems.com/purevariants Accessed on 2024-04-24.
[64]
Mikko Raatikainen, Juha Tiihonen, and Tomi Männistö. 2019. Software product lines and variability modeling: A tertiary study. Journal of Systems and Software 149 (2019), 485–510.
[65]
Rick Rabiser, Klaus Schmid, Martin Becker, Goetz Botterweck, Matthias Galster, Iris Groher, and Danny Weyns. 2018. A study and comparison of industrial vs. academic software product line research published at SPLC. In Proc. of the 22nd International Systems and Software Product Line Conference. ACM, 14–24.
[66]
Rick Rabiser, Klaus Schmid, Martin Becker, Goetz Botterweck, Matthias Galster, Iris Groher, and Danny Weyns. 2019. Industrial and academic software product line research at SPLC: perceptions of the community. In Proc. of the 23rd International Systems and Software Product Line Conference. ACM, 27:1–27:6.
[67]
Sacha Reis, Andreas Metzger, and Klaus Pohl. 2007. Integration Testing in Software Product Line Engineering: A Model-Based Technique. Lecture Notes in Computer Science, Vol. 4422. 321–335.
[68]
Julia Rubin and Marsha Chechik. 2013. A survey of feature location techniques. Domain Engineering: Product Lines, Languages, and Conceptual Models (2013), 29–58.
[69]
Julia Rubin, Andrei Kirshin, Goetz Botterweck, and Marsha Chechik. 2012. Managing forked product variants. In Proc. of SPLC 2012. 156–160.
[70]
Ina Schaefer, Lorenzo Bettini, Viviana Bono, Ferruccio Damiani, and Nico Tanzarella. 2010. Delta-oriented programming of software product lines. In Software Product Lines: Going Beyond: 14th International Conference, SPLC 2010, Jeju Island, South Korea, September 13-17, 2010. Proceedings 14. Springer, 77–91.
[71]
Klaus Schmid. 2002. A comprehensive product line scoping approach and its validation. In Proc. of the 24th International Conference on Software Engineering, ICSE 2002, 19-25 May 2002, Orlando, Florida, USA. ACM, 593–603.
[72]
K. Schmid and H. Eichelberger. 2008. A requirements-based taxonomy of software product line evolution. Electronic Communications of the EASST 8 (2008).
[73]
Klaus Schmid, Rick Rabiser, Martin Becker, Goetz Botterweck, Matthias Galster, Iris Groher, and Danny Weyns. 2021. Bridging the gap: voices from industry and research on industrial relevance of SPLC. In Proc. of the 25th International Systems and Software Product Line Conference. ACM, 184–189.
[74]
K. Schmid and M. Verlage. 2002. The economic impact of product line adoption and evolution. IEEE Software 19, 4 (2002), 50–57.
[75]
Daniel Simon and Thomas Eisenbarth. 2002. Evolutionary Introduction of Software Product Lines. In SPLC. 272–283.
[76]
Chico Sundermann, Kevin Feichtinger, Dominik Engelhardt, Rick Rabiser, and Thomas Thüm. 2021. Yet another textual variability language? a community effort towards a unified language. In Proc. of the 25th ACM International Systems and Software Product Line Conference-Volume A. ACM, 136–147.
[77]
Antti Tevanlinna, Juha Taina, and Raine Kauppinen. 2004. Product family testing: a survey. ACM SIGSOFT Software Engineering Notes 29, 2 (March 2004), 12–12.
[78]
Thomas Thüm, Sven Apel, Christian Kästner, Ina Schaefer, and Gunter Saake. 2014. A Classification and Survey of Analysis Strategies for Software Product Lines. ACM Comput. Surv. 47, 1 (2014), 6:1–6:45.
[79]
Mojtaba Vaismoradi, Hannele Turunen, and Terese Bondas. 2013. Content analysis and thematic analysis: Implications for conducting a qualitative descriptive study. Nursing & health sciences 15, 3 (2013), 398–405.
[80]
Frank van der Linden, Klaus Schmid, and Eelco Rommes. 2007. Software product lines in action - the best industrial practice in product line engineering. Springer.
[81]
Rob van Ommering. 2005. Software reuse in product populations. IEEE Trans. Soft. Eng. 31, 7 (july 2005), 537–550.
[82]
Verband der Automobilindustrie e.V., (VDA). 2024. Automotive SPICE. https://vda-qmc.de/en/automotive-spice/. Accessed: 2024-04-08.
[83]
Michael Vierhauser, Paul Grünbacher, Alexander Egyed, Rick Rabiser, and Wolfgang Heider. 2010. Flexible and scalable consistency checking on product line variability models. In Proc. of the 25th IEEE/ACM international conference on automated software engineering. 63–72.

Cited By

View all
  • (2024)Industry Adoption of UVL: What We Will NeedProceedings of the 28th ACM International Systems and Software Product Line Conference10.1145/3646548.3676597(46-49)Online publication date: 2-Sep-2024

Index Terms

  1. Not Quite There Yet: Remaining Challenges in Systems and Software Product Line Engineering as Perceived by Industry Practitioners

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SPLC '24: Proceedings of the 28th ACM International Systems and Software Product Line Conference
    September 2024
    103 pages
    This work is licensed under a Creative Commons Attribution International 4.0 License.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 02 September 2024

    Check for updates

    Author Tags

    1. Software product line engineering
    2. industry challenges

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    Conference

    SPLC '24
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 167 of 463 submissions, 36%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)206
    • Downloads (Last 6 weeks)45
    Reflects downloads up to 20 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Industry Adoption of UVL: What We Will NeedProceedings of the 28th ACM International Systems and Software Product Line Conference10.1145/3646548.3676597(46-49)Online publication date: 2-Sep-2024

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media