Revisiting the construct and assessment of industrial relevance in software engineering research
Pages 17 - 20
Abstract
Industrial relevance is essential for an applied research area like software engineering. However, it is unclear how to achieve industrial relevance and how we communicate and assess it. We propose a reasoning framework to support the design, reporting, and assessment of research for industrial relevance.
References
[1]
Nauman bin Ali. 2016. Is effectiveness sufficient to choose an intervention? Considering resource use in empirical software engineering. In Proceedings of the 10th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM '16). ACM, New York, NY, USA, 1--6.
[2]
Nauman bin Ali, Emelie Engström, Masoumeh Taromirad, Mohammad Reza Mousavi, Nasir Mehmood Minhas, Daniel Helgesson, Sebastian Kunze, and Mahsa Varshosaz. 2019. On the search for industry-relevant regression testing research. Empirical Software Engineering 24, 4 (2019), 2020--2055.
[3]
Brian M. Belcher, Katherine E. Rasmussen, Matthew R. Kemshaw, and Deborah A. Zornes. 2016. Defining and assessing research quality in a transdisciplinary context. Research Evaluation 25, 1 (2016), 1--17.
[4]
Jürgen Börstler, Nauman bin Ali, Martin Svensson, and Kai Petersen. 2023. Investigating acceptance behavior in software engineering---Theoretical perspectives. Journal of Systems and Software 198 (2023), 111592.
[5]
Tore Dybå. 2013. Contextualizing empirical evidence. IEEE Software 30, 1 (2013), 81--83.
[6]
Emelie Engström, Margaret-Anne Storey, Per Runeson, Martin Höst, and Maria Teresa Baldassarre. 2020. How software engineering research aligns with design science: a review. Empirical Software Engineering 25, 4 (2020), 2630--2660.
[7]
Vahid Garousi, Markus Borg, and Markku Oivo. 2020. Practical relevance of software engineering research: synthesizing the community's voice. Empirical Software Engineering 25, 3 (2020), 1687--1754.
[8]
Vahid Garousi, Kai Petersen, and Baris Ozkan. 2016. Challenges and best practices in industry-academia collaborations in software engineering: A systematic literature review. Information and Software Technology 79 (2016), 106--127.
[9]
Alan R Hevner. 2007. A Three Cycle View of Design Science Research. Scandinavian Journal of Information Systems 19, 2 (2007), 87--92.
[10]
Martin Ivarsson and Tony Gorschek. 2011. A method for evaluating rigor and industrial relevance of technology evaluations. Empirical Software Engineering 16, 3 (2011), 365--395.
[11]
Persis Katrak, Andrea E Bialocerkowski, Nicola Massy-Westropp, VS Saravana Kumar, and Karen A Grimmer. 2004. A systematic review of the content of critical appraisal tools. BMC Medical Research Methodology 4 (2004), 1--11.
[12]
Pår Mårtensson, Uno Fors, Sven-Bertil Wallin, Udo Zander, and Gunnar H Nilsson. 2016. Evaluating research: A multidisciplinary approach to assessing research practice and quality. Research Policy 45, 3 (April 2016), 593--603.
[13]
Jefferson Seide Molléri, Emilia Mendes, Kai Petersen, and Michael Felderer. 2023. Determining a core view of research quality in empirical software engineering. Computer Standards & Interfaces 84 (2023), 103688.
[14]
Kai Petersen, Cigdem Gencel, Negin Asghari, Dejan Baca, and Stefanie Betz. 2014. Action research as a model for industry-academia collaboration in the software engineering context. In Proceedings of the 2014 international workshop on Long-term industrial collaboration on software engineering. "ACM", Vasteras Sweden, 55--62.
[15]
Sergio Rico, Nauman Bin Ali, Emelie Engström, and Martin Höst. 2024. Experiences from conducting rapid reviews in collaboration with practitioners - Two industrial cases. Inf. Softw. Technol. 167 (2024), 107364.
[16]
Tefko Saracevic. 2017. The Notion of Relevance in Information Science: Everybody knows what relevance is. But, what is it really? Springer, Cham, Switzerland.
[17]
William J. Sutherland, David Goulson, Simon G. Potts, and Lynn V. Dicks. 2011. Quantifying the Impact and Relevance of Scientific Research. PLOS ONE 6, 11 (2011), e27537.
[18]
John A Zachman. 1999. A framework for information systems architecture. IBM Systems Journal 38, 2/3 (1999), 454--470.
Index Terms
- Revisiting the construct and assessment of industrial relevance in software engineering research
Index terms have been assigned to the content through auto-classification.
Recommendations
Bridging Software Engineering Research and Industrial Practice
There is a long-standing challenge to narrow the gap between software engineering research and industrial practice. This gap is reinforced by a number of challenges, including differing timelines, metrics, expectations, and perceptions of these two ...
Balancing software engineering education and industrial needs
In the world of information and communications technologies the demand for professionals with software engineering skills grows at an exponential rate. On this ground, we have conducted a study to help both academia and the software industry form a ...
Achieving Industrial Relevance in Software Engineering Education
CSEET '99: Proceedings of the 12th Conference on Software Engineering Education and TrainingThis paper presents a collection of experiences related to success factors in graduate and postgraduate education. The experiences are mostly concerned with how to make the education relevant from an industrial viewpoint. This is emphasized as a key ...
Comments
Information & Contributors
Information
Published In
April 2024
87 pages
ISBN:9798400705670
DOI:10.1145/3643664
Copyright © 2024 Copyright is held by the owner/author(s). Publication rights licensed to ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
In-Cooperation
- Faculty of Engineering of University of Porto
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 09 August 2024
Check for updates
Qualifiers
- Research-article
Funding Sources
- ELLIIT
- Knowledge Foundation
Conference
WSESE '24
Sponsor:
WSESE '24: 1st IEEE/ACM International Workshop on Methodological Issues with Empirical Studies in Software Engineering
April 16, 2024
Lisbon, Portugal
Upcoming Conference
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 56Total Downloads
- Downloads (Last 12 months)56
- Downloads (Last 6 weeks)31
Reflects downloads up to 09 Nov 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in