extended-abstract

What industry wants from academia in software testing?: Hearing practitioners' opinions

Authors:

Michael Felderer,

Marco Kuhrmann,

Kadir HerkiloğluAuthors Info & Claims

EASE '17: Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering

Pages 65 - 69

https://doi.org/10.1145/3084226.3084264

Published: 15 June 2017 Publication History

Abstract

The level of industry-academia collaboration (IAC) in software engineering in general and in software testing in particular is quite low. Many researchers and practitioners are not collaborating with the "other side" to solve industrial problems. To shed light on the above issue and to characterize precisely what industry wants from academia in software testing, we solicited practitioners' opinions on their challenges in different testing activities and also the particularly relevant topics that they want the research community to work on. This short paper aims to draw the community's attention to the important issue of strengthening IAC with the hope of more IAC in software testing in the areas of most importance to the industry.

References

[1]

P. Ammann and J. Offutt. 2016. Introduction to Software Testing (2 ed.). Cambridge University Press.

[2]

S. Beecham, P. O'Leary, S. Baker, I. Richardson, and J. Noll. 2014. Making Software Engineering Research Relevant. Computer 47, 4 (Apr 2014), 80--83.

Digital Library

[3]

L. Briand. 2012. Embracing the Engineering Side of Software Engineering. IEEE Software 29, 4 (July 2012), 96--96.

Digital Library

[4]

V. Garousi, A. Coşkunçay, A. Betin-Can, and O. Demirörs. 2015. A survey of software engineering practices in Turkey. Journal of Systems and Software 108 (2015), 148--177.

[5]

V. Garousi, M. M. Eskandar, and K. Herkiloğlu. 2016. Industry-academia collaborations in software testing: experience and success stories from Canada and Turkey. Software Quality Journal (2016), 1--53.

[6]

V. Garousi and M. Felderer. 2017. Living in two different worlds: A comparison of industry and academic focus areas in software testing. IEEE Software (in press) (2017).

[7]

V. Garousi, A. Mesbah, A. Betin-Can, and S. Mirshokraie. 2013. A systematic mapping study of web application testing. Information and Software Technology 55, 8 (2013), 1374--1396.

Digital Library

[8]

V. Garousi, K. Petersen, and B. Özkan. 2016. Challenges and Best Practices in Industry-academia Collaborations in Software Engineering. Information and Software Technology 79, C (Nov. 2016), 106--127.

Digital Library

[9]

V. Garousi and J. Zhi. 2013. A Survey of Software Testing Practices in Canada. Journal of Systems and Software 86, 5 (May 2013), 1354--1376.

Digital Library

[10]

R. L. Glass. 2006. Software Creativity 2.0. developer.* Books.

Digital Library

[11]

D. Graham, E. V. Veenendaal, and I. Evans. 2008. Cengage Learning. Cengage.

[12]

D. Lo, N. Nagappan, and T. Zimmermann. 2015. How Practitioners Perceive the Relevance of Software Engineering Research. In 10th Joint Meeting on Foundations of Software Engineering (ESEC/FSE 2015). ACM, New York, NY, USA, 415--425.

Digital Library

[13]

J. S. Molléri, K. Petersen, and E. Mendes. 2016. Survey Guidelines in Software Engineering: An Annotated Review. In 10th International Symposium on Empirical Software Engineering and Measurement (ESEM). ACM, New York, NY, USA, Article 58, 6 pages.

Digital Library

[14]

D. M. Shaw and B. S. Elger. 2013. The relevance of relevance in research. Swiss Medical Weekly 143:w13792 (May 2013), 1--4.

[15]

D. I. K. Sjoeberg, J. E. Hannay, O. Hansen, V. B. Kampenes, A. Karahasanovic, N. K. Liborg, and A. C. Rekdal. 2005. A survey of controlled experiments in software engineering. IEEE Transactions on Software Engineering 31, 9 (Sept 2005), 733--753.

Digital Library

[16]

G. J. Smith, M. M. Schmidt, P. J. Edelen-Smith, and B. G. Cook. 2013. Pasteur's Quadrant as the Bridge Linking Rigor with Relevance. Exceptional Children 79, 2 (2013), 147--161.

[17]

A. Tang and R. Kazman. 2017. On the Worthiness of Software Engineering Research. Online: http://shidler.hawaii.edu/sites/shidler.hawaii.edu/files/users/kazman/se_research_worthiness.pdf. (March 2017).

[18]

M. W. Toffel. 2016. Enhancing the Practical Relevance of Research. Production and Operations Management 25, 9 (2016), 1493--1505.

[19]

R. v. Solingen and E. Berghout. 1999. The Goal/Question/Metric Method: A Practical Guide for Quality Improvement of Software Development. Mcgraw-Hill Professional.

[20]

C. Wohlin. 2013. Software Engineering Research under the Lamppost. In ICSOFT. SciTePress, IS--11.

[21]

C. Wohlin, P. Runeson, M. Höst, M. C. Ohlsson, B. Regnell, and A. Wesslén. 2012. Experimentation in Software Engineering. Springer.

Digital Library

Cited By

Lo D(2024)Requirements Engineering for Trustworthy Human-AI Synergy in Software Engineering 2.02024 IEEE 32nd International Requirements Engineering Conference (RE)10.1109/RE59067.2024.00011(3-4)Online publication date: 24-Jun-2024
https://doi.org/10.1109/RE59067.2024.00011
Minani JSabir FMoha NGuéhéneuc Y(2024)A Multimethod Study of Internet of Things Systems Testing in IndustryIEEE Internet of Things Journal10.1109/JIOT.2023.329123311:1(1662-1684)Online publication date: 1-Jan-2024
https://doi.org/10.1109/JIOT.2023.3291233
Santos LSousa NGomes LGarcia JFerreira F(2023)An experiment on software test creation: can EvoSuite help test teaching?Proceedings of the XXII Brazilian Symposium on Software Quality10.1145/3629479.3629499(281-290)Online publication date: 7-Nov-2023
https://dl.acm.org/doi/10.1145/3629479.3629499
Show More Cited By

Index Terms

What industry wants from academia in software testing?: Hearing practitioners' opinions
1. Social and professional topics
  1. Professional topics
    1. Computing industry
2. Software and its engineering
  1. Software creation and management
    1. Software verification and validation

Recommendations

Industry-academia collaborations in software engineering: An empirical analysis of challenges, patterns and anti-patterns in research projects
EASE '17: Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering

Research collaboration between industry and academia supports improvement and innovation in industry and helps to ensure industrial relevance in academic research. However, many researchers and practitioners believe that the level of joint industry-...
Exploring the industry's challenges in software testing: An empirical study
Abstract Context
Software testing is an important and costly software engineering activity in the industry. Despite the efforts of the software testing research community in the last several decades, various studies show that still many practitioners in the ...
Characterizing industry-academia collaborations in software engineering: evidence from 101 projects

Research collaboration between industry and academia supports improvement and innovation in industry and helps ensure the industrial relevance of academic research. However, many researchers and practitioners in the community believe that the level of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

EASE '17: Proceedings of the 21st International Conference on Evaluation and Assessment in Software Engineering

June 2017

405 pages

ISBN:9781450348041

DOI:10.1145/3084226

Conference Chair:
Emilia Mendes,
Program Chairs:
Steve Counsell,
Kai Petersen

Copyright © 2017 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

In-Cooperation

School of Computing, BTH: Blekinge Institute of Technology - School of Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 June 2017

Check for updates

Author Tags

Qualifiers

Extended-abstract
Research
Refereed limited

Conference

EASE'17

EASE'17: Evaluation and Assessment in Software Engineering

June 15 - 16, 2017

Karlskrona, Sweden

Acceptance Rates

Overall Acceptance Rate 71 of 232 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

39
Total Citations
View Citations
531
Total Downloads

Downloads (Last 12 months)53
Downloads (Last 6 weeks)6

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Lo D(2024)Requirements Engineering for Trustworthy Human-AI Synergy in Software Engineering 2.02024 IEEE 32nd International Requirements Engineering Conference (RE)10.1109/RE59067.2024.00011(3-4)Online publication date: 24-Jun-2024
https://doi.org/10.1109/RE59067.2024.00011
Minani JSabir FMoha NGuéhéneuc Y(2024)A Multimethod Study of Internet of Things Systems Testing in IndustryIEEE Internet of Things Journal10.1109/JIOT.2023.329123311:1(1662-1684)Online publication date: 1-Jan-2024
https://doi.org/10.1109/JIOT.2023.3291233
Santos LSousa NGomes LGarcia JFerreira F(2023)An experiment on software test creation: can EvoSuite help test teaching?Proceedings of the XXII Brazilian Symposium on Software Quality10.1145/3629479.3629499(281-290)Online publication date: 7-Nov-2023
https://dl.acm.org/doi/10.1145/3629479.3629499
Zhang MArcuri ALi YLiu YXue K(2023)White-Box Fuzzing RPC-Based APIs with EvoMaster: An Industrial Case StudyACM Transactions on Software Engineering and Methodology10.1145/358500932:5(1-38)Online publication date: 21-Jul-2023
https://dl.acm.org/doi/10.1145/3585009
Fulcini TCoppola RArdito LTorchiano M(2023)A Review on Tools, Mechanics, Benefits, and Challenges of Gamified Software TestingACM Computing Surveys10.1145/358227355:14s(1-37)Online publication date: 10-Feb-2023
https://dl.acm.org/doi/10.1145/3582273
Ardic BZaidman A(2023)Hey Teachers, Teach Those Kids Some Software Testing2023 IEEE/ACM 5th International Workshop on Software Engineering Education for the Next Generation (SEENG)10.1109/SEENG59157.2023.00007(9-16)Online publication date: May-2023
https://doi.org/10.1109/SEENG59157.2023.00007
Arcuri AZhang MGolmohammadi ABelhadi AGaleotti JMarculescu BSeran S(2023)EMB: A Curated Corpus of Web/Enterprise Applications And Library Support for Software Testing Research2023 IEEE Conference on Software Testing, Verification and Validation (ICST)10.1109/ICST57152.2023.00047(433-442)Online publication date: Apr-2023
https://doi.org/10.1109/ICST57152.2023.00047
Yahaya NYusop NRosli M(2023)Is Human Factors Being Studied in Software Testing?: Review of the Literature2023 IEEE 8th International Conference on Recent Advances and Innovations in Engineering (ICRAIE)10.1109/ICRAIE59459.2023.10468409(1-6)Online publication date: 2-Dec-2023
https://doi.org/10.1109/ICRAIE59459.2023.10468409
Suh TMoradi M(2023)Transferring in-store experience to online: An omnichannel strategy for DIY customers’ enhanced brand resonance and co-creative actionsJournal of Business Research10.1016/j.jbusres.2023.114237168(114237)Online publication date: Nov-2023
https://doi.org/10.1016/j.jbusres.2023.114237
Golmohammadi AZhang MArcuri A(2023).NET/C# instrumentation for search-based software testingSoftware Quality Journal10.1007/s11219-023-09645-131:4(1439-1465)Online publication date: 1-Sep-2023
https://doi.org/10.1007/s11219-023-09645-1
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents