Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3530019.3535306acmotherconferencesArticle/Chapter ViewAbstractPublication PageseaseConference Proceedingsconference-collections
research-article

How Experimentation in Software Engineering has been taught? Survey and Research Agenda

Published: 13 June 2022 Publication History

Abstract

[Background:] Experimentation in Software Engineering (ESE) has increased in the last several years as a way to provide evidence by using statistical techniques. These techniques contribute to an auditable and reliable body of knowledge towards evolving a given topic. Therefore, teaching ESE becomes an essential task while disseminating and establishing an experimental culture to both academia and industry. [Aims:] In this paper we seek to understand how ESE has been taught including contents, materials used, strategies employed, and evaluation method applied. We also provide a research agenda on the subject. [Method:] We conducted a web-based questionnaire survey with 31 instructors who teach ESE. [Results:] We see several aspects, such as: ESE is mainly taught in an exclusive course; most of the materials used to teach ESE concepts are from third parties and some of them themselves; most people do not use any type of license; the core materials used to define the content of the courses are papers and books; learning management systems are most often used to share materials with students; key learning practices used are active learning, project-based learning, and problem-based learning; and most instructors assess their students with experimental projects and seminars. Based on such results, we provide and discuss a research agenda to improve teaching of ESE. [Conclusions:] This survey provides results towards planning a research agenda to improve teaching of ESE, thus benefiting instructors, researchers, and practitioners.

References

[1]
Nergiz Ercil Cagiltay. 2007. Teaching software engineering by means of computer-game development: Challenges and opportunities. British Journal of Educational Technology 38, 3 (2007), 405–415.
[2]
Jeffrey C Carver, Letizia Jaccheri, Sandro Morasca, and Forrest Shull. 2010. A checklist for integrating student empirical studies with research and teaching goals. Empirical Software Engineering 15, 1 (2010), 35–59.
[3]
Deepak Dahiya. 2010. Teaching software engineering: A practical approach. ACM SIGSOFT Software Engineering Notes 35, 2 (2010), 1–5.
[4]
A. Fabijan, P. Dmitriev, H. H. Olsson, and J. Bosch. 2017. The Evolution of Continuous Experimentation in Software Product Development: From Data to a Data-Driven Organization at Scale. In ICSE. 770–780.
[5]
David Forsyth. 2018. Probability and Statistics for Computer Science (1st. ed.). Springer Publishing Company, New York, NY.
[6]
Michael Gnatz, Leonid Kof, Franz Prilmeier, and Tilman Seifert. 2003. A practical approach of teaching software engineering. In CSEE&T. IEEE, 120–128.
[7]
Jesús M. González-Barahona and Gregorio Robles. 2012. On the reproducibility of empirical software engineering studies based on data retrieved from development repositories. Emp. Soft. Eng. 17, 1 (2012), 75–89.
[8]
M. Host. 2002. Introducing Empirical Software Engineering Methods in Education. In CSEE&T. 170–179.
[9]
Natalia Juristo and Ana M Moreno. 2010. Basics of Software Engineering Experimentation. Springer Publishing Company.
[10]
M. Kuhrmann. 2017. Teaching Empirical Software Engineering Using Expert Teams. In 15th Workshop on Software Engineering. 20–31.
[11]
Marco Kuhrmann and Jürgen Münch. 2018. Enhancing software engineering education through experimentation: an experience report. In ICE/ITMC. 1–9.
[12]
Johan Linåker, Sardar Muhammad Sulaman, Rafael Maiani de Mello, and Martin Höst. 2015. Guidelines for Conducting Surveys in Software Engineering. Technical Report 1.1. Lund University, Sweden.
[13]
Daniel Mendez, Daniel Graziotin, Stefan Wagner, and Heidi Seibold. 2020. Open Science in Software Engineering. Springer International Publishing, 477–501.
[14]
National Academies of Sciences, Engineering, and Medicine. 2018. Open Science by Design: Realizing a Vision for 21st Century Research. National Academies Press.
[15]
Sofia Ouhbi and Nuno Pombo. 2020. Software Engineering Education: Challenges and Perspectives. In 2020 IEEE Global Engineering Education Conference (EDUCON). 202–209. https://doi.org/10.1109/EDUCON45650.2020.9125353
[16]
D Rodriguez. 2005. Empirical software engineering research: epistemological and ontological foundations. In ONTOSE.
[17]
Halil Ibrahim Saglam. 2011. An Investigation on Teaching Materials Used in Social Studies Lesson.Turkish Online J. Educ. Tech. 10, 1 (2011), 36–44.
[18]
A. Santos, O. S. Gomez, and N. Juristo. 2018. Analyzing Families of Experiments in SE: a Systematic Mapping Study. IEEE Trans. Soft. Eng. 46, 5 (2018), 566–583.
[19]
Rodrigo Santos, Cláudia Werner, Heitor Costa, Ramon Abílio, and Hudson Borges. 2012. Managing reusable learning objects and experience reports in EduSE portal. In International Conference on Information Reuse Integration. 631–638.
[20]
Dag IK Sjøberg, Jo Erskine Hannay, Ove Hansen, Vigdis By Kampenes, Amela Karahasanovic, N-K Liborg, and Anette C Rekdal. 2005. A survey of controlled experiments in software engineering. IEEE Trans. Soft. Eng. 31, 9 (2005), 733–753.
[21]
Claes Wohlin. 2007. Empirical Software Engineering: Teaching Methods and Conducting Studies. Springer Berlin Heidelberg, Berlin, Heidelberg, 135–142.
[22]
C. Wohlin, P. Runeson, M. Höst, C. Ohlsson, B. Regnell, and A. Wesslén. 2012. Experimentation in software engineering(2nd. ed.). Springer.

Cited By

View all
  • (2023)Gamification Project to Receive Continuous Feedback in the Context of the Evolution of Public Service for Lawyers2023 IEEE Frontiers in Education Conference (FIE)10.1109/FIE58773.2023.10343441(1-8)Online publication date: 18-Oct-2023

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
EASE '22: Proceedings of the 26th International Conference on Evaluation and Assessment in Software Engineering
June 2022
466 pages
ISBN:9781450396134
DOI:10.1145/3530019
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 June 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Controlled Experiments
  2. Experimentation in Software Engineering
  3. Research Agenda
  4. Survey
  5. Teaching

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

  • CAPES/Brazil

Conference

EASE 2022

Acceptance Rates

Overall Acceptance Rate 71 of 232 submissions, 31%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)28
  • Downloads (Last 6 weeks)1
Reflects downloads up to 22 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2023)Gamification Project to Receive Continuous Feedback in the Context of the Evolution of Public Service for Lawyers2023 IEEE Frontiers in Education Conference (FIE)10.1109/FIE58773.2023.10343441(1-8)Online publication date: 18-Oct-2023

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media