Article

Systematic mapping studies in software engineering

Authors:

Shahid Mujtaba,

Michael MattssonAuthors Info & Claims

EASE'08: Proceedings of the 12th international conference on Evaluation and Assessment in Software Engineering

Pages 68 - 77

Published: 26 June 2008 Publication History

Abstract

BACKGROUND: A software engineering systematic map is a defined method to build a classification scheme and structure a software engineering field of interest. The analysis of results focuses on frequencies of publications for categories within the scheme. Thereby, the coverage of the research field can be determined. Different facets of the scheme can also be combined to answer more specific research questions.

OBJECTIVE: We describe how to conduct a systematic mapping study in software engineering and provide guidelines. We also compare systematic maps and systematic reviews to clarify how to chose between them. This comparison leads to a set of guidelines for systematic maps.

METHOD: We have defined a systematic mapping process and applied it to complete a systematic mapping study. Furthermore, we compare systematic maps with systematic reviews by systematically analyzing existing systematic reviews.

RESULTS: We describe a process for software engineering systematic mapping studies and compare it to systematic reviews. Based on this, guidelines for conducting systematic maps are defined.

CONCLUSIONS: Systematic maps and reviews are different in terms of goals, breadth, validity issues and implications. Thus, they should be used complementarily and require different methods (e.g., for analysis).

References

[1]

Bailey, J., Budgen, D., Turner, M., Kitchenham, B., Brereton, P. & Linkman, S. (2007), Evidence relating to object-oriented software design: A survey, in 'Proc. of the 1st Int. Symp. on Empirical Software Engineering and Measurement (ESEM 2007)', pp. 482-484.

[2]

Budgen, D., Kitchenham, B., Charters, S., Turner, M., Brereton, P. & Linjkman, S. (2007), Preliminary results of a study of the completeness and clarity of structured abstracts, in 'Proc. of the 11th Int. Conf. on Evaluation and Assessment in Software Engineering 2007', pp. 64- 72.

[3]

Davis, A. M., Tubío, Ó. D., Hickey, A. M., Juzgado, N. J. & Moreno, A. M. (2006), Effectiveness of requirements elicitation techniques: Empirical results derived from a systematic review, in 'Proc. of the 15th Int. Conf. on Requirements Engineering (RE 2006)', pp. 176-185.

[4]

Dixon-Woods, M., Agarwal, S., Jones, D., Young, B. & Sutton, A. (2005), 'Synthesising qualitative and quantitative evidence: a review of possible methods.', Journal of Health Services Research and Policy 10(1), 45-53.

[5]

Dybå, T., Kampenes, V. B. & Sjøberg, D. I. K. (2006), 'A systematic review of statistical power in software engineering experiments', Information & Software Technology 48(8), 745-755.

[6]

Glass, R. L., Vessey, I. & Ramesh, V. (2002), 'Research in software engineering: an analysis of the literature', Information & Software Technology 44(8), 491-506.

[7]

Grimstad, S., Jørgensen, M. & Moløkken-Østvold, K. (2006), 'Software effort estimation terminology: The tower of babel', Information & Software Technology 48(4), 302-310.

[8]

Hannay, J. E., Sjøberg, D. I. K. & Dybå, T. (2007), 'A systematic review of theory use in software engineering experiments', IEEE Trans. Software Eng. 33(2), 87-107.

[9]

Jørgensen, M. & Shepperd, M. J. (2007), 'A systematic review of software development cost estimation studies', IEEE Trans. Software Eng. 33(1), 33-53.

[10]

Kampenes, V. B., Dybå, T., Hannay, J. E. & Sjøberg, D. I. K. (2007), 'Systematic review: A systematic review of effect size in software engineering experiments', Information & Software Technology 49(11-12), 1073-1086.

[11]

Kitchenham, B. (2007), 'The current state of evidence-based software engineering. keynote int. conf. on evaluation and assessment in software engineering (2007)'.

[12]

Kitchenham, B. A., Dyba, T. & Jorgensen, M. (2004), Evidence-based software engineering, in 'Proc. of the 26th Int. Conf. on Software Engineering (ICSE 2006)', IEEE Computer Society, pp. 273-281.

[13]

Kitchenham, B. A., Mendes, E. & Travassos, G. H. (2007), 'Cross versus within-company cost estimation studies: A systematic review', IEEE Trans. Software Eng. 33(5), 316-329.

[14]

Kitchenham, B. & Charters, S. (2007), Guidelines for performing systematic literature reviews in software engineering, Technical Report EBSE-2007-01, School of Computer Science and Mathematics, Keele University.

[15]

MacDonell, S. G. & Shepperd, M. J. (2007), Comparing local and global software effort estimation models - reflections on a systematic review, in 'Proc. of the 1st Int. Symp. on Empirical Software Engineering and Measurement (ESEM 2007)', pp. 401-409.

[16]

Mendes, E. (2005), A systematic review of web engineering research, in 'Proc. of the Int. Symp. on Empirical Software Engineering (ISESE 2005)', pp. 498-507.

[17]

Mujtaba, S., Petersen, K., Feldt, R. & Mattsson, M. (2008), Software product line variability: A systematic mapping study, in 'submission'.

[18]

Sjøberg, D. I. K., Hannay, J. E., Hansen, O., Kampenes, V. B., Karahasanovic, A., Liborg, N.-K. & Rekdal, A. C. (2005), 'A survey of controlled experiments in software engineering', IEEE Trans. Software Eng. 31(9), 733-753.

[19]

Wieringa, R., Maiden, N. A. M., Mead, N. R. & Rolland, C. (2006), 'Requirements engineering paper classification and evaluation criteria: a proposal and a discussion', Requir. Eng. 11(1), 102-107.

Cited By

Truger FBarzen JBechtold MBeisel MLeymann FMandl AYussupov V(2024)Warm-Starting and Quantum Computing: A Systematic Mapping StudyACM Computing Surveys10.1145/365251056:9(1-31)Online publication date: 13-Mar-2024
https://dl.acm.org/doi/10.1145/3652510
Curasma HEstrella J(2023)Reactive Software Architectures in IoTProceedings of the 2023 International Conference on Research in Adaptive and Convergent Systems10.1145/3599957.3606212(1-8)Online publication date: 6-Aug-2023
https://dl.acm.org/doi/10.1145/3599957.3606212
Priestley MO’donnell FSimperl E(2023)A Survey of Data Quality Requirements That Matter in ML Development PipelinesJournal of Data and Information Quality10.1145/359261615:2(1-39)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3592616
Show More Cited By

Recommendations

Conducting Systematic Literature Reviews and Systematic Mapping Studies
ISEC '17: Proceedings of the 10th Innovations in Software Engineering Conference

Context: An essential part of conducting software engineering (SE) research is the ability to identify extant research on tools, technologies, concepts and methods in order to evaluate and make rational and scientific decisions. The domain from which ...
Guidelines for snowballing in systematic literature studies and a replication in software engineering
EASE '14: Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering

Background: Systematic literature studies have become common in software engineering, and hence it is important to understand how to conduct them efficiently and reliably.

Objective: This paper presents guidelines for conducting literature reviews using ...
Guidelines for conducting systematic mapping studies in software engineering

ContextSystematic mapping studies are used to structure a research area, while systematic reviews are focused on gathering and synthesizing evidence. The most recent guidelines for systematic mapping are from 2008. Since that time, many suggestions have ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

EASE'08: Proceedings of the 12th international conference on Evaluation and Assessment in Software Engineering

June 2008

170 pages

Editors:
Giuseppe Visaggio
Department of Informatics, University of Bari, Italy
,
Maria Teresa Baldassarre
Department of Informatics, University of Bari, Italy
,
Steve Linkman
School of Computing and Mathematics, Keele University, UK
,
Mark Turner
School of Computing and Mathematics, Keele University, UK

Sponsors

THE IET: The Institution of Engineering and Technology
Svimservice: Svimservice
Cerit: Cerit
dib: dib
Software Engineering Research & Practices: Software Engineering Research & Practices

Publisher

BCS Learning & Development Ltd.

Swindon, United Kingdom

Publication History

Published: 26 June 2008

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

258
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Truger FBarzen JBechtold MBeisel MLeymann FMandl AYussupov V(2024)Warm-Starting and Quantum Computing: A Systematic Mapping StudyACM Computing Surveys10.1145/365251056:9(1-31)Online publication date: 13-Mar-2024
https://dl.acm.org/doi/10.1145/3652510
Curasma HEstrella J(2023)Reactive Software Architectures in IoTProceedings of the 2023 International Conference on Research in Adaptive and Convergent Systems10.1145/3599957.3606212(1-8)Online publication date: 6-Aug-2023
https://dl.acm.org/doi/10.1145/3599957.3606212
Priestley MO’donnell FSimperl E(2023)A Survey of Data Quality Requirements That Matter in ML Development PipelinesJournal of Data and Information Quality10.1145/359261615:2(1-39)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3592616
Kotti ZGalanopoulou RSpinellis D(2023)Machine Learning for Software Engineering: A Tertiary StudyACM Computing Surveys10.1145/357290555:12(1-39)Online publication date: 2-Mar-2023
https://dl.acm.org/doi/10.1145/3572905
Hasan MMuna F(2022)Technology Trends and Cyber Security in BangladeshInternational Journal of Technology Diffusion10.4018/IJTD.30438113:1(1-17)Online publication date: 8-Jul-2022
https://dl.acm.org/doi/10.4018/IJTD.304381
Chloros DGerogiannis VKakarontzas G(2022)Use of software and project management metrics in agile software development methodologiesProceedings of the 2022 European Symposium on Software Engineering10.1145/3571697.3571701(25-32)Online publication date: 27-Oct-2022
https://dl.acm.org/doi/10.1145/3571697.3571701
Ralph PBaltes SRoychoudhury ACadar CKim M(2022)Paving the way for mature secondary research: the seven types of literature reviewProceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3540250.3560877(1632-1636)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3540250.3560877
Sánchez JJörgensen NTörngren MInam RBerezovskyi AFeng LFersman ERamli MTan K(2022)Edge Computing for Cyber-physical Systems: A Systematic Mapping Study Emphasizing TrustworthinessACM Transactions on Cyber-Physical Systems10.1145/35396626:3(1-28)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3539662
Costa BBachiega Jde Carvalho LAraujo A(2022)Orchestration in Fog Computing: A Comprehensive SurveyACM Computing Surveys10.1145/348622155:2(1-34)Online publication date: 18-Jan-2022
https://dl.acm.org/doi/10.1145/3486221
Ciccozzi FAddazi LAsadollah SLisper BMasud AMubeen S(2022)A Comprehensive Exploration of Languages for Parallel ComputingACM Computing Surveys10.1145/348500855:2(1-39)Online publication date: 18-Jan-2022
https://dl.acm.org/doi/10.1145/3485008
Show More Cited By

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents