research-article

Industry application of continuous integration modeling: a multiple-case study

Authors:

Jan BoschAuthors Info & Claims

ICSE '16: Proceedings of the 38th International Conference on Software Engineering Companion

Pages 270 - 279

https://doi.org/10.1145/2889160.2889252

Published: 14 May 2016 Publication History

Abstract

The popular agile practice of continuous integration has become an essential part of the software development process in many companies, sometimes to the extent that delivery to customer is impossible without it. Due to this pivotal role it is an important field of research to better understand the practice: continuous integration system behavior, improvement identification and analysis of change impacts. This paper investigates the effects of modeling of such systems, by applying two continuous integration modeling techniques to four separate industry cases in three companies. These techniques are found to complement each other, and their ability to help professionals gain a better understanding of their continuous integration systems, to communicate around them and to support technical work is demonstrated. In addition, guidelines for conducting similar continuous integration modeling work are presented and feedback on the studied models provided. This work presents software professionals with demonstrably effective methods for design and analysis of continuous integration systems and thereby improving the efficacy of a vital part of their software development efforts, while supporting researchers with recommendations for and feedback on available modeling techniques.

References

[1]

S. Alyahya, W. K. Ivins, and W. Gray. Co-ordination support for managing progress of distributed agile projects. In Sixth IEEE International Conference on Global Software Engineering Workshop (ICGSEW), pages 31--34. IEEE, 2011.

Digital Library

[2]

C. Bartoszuk, G. Timoszuk, R. Dabrowski, and K. Stencel. On visual assessment of software quality. e-Informatica Software Engineering Journal, 8(1), 2014.

[3]

O. Beaumont, N. Bonichon, L. Courtès, X. Hanin, and E. Dolstra. Mixed data-parallel scheduling for distributed continuous integration. In 26th International Parallel and Distributed Processing Symposium Workshops & PhD Forum (IPDPSW), pages 91--98. IEEE, 2012.

Digital Library

[4]

T. D. Cook, D. T. Campbell, and A. Day. Quasi-experimentation: Design & analysis issues for field settings, volume 351. Houghton Mifflin Boston, 1979.

[5]

J. Downs, J. Hosking, and B. Plimmer. Status communication in agile software teams: A case study. In Fifth International Conference on Software Engineering Advances (ICSEA), pages 82--87. IEEE, 2010.

Digital Library

[6]

V. García-Díaz, B. C. Pelayo García-Bustelo, and J. M. Cueva Lovelle. Mdci: Model-driven continuous integration. Journal ofAmbient Intelligence and Smart Environments, 4(5):479--481, 2012.

Digital Library

[7]

B. Hoffman, D. Cole, and J. Vines. Software process for rapid development of hpc software using cmake. In DoD High Performance Computing Modernization Program Users Group Conference (HPCMP-UGC), pages 378--382. IEEE, 2009.

Digital Library

[8]

S. E. Hove and B. Anda. Experiences from conducting semi-structured interviews in empirical software engineering research. In 11th IEEE International Symposium on Software Metrics, pages 10-pp. IEEE, 2005.

Digital Library

[9]

B. Jiang, Z. Zhang, W. K. Chan, T. Tse, and T. Y. Chen. How well does test case prioritization integrate with statistical fault localization? Information and Software Technology, 54(7):739--758, 2012.

Digital Library

[10]

F. Khomh, T. Dhaliwal, Y. Zou, and B. Adams. Do faster releases improve software quality? an empirical case study of mozilla firefox. In 9th IEEE Working Conference on Mining Software Repositories (MSR), pages 179--188. IEEE, 2012.

Digital Library

[11]

E. H. Kim, J. C. Na, and S. M. Ryoo. Implementing an effective test automation framework. In 33rd Annual IEEE International Computer Software and Applications Conference (COMPSAC'09), volume 2, pages 534--538. IEEE, 2009.

Digital Library

[12]

S. Krusche and L. Alperowitz. Introduction of continuous delivery in multi-customer project courses. In Companion Proceedings of the 36th International Conference on Software Engineering, pages 335--343. ACM, 2014.

Digital Library

[13]

M. V. Mantyla, F. Khomh, B. Adams, E. Engstrom, and K. Petersen. On rapid releases and software testing. In 29th International Conference on Software Maintenance (ICSM), pages 20--29. IEEE, 2013.

Digital Library

[14]

M. Mossige, A. Gotlieb, and H. Meling. Using CP in automatic test generation for ABB Robotics - Paint Control System. In Principles and Practice of Constraint Programming, pages 25--41. Springer, 2014.

[15]

A. Nilsson, J. Bosch, and C. Berger. Visualizing testing activities to support continuous integration: A multiple case study. In Agile Processes in Software Engineering and Extreme Programming, pages 171--186. Springer, 2014.

Digital Library

[16]

N. Rathod and A. Surve. Test orchestration a framework for continuous integration and continuous deployment. In International Conference on Pervasive Computing (ICPC), pages 1--5. IEEE, 2015.

[17]

T. Remencius, A. Sillitti, and G. Succi. Using metric visualization and sharing tool to drive agile-related practices. In Agile Processes in Software Engineering and Extreme Programming, pages 255--256. Springer, 2009.

[18]

M. Roberts. Enterprise continuous integration using binary dependencies. In Extreme Programming and Agile Processes in Software Engineering, pages 194--201. Springer, 2004.

[19]

C. Robson. Real world research, pages 474--488. Blackwell publishers Oxford, 2002.

[20]

R. O. Rogers. Scaling continuous integration. In Extreme Programming and Agile Processes in Software Engineering, pages 68--76. Springer, 2004.

[21]

E. Rouillé, B. Combemale, O. Barais, D. Touzet, and J.-M. Jézéquel. Improving reusability in software process lines. In 39th EUROMICRO Conference on Software Engineering and Advanced Applications (SEAA), pages 90--93. IEEE, 2013.

Digital Library

[22]

P. Runeson and M. Höst. Guidelines for conducting and reporting case study research in software engineering. Empirical software engineering, 14(2):131--164, 2009.

Digital Library

[23]

Software Center. About Software Center. http://www.software-center.se/about-software-center, 2014. {Online; accessed 04-March-2015}.

[24]

D. Ståhl and J. Bosch. Experienced benefits of continuous integration in industry software product development: A case study. In The 12th IASTED International Conference on Software Engineering, (Innsbruck, Austria, 2013), pages 736--743, 2013.

[25]

D. Ståhl and J. Bosch. Automated software integration flows in industry. In The 36th International Conference on Software Engineering, (Hyderabad, India, 2014), pages 54--63, 2014.

Digital Library

[26]

D. Ståhl and J. Bosch. Modeling continuous integration practice differences in industry software development. Journal of Systems and Software, 87:48--59, 2014.

Digital Library

[27]

H. Yuksel, E. Tuzun, E. Gelirli, E. Biyikli, and B. Baykal. Using continuous integration and automated test techniques for a robust c4isr system. In 24th International Symposium on Computer and Information Sciences, pages 743--748. IEEE, 2009.

Cited By

Yin MKashiwa YGallaba KAlfadel MKamei YMcIntosh SFilkov VRay BZhou M(2024)Developer-Applied Accelerations in Continuous Integration: A Detection Approach and Catalog of PatternsProceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering10.1145/3691620.3695533(1655-1666)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3691620.3695533
Zeng ZXiao TLamothe MHata HMcintosh SSpinellis DConstantinou EBacchelli A(2024)A Mutation-Guided Assessment of Acceleration Approaches for Continuous Integration: An Empirical Study of YourBaseProceedings of the 21st International Conference on Mining Software Repositories10.1145/3643991.3644914(556-568)Online publication date: 15-Apr-2024
https://dl.acm.org/doi/10.1145/3643991.3644914
Jahić J(2024)SCATS Framework for Software Integration in Software-Defined Vehicle with Cross-Organizational Agile TeamsSoftware Architecture10.1007/978-3-031-70797-1_25(371-378)Online publication date: 1-Sep-2024
https://doi.org/10.1007/978-3-031-70797-1_25
Show More Cited By

Index Terms

Industry application of continuous integration modeling: a multiple-case study
1. Software and its engineering
  1. Software creation and management
    1. Designing software
      1. Software implementation planning
        Software design techniques
    2. Software development process management

Recommendations

Automated software integration flows in industry: a multiple-case study
ICSE Companion 2014: Companion Proceedings of the 36th International Conference on Software Engineering

There is a steadily increasing interest in the agile practice of continuous integration. Consequently, there is great diversity in how it is interpreted and implemented, and a need to study, document and analyze how automated software integration flows ...
Tailoring MDevSPICE® for mobile medical apps
ICSSP '16: Proceedings of the International Conference on Software and Systems Process

Mobile medical apps play an important role within the healthcare industry. Developers of mobile medical apps need to understand what is required when a mobile application fulfils the definition of a medical device. Such applications have to be developed ...
Modeling continuous integration practice differences in industry software development

Continuous integration is a software practice where developers integrate frequently, at least daily. While this is an ostensibly simple concept, it does leave ample room for interpretation: what is it the developers integrate with, what happens when ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICSE '16: Proceedings of the 38th International Conference on Software Engineering Companion

May 2016

946 pages

ISBN:9781450342056

DOI:10.1145/2889160

General Chair:
Laura Dillon
Michigan State University
,
Program Chairs:
Willem Visser
Stellenbosch University, South Africa
,
Laurie Williams
North Carolina State University

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

ACM: Association for Computing Machinery
SIGSOFT: ACM Special Interest Group on Software Engineering
IEEE-CS\TCSE: TC on Software Engineering
IEEE-CS\DATC: IEEE Computer Society

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 May 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICSE '16

Sponsor:

ACM
SIGSOFT
IEEE-CS\TCSE
IEEE-CS\DATC

ICSE '16: 38th International Conference on Software Engineering

May 14 - 22, 2016

Texas, Austin

Acceptance Rates

Overall Acceptance Rate 276 of 1,856 submissions, 15%

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

35
Total Citations
View Citations
444
Total Downloads

Downloads (Last 12 months)22
Downloads (Last 6 weeks)1

Reflects downloads up to 03 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Yin MKashiwa YGallaba KAlfadel MKamei YMcIntosh SFilkov VRay BZhou M(2024)Developer-Applied Accelerations in Continuous Integration: A Detection Approach and Catalog of PatternsProceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering10.1145/3691620.3695533(1655-1666)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3691620.3695533
Zeng ZXiao TLamothe MHata HMcintosh SSpinellis DConstantinou EBacchelli A(2024)A Mutation-Guided Assessment of Acceleration Approaches for Continuous Integration: An Empirical Study of YourBaseProceedings of the 21st International Conference on Mining Software Repositories10.1145/3643991.3644914(556-568)Online publication date: 15-Apr-2024
https://dl.acm.org/doi/10.1145/3643991.3644914
Jahić J(2024)SCATS Framework for Software Integration in Software-Defined Vehicle with Cross-Organizational Agile TeamsSoftware Architecture10.1007/978-3-031-70797-1_25(371-378)Online publication date: 1-Sep-2024
https://doi.org/10.1007/978-3-031-70797-1_25
Li YZhang HLiu BDong LGong HRong G(2023)Verification and validation of software process simulation models: A systematic mapping studyJournal of Software: Evolution and Process10.1002/smr.2612Online publication date: 19-Oct-2023
https://doi.org/10.1002/smr.2612
Staron M(2022)Introduction to the Metrics ThemeAccelerating Digital Transformation10.1007/978-3-031-10873-0_9(155-161)Online publication date: 20-Oct-2022
https://doi.org/10.1007/978-3-031-10873-0_9
Jongeling RCiccozzi FCicchetti ACarlson J(2022)Chapter 6 Lightweight Consistency Checking for Agile Model-Based Development in PracticeAccelerating Digital Transformation10.1007/978-3-031-10873-0_8(131-151)Online publication date: 20-Oct-2022
https://doi.org/10.1007/978-3-031-10873-0_8
Berger CEklund U(2022)Chapter 5 Expectations and Challenges from Scaling Agile in Mechatronics-Driven Companies – A Comparative Case StudyAccelerating Digital Transformation10.1007/978-3-031-10873-0_7(119-130)Online publication date: 20-Oct-2022
https://doi.org/10.1007/978-3-031-10873-0_7
Martini ABesker TBosch J(2022)Chapter 4 Technical Debt Tracking: Current State of Practice: A Survey and Multiple Case Study in 15 Large OrganizationsAccelerating Digital Transformation10.1007/978-3-031-10873-0_6(87-118)Online publication date: 20-Oct-2022
https://doi.org/10.1007/978-3-031-10873-0_6
Berger CCarlson J(2022)Introduction to the Continuous Architecture ThemeAccelerating Digital Transformation10.1007/978-3-031-10873-0_5(85-86)Online publication date: 20-Oct-2022
https://doi.org/10.1007/978-3-031-10873-0_5
Mårtensson TStåhl DMartini ABosch J(2022)Chapter 3 Efficient and Effective Exploratory Testing of Large-Scale Software SystemsAccelerating Digital Transformation10.1007/978-3-031-10873-0_4(51-81)Online publication date: 20-Oct-2022
https://doi.org/10.1007/978-3-031-10873-0_4
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents