research-article

A Multivocal Literature Review on the use of DevOps for e-Learning systems

Authors:

Mary Sánchez-Gordón,

Ricardo Colomo-PalaciosAuthors Info & Claims

TEEM'18: Proceedings of the Sixth International Conference on Technological Ecosystems for Enhancing Multiculturality

Pages 883 - 888

https://doi.org/10.1145/3284179.3284328

Published: 24 October 2018 Publication History

Abstract

DevOps is an approach to reduce software development times by integrating a set of tools in order to get a better and automated transition towards production. DevOps is highly connected to tools and to Cloud Computing. On the other hand, e-Learning tools are also evolving towards the cloud. In this scenario, the connection of this two research fields seems to be promising. However, to the best of authors' knowledge the interaction of both has not been studied in deep. To bridge this gap, in this paper, a multivocal literature review is presented. By means of this systematic approach, authors analyze scientific and professional literature on the topic. Results reveal a nascent but still modest interest in DevOps in e-Learning solutions. Authors believe that the increasing adoption of cloud e-Learning solutions and the increasing pressure to deploy new versions of software with boost the interest in this research field.

References

[1]

Airaj, M. Enable cloud DevOps approach for industry and higher education. Concurrency and Computation: Practice and Experience. 29, 5, e3937.

[2]

Bruneo, D. et al. 2014. CloudWave: Where adaptive cloud management meets DevOps. 2014 IEEE Symposium on Computers and Communications (ISCC) (Jun. 2014), 1--6.

[3]

Bulman, G. and Fairlie, R.W. 2016. Chapter 5 - Technology and Education: Computers, Software, and the Internet. Handbook of the Economics of Education. E.A. Hanushek, S. Machin, and L. Woessmann, eds. Elsevier. 239--280.

[4]

Colomo-Palacios, R., Fernandes, E., Soto-Acosta, P. and Larrucea, X. 2018. A case analysis of enabling continuous software deployment through knowledge management. International Journal of Information Management. (2018).

Digital Library

[5]

Debois, P. 2011. Devops: A Software Revolution in the Making? Cutter Business Technology Journal. 24, 8 (2011).

[6]

Ebert, C., Gallardo, G., Hernantes, J. and Serrano, N. 2016. DevOps. IEEE Software. 33, 3 (2016), 94--100.

Digital Library

[7]

Fitzgerald, B. and Stol, K.-J. 2014. Continuous Software Engineering and Beyond: Trends and Challenges. Proceedings of the 1st International Workshop on Rapid Continuous Software Engineering (New York, NY, USA, 2014), 1--9.

Digital Library

[8]

Garousi, V. and Mäntylä, M.V. 2016. A systematic literature review of literature reviews in software testing. Information and Software Technology. 80, (Dec. 2016), 195--216.

Digital Library

[9]

Ibrahim, M.S., Salleh, N. and Misra, S. 2015. Empirical Studies of Cloud Computing in Education: A Systematic Literature Review. Computational Science and Its Applications -- ICCSA 2015. Springer, Cham. 725--737.

Digital Library

[10]

Ikerionwu, C. and Edgar, D. 2016. DevOps: Introducing Agility and Flexibility to BPO-IT Organisations -- Service Providers' Perspective. Software Engineering. 4, 5 (Dec. 2016), 65.

[11]

Islam, A.K.M.N. 2016. E-learning system use and its outcomes: Moderating role of perceived compatibility. Telematics and Informatics. 33, 1 (Feb. 2016), 48--55.

Digital Library

[12]

Jabbari, R., bin Ali, N., Petersen, K. and Tanveer, B. 2016. What is DevOps?: A Systematic Mapping Study on Definitions and Practices. Proceedings of the Scientific Workshop Proceedings of XP2016 (2016), 12.

Digital Library

[13]

Jafari Navimipour, N. and Zareie, B. 2015. A model for assessing the impact of e-learning systems on employees' satisfaction. Computers in Human Behavior. 53, (Dec. 2015), 475--485.

Digital Library

[14]

Jayasena, K.P.N. and Song, H. 2017. Private Cloud with e-Learning for Resources Sharing in University Environment. E-Learning, E-Education, and Online Training. Springer, Cham. 169--180.

[15]

Kitchenham, B. and Charters, S. 2007. Guidelines for performing Systematic Literature Reviews in Software Engineering (version 2.3). Keele University and Durham University.

[16]

Lara, J.A., Lizcano, D., Martínez, M.A., Pazos, J. and Riera, T. 2014. A system for knowledge discovery in e-learning environments within the European Higher Education Area -- Application to student data from Open University of Madrid, UDIMA. Computers & Education. 72, (Mar. 2014), 23--36.

[17]

Larrucea, X., Santamaria, I., Colomo-Palacios, R. and Ebert, C. 2018. Microservices. IEEE Software. 35, 3 (May 2018), 96--100.

[18]

Myrbakken, H. avard and Colomo-Palacios, R. 2017. DevSecOps: A Multivocal Literature Review. International Conference on Software Process Improvement and Capability Determination (2017), 17--29.

[19]

Ogawa, R.T. and Malen, B. 1991. Towards Rigor in Reviews of Multivocal Literatures: Applying the Exploratory Case Study Method. Review of Educational Research. 61, 3 (Sep. 1991), 265--286.

[20]

Riungu-Kalliosaari, L., Mäkinen, S., Lwakatare, L.E., Tiihonen, J. and Männistö, T. 2016. DevOps adoption benefits and challenges in practice: a case study. International Conference on Product-Focused Software Process Improvement (2016), 590--597.

[21]

Stahl, D., Martensson, T. and Bosch, J. 2017. Continuous practices and devops: beyond the buzz, what does it all mean? Software Engineering and Advanced Applications (SEAA), 2017 43rd Euromicro Conference on (2017), 440--448.

[22]

Takashi Nakamura, W., Harada Teixeira de Oliveira, E. and Conte, T. 2017. Usability and User Experience Evaluation of Learning Management Systems - A Systematic Mapping Study: (2017), 97--108.

[23]

Velicanu, A., Lungu, I., Diaconita, V. and Nisioiu, C. 2013. Cloud E-Learning. ("Carol I" National Defence Universit, 2013), 380--385.

Cited By

Azad NHyrynsalmi S(2024)Multivocal Literature Review on DevOps Critical Success FactorsProceedings of the 28th International Conference on Evaluation and Assessment in Software Engineering10.1145/3661167.3661236(520-527)Online publication date: 18-Jun-2024
https://dl.acm.org/doi/10.1145/3661167.3661236
Deshpande GCheekati SPatel SRaj PSingh MPindur MAl Soghyar NZhao BBabolhavaeji PTaher MNathan KSpaeth WRoozbahani MJoyner DKim MWang XXia M(2024)Transforming CS Education with DevOps: Streamlined Assignment Validation and Delivery @ ScaleProceedings of the Eleventh ACM Conference on Learning @ Scale10.1145/3657604.3664676(259-264)Online publication date: 9-Jul-2024
https://dl.acm.org/doi/10.1145/3657604.3664676
Neupane RCalyam PWang SNeupane KPandey ACheng XGafurov DYeddulapalli HGlaser NSingh KGu YLi SSrinivas S(2024)Online Self-Service Learning Platform for Application-Inspired Cloud Development and Operations (DevOps) CurriculumIEEE Transactions on Learning Technologies10.1109/TLT.2024.342884217(1946-1960)Online publication date: 2024
https://doi.org/10.1109/TLT.2024.3428842
Show More Cited By

Index Terms

A Multivocal Literature Review on the use of DevOps for e-Learning systems
1. Applied computing
  1. Education
    1. E-learning
2. Software and its engineering
  1. Software creation and management
    1. Collaboration in software development

Recommendations

Characterizing DevOps by Hearing Multiple Voices
SBES '16: Proceedings of the XXX Brazilian Symposium on Software Engineering

Recently, DevOps has emerged as an alternative for software organizations inserted into a dynamic market to handle daily software demands. As claimed, it intends to make the software development and operations teams to work collaboratively. However, it ...
Multivocal Literature Review on DevOps Critical Success Factors
EASE '24: Proceedings of the 28th International Conference on Evaluation and Assessment in Software Engineering

DevOps is a methodology that seeks to unify development and operations teams in organizations, aiming to facilitate faster software delivery and promote collaboration to build a positive company culture. Our research aims to investigate the current ...
DevOps Job Roles: A Multivocal Literature Review
Computational Science and Its Applications – ICCSA 2021
Abstract
DevOps bridges the gap between software development and operations to provide rapid deliveries and integrated collaboration. However, DevOps entails lots of factors and challenges involved in its implementation including technical, organizational ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

TEEM'18: Proceedings of the Sixth International Conference on Technological Ecosystems for Enhancing Multiculturality

October 2018

1072 pages

ISBN:9781450365185

DOI:10.1145/3284179

Editor:
Francisco José García-Peñalvo
University of Salamanca

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

University of Salamanca: University of Salamanca

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 October 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

TEEM'18

TEEM'18: Sixth International Conference on Technological Ecosystems for Enhancing Multiculturality

October 24 - 26, 2018

Salamanca, Spain

Acceptance Rates

TEEM'18 Paper Acceptance Rate 151 of 243 submissions, 62%;

Overall Acceptance Rate 496 of 705 submissions, 70%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
372
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Azad NHyrynsalmi S(2024)Multivocal Literature Review on DevOps Critical Success FactorsProceedings of the 28th International Conference on Evaluation and Assessment in Software Engineering10.1145/3661167.3661236(520-527)Online publication date: 18-Jun-2024
https://dl.acm.org/doi/10.1145/3661167.3661236
Deshpande GCheekati SPatel SRaj PSingh MPindur MAl Soghyar NZhao BBabolhavaeji PTaher MNathan KSpaeth WRoozbahani MJoyner DKim MWang XXia M(2024)Transforming CS Education with DevOps: Streamlined Assignment Validation and Delivery @ ScaleProceedings of the Eleventh ACM Conference on Learning @ Scale10.1145/3657604.3664676(259-264)Online publication date: 9-Jul-2024
https://dl.acm.org/doi/10.1145/3657604.3664676
Neupane RCalyam PWang SNeupane KPandey ACheng XGafurov DYeddulapalli HGlaser NSingh KGu YLi SSrinivas S(2024)Online Self-Service Learning Platform for Application-Inspired Cloud Development and Operations (DevOps) CurriculumIEEE Transactions on Learning Technologies10.1109/TLT.2024.342884217(1946-1960)Online publication date: 2024
https://doi.org/10.1109/TLT.2024.3428842
Rahman ABose DBarsha FPandita R(2023)Defect Categorization in Compilers: A Multi-vocal Literature ReviewACM Computing Surveys10.1145/362631356:4(1-42)Online publication date: 10-Nov-2023
https://dl.acm.org/doi/10.1145/3626313
Amaro RPereira Rda Silva M(2023)Capabilities and Practices in DevOps: A Multivocal Literature ReviewIEEE Transactions on Software Engineering10.1109/TSE.2022.316662649:2(883-901)Online publication date: 1-Feb-2023
https://doi.org/10.1109/TSE.2022.3166626
Amaro RPereira Rda Silva M(2023)Capabilities and metrics in DevOpsInformation and Management10.1016/j.im.2023.10380960:5Online publication date: 1-Jul-2023
https://dl.acm.org/doi/10.1016/j.im.2023.103809
Papakonstantinou NHale BLinnosmaa JSalonen JBossuyt D(2022)Model Driven Engineering for Resilience of Systems with Black Box and AI-based Components2022 Annual Reliability and Maintainability Symposium (RAMS)10.1109/RAMS51457.2022.9893930(1-7)Online publication date: 24-Jan-2022
https://doi.org/10.1109/RAMS51457.2022.9893930
Ahmed WColomo-Palacios R(2021)Team Topologies in Software Teams: A Multivocal Literature ReviewComputational Science and Its Applications – ICCSA 202110.1007/978-3-030-87013-3_21(272-282)Online publication date: 10-Sep-2021
https://doi.org/10.1007/978-3-030-87013-3_21
Lie MSánchez-Gordón MColomo-Palacios R(2020)DevOps in an ISO 13485 Regulated EnvironmentProceedings of the 14th ACM / IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM)10.1145/3382494.3410679(1-11)Online publication date: 5-Oct-2020
https://dl.acm.org/doi/10.1145/3382494.3410679
Mishra AOtaiwi Z(2020)DevOps and software qualityComputer Science Review10.1016/j.cosrev.2020.10030838:COnline publication date: 1-Nov-2020
https://dl.acm.org/doi/10.1016/j.cosrev.2020.100308
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents