Abstract
Multimedia tutorials are more and more considered for online professional training as a valuable complement to traditional in presence training. Indeed, video and pictures can offer rich detail, show relevant context, and provide concrete visualisations of key concepts. An important aspect of achieving effective learning is to create an engaging experience for the learner. This can be obtained by increasing the level of interactivity required to the students, keeping them active and interested. However, there are different categories of interactive video, and what type of interactivity works best for online training needs to be systematically investigated. Moreover, the effort in developing such multimedia tutorials by instructional designers should be sustainable to enable large scale adoption. This calls for the development of appropriate methods and tools to support authors and teachers from the conception of an exercise to its deployment and evolution. These challenges have been addressed in the context of an industrial innovation project called ELEVATE (E-LEarning with Virtual interAcTive Experience). In order to collect empirical evidence on what type of interactive multimedia exercise could be effective in training, we performed an experiment to compare online training exercises based on linear videos with ones based on interactive videos having a graph-structure. Meanwhile, prototypes of the ELEVATE tool suite were being developed and validated in an iterative approach, by adding advanced features, such as those enabling the production of customisable exercises. In this paper, we present the design of the experiment and an execution with sixteen subjects, which provided useful results. The ELEVATE tool suite and the companion methodology are also described, together with the mechanisms it provides to develop customisable multimedia exercises.
Similar content being viewed by others
Data Availability
The dataset generated and analysed during the controlled experiment presented in this paper is available from the corresponding author on reasonable request.
Notes
The PRESTO (Plausible Representation of Emergency Scenarios for Training Operations) project, a 4-year industrial research project ended in 2016.
An alternative model is proposed in [7], where correlations between quality attributes are taken into account, and appropriate weights are assigned by experts to the evaluation attributes, depending on the object and goal of the evaluation. For our experiment we preferred to consider same weight for the considered attributes
A blinded version of the experiment package is available at https://figshare.com/s/c4143a098823ebe201a8
General Data Protection Regulation is a regulation in EU law on data protection and privacy in the European Union and the European Economic Area
Science, technology, engineering, and mathematics.
Called demonstration videos in [23].
Demo of the multimedia exercises produced with the ELEVATE Tool Suite can be found at the following link: https://elevate.deltainformatica.eu/portfolio.html (in Italian). It is possible to get a trial access to the ELEVATE Tool Suite by requesting a demo account at the following link: https://elevate.deltainformatica.eu - clicking on ”ACCEDI A ELEVATE”
References
Alemdag E, Cagiltay K (2018) A systematic review of eye tracking research on multimedia learning. Comput Educ 125:413–428
Ardito C, Costabile MF, Marsico MD, Lanzilotti R, Levialdi S, Roselli T, Rossano V (2006) An approach to usability evaluation of e-learning applications. Univers Access Inf Soc 4(3):270–283
Astegher M, Busetta P, Gabbasov A, Pedrotti M, Perini A, Susi A (2022) Specifying requirements for collection and analysis of online user feedback. Requir Eng:1–22
Benkada C, Moccozet L (2017) Enriched interactive videos for teaching and learning. In: 2017 21St international conference information visualisation (IV). IEEE, pp 344–349
Busetta P, Fruet M, Consolati P, Dragoni M, Ghidini C (2015) Developing an ontology for autonomous entities in a virtual reality: the PRESTO experience. In: Hodický J. (ed) Modelling and simulation for autonomous systems - second international workshop, MESAS 2015, Prague, Czech Republic, April 29-30, 2015, Revised Selected Papers. Lecture notes in computer science, vol 9055. Springer, pp 3–16. https://doi.org/10.1007/978-3-319-22383-4_1
Caldiera VRBG, Rombach HD (1994) The goal question metric approach. Encyc Softw Eng:528–532
Choi CR, Jeong HY (2019) Quality evaluation for multimedia contents of e-learning systems using the anp approach on high speed network. Multimed Tools Appl 78(20):28853–28875
Dellagiacoma D, Busetta P, Gabbasov A, Perini A, Susi A, Gabardi E, Palmisano F, Masè C, Moletta C (2020) Authoring interactive-video exercises with ELEVATE: The NLS procedure case study. In: 10Th international conference in MIS4TEL, NURSING workshop. Springer
Fiorella L, Mayer RE (2018) What works and doesn’t work with instructional video. Comput. Hum. Behav. 89:465–470. https://doi.org/10.1016/j.chb.2018.07.015
Hale KS, Stanney KM (2014) Handbook of virtual environments: design, implementation, and applications, CRC Press, Boca Raton
IEC25010 ISO (2011) Systems and software engineering–systems and software QUAlity REquirements and evaluation (SQUARE)–system and software quality models. Int Organ Standard 34:2910
Kersting NB, Givvin KB, Thompson BJ, Santagata R, Stigler JW (2012) Measuring usable knowledge: Teachers’ analyses of mathematics classroom videos predict teaching quality and student learning. Am Educ Res J 49(3):568–589
Ketsman O, Daher T, Colon Santana JA (2018) An investigation of effects of instructional videos in an undergraduate physics course. E-Learn Digit Med 15(6):267–289
Khamparia A, Pandey B (2018) Impact of interactive multimedia in e-learning technologies: Role of multimedia in e-learning. In: Digital multimedia: concepts, methodologies, tools, and applications. IGI Global, pp 1087–1110
Kleftodimos A, Evangelidis G (2016) An interactive video-based learning environment that supports learning analytics for teaching’image editing’. In: SE@ VBL@ LAK. pp 26–33
Kolås L (2015) Application of interactive videos in education. In: 2015 International conference on information technology based higher education and training (ITHET). IEEE, pp 1–6
Mayer RE, Fiorella L, Stull A (2020) Five ways to increase the effectiveness of instructional video. Educ Technol Res Dev:1–16
Molka-Danielsen J, Prasolova-førland E, Fominykh M, Lamb K (2018) Use of a collaborative virtual reality simulation for multi-professional training in emergency management communications. In: 2018 IEEE International conference on teaching, assessment, and learning for engineering (TALE). IEEE, pp 408–415
Mulders M, Buchner J, Kerres M (2020) A framework for the use of immersive virtual reality in learning environments. Int J Emerg Technol Learn (iJET) 15(24):208–224
Nan R, Zhang H (2019) Multimedia learning platform development and implementation based on cloud environment. Multimed Tools Appl 78 (24):35651–35664
Perini A, Susi A, Gabbasov A, Busetta P, Dellagiacoma D, Astegher M, Pedrotti M, Longato M (2020) Using i* to understand the domain of video tutorial for online training. In: CEUR WORKSHOP PROCEEDINGS. CEUR, 2020, vol 2641, pp 13–18 http://ceur-ws.org/Vol-2641/paper_03.pdf
Ponzanelli L, Bavota G, Mocci A, Di Penta M, Oliveto R, Hasan M, Russo B, Haiduc S, Lanza M (2016) Too long; didn’t watch! extracting relevant fragments from software development video tutorials. In: Proceedings of the 38th international conference on software engineering, pp 261–272
Preradovic NM, Lauc T, Panev I (2020) Investigating interactivity in instructional video tutorials for an undergraduate informatics course. Issues Educ Res
Schneider K, Bertolli LM (2019) Video variants for crowdre: how to create linear videos, vision videos, and interactive videos. In: 27Th IEEE international requirements engineering conference workshops, RE 2019 workshops, Jeju island, Korea (South), September 23-27, 2019. IEEE, pp 186–192. https://doi.org/10.1109/REW.2019.00039
Strecker S, Kundisch D, Lehner F, Leimeister JM, Schubert P (2018) Higher education and the opportunities and challenges of educational technology. Bus Inf Syst Eng 60(2):181–189
Takacs B, Vincze Z (2021) Deep authoring-an ai tool set for creating immersive multimedia experiences. Multimed Tools Appl:1–30
Vlachogianni P, Tselios N (2022) Perceived usability evaluation of educational technology using the system usability scale (sus): a systematic review. J Res Technol Educ 54(3):392–409
Wijnker W, Bakker A, van Gog T, Drijvers P (2019) Educational videos from a film theory perspective: Relating teacher aims to video characteristics. Br J Educ Technol 50(6):3175–3197
Wohlin C, Runeson P, Höst M, Ohlsson MC, Regnell B, Wesslén A (2012) Experimentation in software engineering. Springer Science & Business Media, Berlin
Wyllie J, Bruinenberg J, Roehr CC, Rüdiger M, Trevisanuto D, Urlesberger B (2015) European resuscitation council guidelines for resuscitation 2015: Section 7 resuscitation and support of transition of babies at birth
Yousef AMF, Chatti MA, Schroeder U (2014) The state of video-based learning: a review and future perspectives. Int J Adv Life Sci 6(3/4):122–135
Zhang D, Zhou L, Briggs RO, Nunamaker JF Jr (2006) Instructional video in e-learning: assessing the impact of interactive video on learning effectiveness. Inf Manag 43(1):15–27
Acknowledgements
We would like to thank the anonymous reviewers for their invaluable help to improve the presentation of this work.
Funding
Partial financial support was received from Provincia Autonoma di Trento, L.P. 6/1999, the ELEVATE industrial innovation project.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Perini, A., Schneider, K., Bertolli, L.M. et al. Multimedia interactive exercises for online training. Multimed Tools Appl 82, 38319–38343 (2023). https://doi.org/10.1007/s11042-023-15157-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-023-15157-8