Designing an information visualization dashboard to proctor test-takers during language certification online testing
Authors: 
Jose-Guillermo Hernández-Calderón, Valeria Soto-Mendoza, Luis Gerardo Montané-Jiménez, Marion Alain Meunier Colula, Janeth Tello-CarrilloAuthors Info & Claims
Jose-Guillermo Hernández-Calderón, Valeria Soto-Mendoza, Luis Gerardo Montané-Jiménez, Marion Alain Meunier Colula, Janeth Tello-CarrilloAuthors Info & ClaimsArticle No.: 7, Pages 1 - 5
Abstract
The learning mechanisms and the evaluation process have been moved to an online mode in order to maintain social distancing and reduce the spread of the COVID-19. E-learning initiatives (including assessment and proctoring) produce a large amount of data, so visualization mechanisms are required to support the decision-making process. This problem is addressed from a practical context of study: the English Language Certification Tests of a University in the southeast of Mexico. The conceptual design of four conceptual dashboards are presented using a mixed methodology: the UCD process and a conceptual model for a dashboard generator process. The four conceptual dashboards were evaluated by five experts. Although the design proposals were simple and reflected most initial user requirements, the experts suggested to include more elements in all the dashboards to provide the information needed for the intended users and improve the decision-making process.
References
[1]
Gökhan Akçapınar, Mohammad Nehal Hasnine, Rwitajit Majumdar, Brendan Flanagan, and Hiroaki Ogata. 2019. Developing an early-warning system for spotting at-risk students by using eBook interaction logs. Smart Learning Environments 6, 1 (2019). https://doi.org/10.1186/s40561-019-0083-4
[2]
Muhammad Anshari, Yabit Alas, Nor’azmah Hj Mohd Yunus, Norakmarul Ihsan Pg Hj Sabtu, and Malai Hayati Sheikh Abdul Hamid. 2016. Online learning: Trends, issues, and challenges in the big data era. Journal of E-Learning and Knowledge Society 12, 1 (2016), 121–134. https://doi.org/10.20368/1971-8829/1003
[3]
David Bañeres, M. Elena Rodríguez, Ana Elena Guerrero-Roldán, and Abdulkadir Karadeniz. 2020. An early warning system to detect at-risk students in online higher education. Applied Sciences (Switzerland) 10, 13 (2020). https://doi.org/10.3390/app10134427
[4]
Robert Bodily and Katrien Verbert. 2017. Review of research on student-facing learning analytics dashboards and educational recommender systems. IEEE Transactions on Learning Technologies 10, 4 (2017), 405–418. https://doi.org/10.1109/TLT.2017.2740172
[5]
Chen Chen, Zhang Ming, Chen Chong, and Sha Kun. 2021. The Existing Problems and Intelligent Improved Strategies in Online Teaching during the Outbreak of of COVID-19. (2021), 665–668. https://doi.org/10.1109/icbdie52740.2021.00157
[6]
Camilla Forsell and Jimmy Johansson. 2010. An heuristic set for evaluation in information visualization. In Proceedings of the International Conference on Advanced Visual Interfaces. 199–206.
[7]
Isabel Guitart Hormigo, M. Elena Rodríguez, and Xavier Baró. 2020. Design and implementation of dashboards to support teachers decision-making process in e-assessment systems. Lecture Notes on Data Engineering and Communications Technologies 34 (2020), 109–132. https://doi.org/10.1007/978-3-030-29326-0_6
[8]
Dabbebi Ines, Iksal Sebastien, Gilliot Jean-Marie, May Madeth, and Garlatti Serge. 2017. Towards adaptive dashboards for learning analytic an approach for conceptual design and implementation. CSEDU 2017 - Proceedings of the 9th International Conference on Computer Supported Education 1 (2017), 120–131. https://doi.org/10.5220/0006325601200131
[9]
Peerumporn Jiranantanagorn;, Konlayut Tippayakulpiroj;, and Panuwat Saikaew. 2021. Designing an Interactive Online Learning Platform to Support a Practical Subject During COVID-19 Outbreak. 18th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON) (2021), 283. https://doi.org/10.1109/ECTI-CON51831.2021.9454820
[10]
Jelena Jovanović, Mohammed Saqr, Srećko Joksimović, and Dragan Gašević. 2021. Students matter the most in learning analytics: The effects of internal and instructional conditions in predicting academic success. Computers and Education 172, October 2020 (2021), 1–13. https://doi.org/10.1016/j.compedu.2021.104251
[11]
Mikel Labayen, Ricardo Vea, Julian Florez, Naiara Aginako, and Basilio Sierra. 2021. Online Student Authentication and Proctoring System Based on Multimodal Biometrics Technology. IEEE Access 9(2021), 72398–72411. https://doi.org/10.1109/ACCESS.2021.3079375
[12]
Riccardo Mazza. 2021. A visual method to identify and characterise students suspected of collaboration during remote quizzes submissions in Learning Environments. Proceedings of the 25th IEEE International Conference on Information Visualisation (2021).
[13]
Matthew Montebello. 2019. Assisting Education through RealTime Learner Analytics. Proceedings - Frontiers in Education Conference, FIE 2018-Octob (2019). https://doi.org/10.1109/FIE.2018.8659345
[14]
Samantha Orlando, Elena Gaudioso, and Felix De La Paz. 2020. Supporting Teachers to Monitor Student’s Learning Progress in an Educational Environment with Robotics Activities. IEEE Access 8(2020), 48620–48631. https://doi.org/10.1109/ACCESS.2020.2978979
[15]
Julio Rojas-Mora, Oriel A. Herrera, Pedro Mirabal, and Marcos Levano. 2020. Methodological recommendations to face an online semester in a catastrophic situation: The case of a computer science program during the COVID-19 lockdown. Proceedings - International Conference of the Chilean Computer Science Society, SCCC 2020-Novem(2020). https://doi.org/10.1109/SCCC51225.2020.9281214
[16]
Aiman A. Turani, Jawad H. Alkhateeb, and Abdul Rahman A. Alsewari. 2020. Students Online Exam Proctoring: A Case Study Using 360 Degree Security Cameras. ETCCE 2020 - International Conference on Emerging Technology in Computing, Communication and Electronics(2020). https://doi.org/10.1109/ETCCE51779.2020.9350872
[17]
Usability.gov. 2017. User-Centered Design Basics. https://www.usability.gov/what-and-why/user-centered-design.html
[18]
Maya Usher, Arnon Hershkovitz, and Alona Forkosh-Baruch. 2021. From data to actions: Instructors’ decision making based on learners’ data in online emergency remote teaching. British Journal of Educational TechnologyApril (2021), 1338–1356. https://doi.org/10.1111/bjet.13108
[19]
Bart Valks, Monique Arkesteijn, Alexander Koutamanis, and Alexandra Den Heijer. 2021. Towards smart campus management: Defining information requirements for decision making through dashboard design. Buildings 11, 5 (2021). https://doi.org/10.3390/buildings11050201
[20]
Trynke Keuning van Geel and Marieke. 2021. Systems and Teacher Dashboards : The Teacher Still Matters Most. IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES 14, 2 (2021), 201–210.
[21]
Andrea Vázquez-Ingelmo, Francisco José García-Peñalvo, and Roberto Therón. 2019. Tailored information dashboards. (2019), 1–8. https://doi.org/10.1145/3335595.3335628
[22]
Annika Wolff, Zdenek Zdrahal, Andriy Nikolov, and Michal Pantucek. 2013. Improving retention: predicting at-risk students by analysing clicking behaviour in a virtual learning environment. In Proceedings of the third international conference on learning analytics and knowledge. 145–149.
Recommendations
Interactive Visualization Tools to Improve Learning and Teaching in Online Learning Environments
This paper presents two interactive visualization tools for learning management systems LMS in order to improve learning and teaching in online courses. The first tool was developed at the Intelligent Information Systems Laboratory IISLab at the Tampere ...
Designing a personal information visualization tool
NordiCHI '10: Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending BoundariesInteracting with computers has become part of our daily lives. This interaction results in large amounts of personal information, spread throughout places and applications. As a consequence, it is quite difficult to get an overall view of all our ...
Designing Pixel-Oriented Visualization Techniques: Theory and Applications
Visualization techniques are of increasing importance in exploring and analyzing large amounts of multidimensional information. One important class of visualization techniques which is particularly interesting for visualizing very large multidimensional ...
Comments
Information & Contributors
Information
Published In
December 2021
47 pages
ISBN:9781450387170
DOI:10.1145/3492724
Copyright © 2021 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 13 January 2022
Check for updates
Author Tags
Qualifiers
- Short-paper
- Research
- Refereed limited
Conference
MexIHC' 21
Acceptance Rates
Overall Acceptance Rate 20 of 40 submissions, 50%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 84Total Downloads
- Downloads (Last 12 months)13
- Downloads (Last 6 weeks)1
Reflects downloads up to 19 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format