Abstract
The diversity and advance of information, communication, and analytical technologies and their increasing adoption to assist instruction and learning give rise to various technology-driven conferences (e.g., artificial intelligence in education) in educational technology. Previous reviews on educational technology commonly focused on journal articles while seldom including mainstream conference papers which also contribute to an important part of scientific output in computer science and emerging disciplines like educational technology and are equally and even more important than articles in knowledge transmission. Hence, conference papers should also be included in bibliometric studies to produce a complete and precise picture of scientific production concerning educational technology. This study, therefore, uses bibliometrics and topic modeling to analyze papers from mainstream conferences, including Artificial Intelligence in Education, Learning Analytics and Knowledge, Educational Data Mining, Intelligent Tutoring System, and Learning at Scale, focusing on contributors, collaborations, and particularly research topics and topic evolutions to inform relevant stakeholders about educational technology’s development and its future. Results indicate promising areas like affective computing and behavior mining for adaptive instruction, recommender systems in personalized learning recommendations, eye-tracking for cognitive process diagnosis, videos for feedback provision, and natural language processing in discourse analysis and language education.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Notes
References
Akram, B., Min, W., Wiebe, E., Mott, B., Boyer, K. E., & Lester, J. (2018). Improving stealth assessment in game-based learning with LSTM-based analytics. In International Conference on Educational Data Mining (pp. 208–218). International Educational Data Mining Society. Retrieved June 1, 2022, from https://files.eric.ed.gov/fulltext/ED593099.pdf
Ashwin, T. S., & Guddeti, R. M. R. (2019). Unobtrusive behavioral analysis of students in classroom environment using non-verbal cues. IEEE Access, 7, 150693–150709.
Atanassova, I., Bertin, M., & Mayr, P. (2019). Mining scientific papers: NLP-enhanced bibliometrics. Frontiers in Research Metrics and Analytics, 2. Retrieved from https://doi.org/10.3389/frma.2019.00002
Bond, M., Zawacki-Richter, O., & Nichols, M. (2019). Revisiting five decades of educational technology research: A content and authorship analysis of the British Journal of Educational Technology. British Journal of Educational Technology, 50(1), 12–63.
Botelho, A. F., Baker, R. S., Ocumpaugh, J., & Heffernan, N. T. (2018). Studying Affect Dynamics and Chronometry Using Sensor-Free Detectors. In International Conference on Educational Data Mining (pp 157–166). International Educational Data Mining Society. Retrieved June 1, 2022, from https://files.eric.ed.gov/fulltext/ED593106.pdf
Butler, L. (2008). ICT assessment: Moving beyond journal outputs. Scientometrics, 74(1), 39–55.
Butler, L., & Visser, M. S. (2006). Extending citation analysis to non-source items. Scientometrics, 66(2), 327–343.
Byrne, T. (2007). Marrying two existing software packages into an efficient online tutoring tool. Computer Assisted Language Learning, 20(5), 459–469.
Chan, K. S., & Zary, N. (2019). Applications and Challenges of Implementing Artificial Intelligence in Medical Education: Integrative Review. JMIR Medical Education, 5(1), e13930.
Chen, G., Rolim, V., Mello, R. F., & Gašević, D. (2020a). Let's shine together! a comparative study between learning analytics and educational data mining. In International Conference on Learning Analytics & Knowledge (pp 544-553). Association for Computing Machinery (ACM). https://doi.org/10.1145/3375462.3375500
Chen, X., Zou, D., Cheng, G., & Xie, H. (2020b). Detecting latent topics and trends in educational technologies over four decades using structural topic modeling: A retrospective of all volumes of Computers & Education. Computers & Education, 151, 103855.
Chung, J. Y., & Lee, S. (2019). Dropout early warning systems for high school students using machine learning. Children and Youth Services Review, 96, 346–353.
Dawson, S., Joksimovic, S., Poquet, O., & Siemens, G. (2019). Increasing the impact of learning analytics. Proceedings of the 9th International Conference on Learning Analytics & Knowledge, 446–455.
Duchowski, A. T., & Duchowski, A. T. (2017). Eye tracking methodology: Theory and practice. Springer.
Dwivedi, P., Kant, V., & Bharadwaj, K. K. (2018). Learning path recommendation based on modified variable length genetic algorithm. Education and Information Technologies, 23(2), 819–836.
Feinerer, I., Hornik, K., & Feinerer, M. I. (2015). Package “tm”. Retrieved June 1, 2022, from https://cran.r-project.org/web/packages/tm/index.html
Grafsgaard, J., Wiggins, J. B., Boyer, K. E., Wiebe, E. N., & Lester, J. (2013, July). Automatically recognizing facial expression: Predicting engagement and frustration. In International Conference on Educational Data Mining (pp 43–50). International Educational Data Mining Society. Retrieved June 1, 2022, from https://www.educationaldatamining.org/EDM2013/papers/rn_paper_09.pdf
Guerrero Bote, V. P., Olmeda-Gómez, C., & de Moya-Anegón, F. (2013). Quantifying the benefits of international scientific collaboration. Journal of the American Society for Information Science and Technology, 64(2), 392–404.
Harper, F., Green, H., & Fernandez-Toro, M. (2018). Using screencasts in the teaching of modern languages: Investigating the use of Jing® in feedback on written assignments. The Language Learning Journal, 46(3), 277–292.
Head, A., Glassman, E., Soares, G., Suzuki, R., Figueredo, L., D’Antoni, L., & Hartmann, B. (2017). Writing reusable code feedback at scale with mixed-initiative program synthesis. In ACM Conference on Learning@ Scale (pp 89–98). Association for Computing Machinery (ACM). https://doi.org/10.1145/3051457.3051467
Higgins, S. E., Mercier, E., Burd, E., & Hatch, A. (2011). Multi-touch tables and the relationship with collaborative classroom pedagogies: A synthetic review. International Journal of Computer-Supported Collaborative Learning, 6(4), 515–538.
Huang, W., Hew, K. F., & Fryer, L. K. (2022). Chatbots for language learning—Are they really useful? A systematic review of chatbot-supported language learning. Journal of Computer Assisted Learning, 38(1), 237–257.
Kao, G.Y.-M., Chiang, X.-Z., & Foulsham, T. (2019). Reading behavior and the effect of embedded selfies in role-playing picture e-books: An eye-tracking investigation. Computers & Education, 136, 99–112.
Karumbaiah, S., Baker, R. S., & Shute, V. (2018). Predicting Quitting in Students Playing a Learning Game. International Educational Data Mining Society.
Kendall, M., & Gibbons, J. D. (1990). Rank Correlation Methods (5 ed). Charles Griffin.
Khandwala, K., & Guo, P. J. (2018). Codemotion: expanding the design space of learner interactions with computer programming tutorial videos. In ACM Conference on Learning@ Scale (pp 1–10). Association for Computing Machinery (ACM). https://doi.org/10.1145/3231644.3231652
Kyvik, S., & Reymert, I. (2017). Research collaboration in groups and networks: Differences across academic fields. Scientometrics, 113(2), 951–967.
Labarthe, H., Luengo, V., & Bouchet, F. (2018). Analyzing the relationships between learning analytics, educational data mining and AI for education. In International Conference on Intelligent Tutoring Systems (ITS): Workshop Learning Analytics (pp. 63–72). Retrieved June 1, 2022, from http://ceur-ws.org/Vol-2354/w2paper2.pdf
Le, N.-T. (2016). Analysis techniques for feedback-based educational systems for programming. In Advanced Computational Methods for Knowledge Engineering (pp. 141–152). Springer. https://doi.org/10.1007/978-3-319-38884-7_11
Liefner, I. (2003). Funding, resource allocation, and performance in higher education systems. Higher Education, 46(4), 469–489.
Lisée, C., Larivière, V., & Archambault, É. (2008). Conference proceedings as a source of scientific information: A bibliometric analysis. Journal of the American Society for Information Science and Technology, 59(11), 1776–1784.
Liu, C., Zou, D., Chen, X., Xie, H., & Chan, W. H. (2021). A bibliometric review on latent topics and trends of the empirical MOOC literature (2008–2019). Asia Pacific Education Review, 22(3), 515–534.
Lucas, C., Nielsen, R. A., Roberts, M. E., Stewart, B. M., Storer, A., & Tingley, D. (2015). Computer-assisted text analysis for comparative politics. Political Analysis, 23(2), 254–277.
Mann, H. B. (1945). Nonparametric tests against trend. Econometria.
Mimno, D., Wallach, H., Talley, E., Leenders, M., & McCallum, A. (2011). Optimizing semantic coherence in topic models. In Conference on Empirical Methods in Natural Language Processing (pp 262–272). Association for Computational Linguistics. Retrieved June 1, 2022, from https://aclanthology.org/D11-1024.pdf
Mojarad, S., Essa, A., Mojarad, S., & Baker, R. S. (2018). Data-driven learner profiling based on clustering student behaviors: learning consistency, pace and effort. In International Conference on Intelligent Tutoring Systems (pp. 130–139). Springer. https://doi.org/10.1007/978-3-319-91464-0_13
Molina, A. I., Navarro, Ó., Ortega, M., & Lacruz, M. (2018). Evaluating multimedia learning materials in primary education using eye tracking. Computer Standards & Interfaces, 59, 45–60.
Nabizadeh, A. H., Gonçalves, D., Gama, S., Jorge, J., & Rafsanjani, H. N. (2020). Adaptive learning path recommender approach using auxiliary learning objects. Computers & Education, 147, 103777.
Nam, S., & Samson, P. (2019). Integrating Students’ Behavioral Signals and Academic Profiles in Early Warning System. In International Conference on Artificial Intelligence in Education (pp. 345–357). Springer. https://doi.org/10.1007/978-3-030-23204-7_29
Ninaus, M., Greipl, S., Kiili, K., Lindstedt, A., Huber, S., Klein, E., et al. (2019). Increased emotional engagement in game-based learning–A machine learning approach on facial emotion detection data. Computers & Education, 142, 103641.
Ochoa, X., Suthers, D., Verbert, K., & Duval, E. (2014). Analysis and reflections on the third Learning Analytics and Knowledge Conference. Journal of Learning Analytics, 1(2), 5–22.
Ocumpaugh, J., Andres, J. M., Baker, R., DeFalco, J., Paquette, L., Rowe, J. et al (2017). Affect dynamics in military trainees using vMedic: From engaged concentration to boredom to confusion. In International conference on artificial intelligence in education (pp 238–249). Springer. https://doi.org/10.1007/978-3-319-61425-0_20
Peng, B., Guo, D., Qiao, H., Yang, Q., Zhang, B., Hayat, T., … & Ahmad, B. (2018). Bibliometric and visualized analysis of China's coal research 2000–2015. Journal of cleaner production, 197, 1177-1189.
Pham, P., & Wang, J. (2018). Predicting learners’ emotions in mobile MOOC learning via a multimodal intelligent tutor. In International Conference on Intelligent Tutoring Systems (pp 150–159). Springer. https://doi.org/10.1007/978-3-319-91464-0_15
Pohlert, T. (2016). Package “trend”. Retrieved June 1, 2022, from https://cran.r-project.org/web/packages/trend/index.html
Rivers, K., & Koedinger, K. R. (2017). Data-driven hint generation in vast solution spaces: A self-improving python programming tutor. International Journal of Artificial Intelligence in Education, 27(1), 37–64.
Roberts, M. E., Stewart, B. M., & Tingley, D. (2014). stm: R package for structural topic models. Journal of Statistical Software, 10(2), 1–40.
Romero, L. (2018). A Citation Analysis of Scholarly Journals in Communication Studies. Portal: Libraries and the Academy, 18(3), 505–534.
Serdyukov, P. (2017). Innovation in education: What works, what doesn’t, and what to do about it? Journal of Research in Innovative Teaching & Learning, 10(1), 4–33.
Shen, C., & Ho, J. (2020). Technology-enhanced learning in higher education: A bibliometric analysis with latent semantic approach. Computers in Human Behavior, 104, 106177.
Staubitz, T., Petrick, D., Bauer, M., Renz, J., & Meinel, C. (2016). Improving the peer assessment experience on MOOC platforms. In ACM Conference on Learning@ Scale (pp 389–398). Association for Computing Machinery (ACM). https://doi.org/10.1145/2876034.2876043
Stewart, A., & D’Mello, S. K. (2018). Connecting the dots towards collaborative AIED: Linking group makeup to process to learning. In International Conference on Artificial Intelligence in Education (pp 545–556). Springer. https://doi.org/10.1007/978-3-319-93843-1_40
Sullivan, F. R., & Keith, P. K. (2019). Exploring the potential of natural language processing to support microgenetic analysis of collaborative learning discussions. British Journal of Educational Technology, 50(6), 3047–3063.
Sung, Y.-T., Chang, K.-E., & Yang, J.-M. (2015). How effective are mobile devices for language learning? A meta-analysis. Educational Research Review, 16, 68–84.
Svensson, G. (2010). SSCI and its impact factors: A “prisoner’s dilemma”? European Journal of Marketing, 44(1–2), 23–33.
Taub, M., Sawyer, R., Lester, J., & Azevedo, R. (2020). The impact of contextualized emotions on self-regulated learning and scientific reasoning during learning with a game-based learning environment. International Journal of Artificial Intelligence in Education, 30(1), 97–120.
Tsai, Y.-L., & Tsai, C.-C. (2018). Digital game-based second-language vocabulary learning and conditions of research designs: A meta-analysis study. Computers & Education, 125, 345–357.
Vanbecelaere, S., Cornillie, F., Sasanguie, D., Reynvoet, B., & Depaepe, F. (2021). The effectiveness of an adaptive digital educational game for the training of early numerical abilities in terms of cognitive, noncognitive and efficiency outcomes. British Journal of Educational Technology, 52(1), 112–124.
Vanitha, V., Krishnan, P., & Elakkiya, R. (2019). Collaborative optimization algorithm for learning path construction in E-learning. Computers & Electrical Engineering, 77, 325–338.
Wampfler, R., Klingler, S., Solenthaler, B., Schinazi, V., & Gross, M. (2019). Affective State Prediction in a Mobile Setting using Wearable Biometric Sensors and Stylus. In International Conference on Educational Data Mining (pp 198–207). International Educational Data Mining Society. Retrieved June 1, 2022, from https://files.eric.ed.gov/fulltext/ED599181.pdf
Wang, X., Xing, W., & Laffey, J. M. (2018). Autistic youth in 3D game-based collaborative virtual learning: Associating avatar interaction patterns with embodied social presence. British Journal of Educational Technology, 49(4), 742–760.
Westera, W., Dascalu, M., Kurvers, H., Ruseti, S., & Trausan-Matu, S. (2018). Automated essay scoring in applied games: Reducing the teacher bandwidth problem in online training. Computers & Education, 123, 212–224.
Xiao, J., Wang, M., Jiang, B., & Li, J. (2018). A personalized recommendation system with combinational algorithm for online learning. Journal of Ambient Intelligence and Humanized Computing, 9(3), 667–677.
Yang, S. J. H., Ogata, H., Matsui, T., & Chen, N.-S. (2021). Human-centered artificial intelligence in education: Seeing the invisible through the visible. Computers and Education: Artificial Intelligence, 2, 100008. https://doi.org/10.1016/j.caeai.2021.100008
Yenioglu, B. Y., Ergulec, F., & Yenioglu, S. (2021). Augmented reality for learning in special education: a systematic literature review. Interactive Learning Environments, 1–17.
Zarzour, H., Bendjaballah, S., & Harirche, H. (2020). Exploring the behavioral patterns of students learning with a Facebook-based e-book approach. Computers & Education, 156, 103957.
Zawacki-Richter, O., & Latchem, C. (2018). Exploring four decades of research in Computers & Education. Computers & Education, 122, 136–152.
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education–where are the educators? International Journal of Educational Technology in Higher Education, 16(1), 39.
Zhou, Y., Huang, C., Hu, Q., Zhu, J., & Tang, Y. (2018). Personalized learning full-path recommendation model based on LSTM neural networks. Information Sciences, 444, 135–152.
Author information
Authors and Affiliations
Corresponding authors
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix
Rights and permissions
About this article
Cite this article
Chen, X., Zou, D., Xie, H. et al. Exploring contributors, collaborations, and research topics in educational technology: A joint analysis of mainstream conferences. Educ Inf Technol 28, 1323–1358 (2023). https://doi.org/10.1007/s10639-022-11209-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10639-022-11209-y