Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3375462.3375500acmotherconferencesArticle/Chapter ViewAbstractPublication PageslakConference Proceedingsconference-collections
research-article

Let's shine together!: a comparative study between learning analytics and educational data mining

Published: 23 March 2020 Publication History

Abstract

Learning Analytics and Knowledge (LAK) and Educational Data Mining (EDM) are two of the most popular venues for researchers and practitioners to report and disseminate discoveries in data-intensive research on technology-enhanced education. After the development of about a decade, it is time to scrutinize and compare these two venues. By doing this, we expected to inform relevant stakeholders of a better understanding of the past development of LAK and EDM and provide suggestions for their future development. Specifically, we conducted an extensive comparison analysis between LAK and EDM from four perspectives, including (i) the topics investigated; (ii) community development; (iii) community diversity; and (iv) research impact. Furthermore, we applied one of the most widely-used language modeling techniques (Word2Vec) to capture words used frequently by researchers to describe future works that can be pursued by building upon suggestions made in the published papers to shed light on potential directions for future research.

References

[1]
Dag W. Aksnes, Liv Langfeldt, and Paul Wouters. 2019. Citations, citation indicators, and research quality: An overview of basic concepts and theories.
[2]
Mathieu Bastian, Sebastien Heymann, and Mathieu Jacomy. 2009. Gephi: An Open Source Software for Exploring and Manipulating Networks. In ICWSM.
[3]
Francesca De Battisti, Alfio Ferrara, and Silvia Salini. 2013. A decade of research in statistics: a topic model approach. Scientometrics 103 (2013), 413--433.
[4]
Sanam Shirazi Beheshitha, Marek Hatala, Dragan Gaević, and Srecko Joksimovic. 2016. The role of achievement goal orientations when studying effect of learning analytics visualizations. In LAK.
[5]
Yoav Bergner, Stefan Dröschler, Gerd Kortemeyer, Saif Rayyan, Daniel T. Seaton, and David E. Pritchard. 2012. Model-Based Collaborative Filtering Analysis of Student Response Data: Machine-Learning Item Response Theory. In EDM.
[6]
David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent Dirichlet Allocation. J. Mach. Learn. Res. 3 (2003), 993--1022.
[7]
Paulo Blikstein. 2011. Using learning analytics to assess students' behavior in open-ended programming tasks. In LAK.
[8]
Paulo Blikstein. 2013. Multimodal learning analytics. In LAK.
[9]
François Bouchet, John S. Kinnebrew, Gautam Biswas, and Roger Azevedo. 2012. Identifying Students' Characteristic Learning Behaviors in an Intelligent Tutoring System Fostering Self-Regulated Learning. In EDM.
[10]
Kai-Yuan Cai and David Card. 2008. An analysis of research topics in software engineering - 2006. Journal of Systems and Software 81 (2008), 1051--1058.
[11]
Zhourong Chen, Nevin Lianwen Zhang, Dit-Yan Yeung, and Peixian Chen. 2016. Sparse Boltzmann Machines with Structure Learning as Applied to Text Analysis. In AAAI.
[12]
Johannes K. Chiang, Chen-Wo Kuo, and Yu-Hsiang Yang. 2010. A Bibliometric Study of E-Learning Literature on SSCI Database. In Entertainment for Education. Digital Techniques and Systems.
[13]
Hale Turhan Damar, Ozlem Bilik, Güzin Özdagoglu, Askin Ozdagoglu, and Muhammet Damar. 2018. Evaluating the nursing academicians in Turkey in the scope of Web of Science: scientometrics of original articles. Scientometrics 115 (2018), 539--562.
[14]
Subhajit Datta, Santonu Sarkar, and A. S. M. Sajeev. 2016. How Long Will This Live? Discovering the Lifespans of Software Engineering Ideas. IEEE Transactions on Big Data 2 (2016), 124--137.
[15]
Shane Dawson, Dragan Gaević, George Siemens, and Srecko Joksimovic. 2014. Current state and future trends: a citation network analysis of the learning analytics field. In LAK.
[16]
Shane Dawson, Srecko Joksimovic, Oleksandra Poquet, and George Siemens. 2019. Increasing the Impact of Learning Analytics. In LAK.
[17]
Ryan Shaun Joazeiro de Baker, Sujith M. Gowda, Michael Wixon, Jessica Kalka, Angela Z. Wagner, Aatish Salvi, Vincent Aleven, Gail Kusbit, Jaclyn Ocumpaugh, and Lisa M. Rossi. 2012. Sensor-free automated detection of affect in a Cognitive Tutor for Algebra. In EDM.
[18]
Gerben Dekker, Mykola Pechenizkiy, and Jan Vleeshouwers. 2009. Predicting Students Drop Out: A Case Study. In EDM.
[19]
Rebecca Ferguson and Simon Buckingham Shum. 2011. Learning analytics to identify exploratory dialogue within synchronous text chat. In LAK.
[20]
Vahid Garousi and Mika Mäntylä. 2016. Citations, research topics and active countries in software engineering: A bibliometrics study. Computer Science Review 19 (2016), 56--77.
[21]
Shengnan Gong, Xinyi Yin, and Yuchao Ji. 2019. Comparative Analysis of Chinese and American Educational Games Research Based on Bibliometrics. In Proceedings of the 2019 7th International Conference on Information and Education Technology (ICIET 2019). ACM, New York, NY, USA, 120--125.
[22]
Joseph F. Grafsgaard, Joseph B. Wiggins, Kristy Elizabeth Boyer, Eric N. Wiebe, and James C. Lester. 2014. Predicting Learning and Affect from Multimodal Data Streams in Task-Oriented Tutorial Dialogue. In EDM.
[23]
Thomas L. Griffiths and Mark Steyvers. 2004. Finding scientific topics. Proceedings of the National Academy of Sciences of the United States of America 101 Suppl 1 (2004), 5228--35.
[24]
Erik Harpstead, Christopher J. MacLellan, Kenneth R. Koedinger, Vincent Aleven, Steven Dow, and Brad A. Myers. 2013. Investigating the Solution Space of an Open-Ended Educational Game Using Conceptual Feature Extraction. In EDM.
[25]
Jui-Long Hung and Kecheng Zhang. 2012. Examining mobile learning trends 2003--2008: a categorical meta-trend analysis using text mining techniques. Journal of Computing in Higher Education 24 (2012), 1--17.
[26]
Miguel Ángel Fernández Jiménez, Theresa M. Laverty, Sara P. Bombaci, Kate L. Wilkins, Drew E. Bennett, and Liba Pejchar. 2019. Underrepresented faculty play a disproportionate role in advancing diversity and inclusion. Nature Ecology Evolution 3 (2019), 1030--1033.
[27]
René F. Kizilcec, Chris Piech, and Emily Schneider. 2013. Deconstructing disengagement: analyzing learner subpopulations in massive open online courses. In LAK.
[28]
Aaron D. Likens, Kathryn S. McCarthy, Laura K. Allen, and Danielle S. McNamara. 2018. Recurrence Quantification Analysis As a Method for Studying Text Comprehension Dynamics. In LAK.
[29]
Tengfei Liu, Nevin Lianwen Zhang, and Peixian Chen. 2014. Hierarchical Latent Tree Analysis for Topic Detection. In ECML/PKDD.
[30]
G. Mathew, A. Agrawal, and T. Menzies. 2018. Finding Trends in Software Research. IEEE Transactions on Software Engineering (2018), 1--1.
[31]
Negin Mirriahi, Dragan Gaević, Shane Dawson, and P. D. Long. 2014. Scientometrics as an Important Tool for the Growth of the Field of Learning Analytics. Journal of Learning Analytics.
[32]
Xavier Ochoa, Daniel D. Suthers, Katrien Verbert, and Erik Duval. 2014. Analysis and Reflections on the Third Learning Analytics and Knowledge Conference (LAK 2013).
[33]
Sam S. Oh, Joshua M Galanter, Neeta Thakur, Maria Pino-Yanes, Nicolas E. Barcelo, Marquitta J. White, Danielle M. de Bruin, Ruth M. Greenblatt, Kirsten Bibbins-Domingo, Alan H. B. Wu, Luisa N Borrell, Chris Gunter, Neil R. Powe, and Esteban G. Burchard. 2015. Diversity in Clinical and Biomedical Research: A Promise Yet to Be Fulfilled.
[34]
Abelardo Pardo, Kathryn Bartimote, Simon Buckingham Shum, Shane Dawson, Jing Gao, Dragan Gasevic, Steve Leichtweis, Danny Y. T. Liu, Roberto Martinez-Maldonado, Negin Mirriahi, Adon Christian Michael Moskal, Jurgen Schulte, George Siemens, and Lorenzo Vigentini. 2018. OnTask: Delivering Data-Informed, Personalized Learning Support Actions.
[35]
Zachary A. Pardos and Neil T. Heffernan. 2010. Navigating the parameter space of Bayesian Knowledge Tracing models: Visualizations of the convergence of the Expectation Maximization algorithm. In EDM.
[36]
José Martí Parreño, E. Méndez-Ibáñez, and A. Alonso-Arroyo. 2016. The use of gamification in education: a bibliometric and text mining analysis. J. Comp. Assisted Learning 32 (2016), 663--676.
[37]
Chris Piech, Jonathan Huang, Zhenghao Chen, Chuong B. Do, Andrew Y. Ng, and Daphne Koller. 2013. Tuned Models of Peer Assessment in MOOCs. ArXiv abs/1307.2579 (2013).
[38]
Paul Prinsloo and Sharon Slade. 2013. An evaluation of policy frameworks for addressing ethical considerations in learning analytics. In LAK.
[39]
Arthur E. Pritchard. 1969. Statistical bibliography or bibliometrics.
[40]
Joseph M. Reilly, Milan Ravenell, and Bertrand Schneider. 2018. Exploring Collaboration Using Motion Sensors and Multi-Modal Learning Analytics. In EDM.
[41]
Steven Ritter, Thomas K. Harris, Tristan Nixon, Daniel Dickison, R. Charles Murray, and Brendon Towle. 2009. Reducing the Knowledge Tracing Space. In EDM.
[42]
Cristóbal Romero and Sebastián Ventura. 2007. Educational data mining: A survey from 1995 to 2005. ESWA 33 (2007), 135--146.
[43]
Cristóbal Romero and Sebastián Ventura. 2010. Educational Data Mining: A Review of the State of the Art. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) 40 (2010), 601--618.
[44]
Per O Seglen. 1997. Why the impact factor of journals should not be used for evaluating research. British Medical Journal 314, 7079 (1997), 497.
[45]
George Siemens and Ryan S. J. d. Baker. 2012. Learning Analytics and Educational Data Mining: Towards Communication and Collaboration. In LAK.
[46]
Vilaythong Southavilay, Kalina Yacef, Peter Reimann, and Rafael A. Calvo. 2013. Analysis of collaborative writing processes using revision maps and probabilistic topic models. In LAK.
[47]
Caroline M. Tucker, Marc W. Cadotte, Silvia B. Carvalho, T. Jonathan Davies, Simon Ferrier, Susanne A. Fritz, Rich Grenyer, Matthew R. Helmus, Lanna S. Jin, Arne O. Mooers, Sandrine Pavoine, Oliver Purschke, David W. Redding, Dan F. Rosauer, Marten Winter, and Florent Mazel. 2017. A guide to phylogenetic metrics for conservation, community ecology and macroecology. Biological Reviews 92, 2 (2017), 698--715. arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1111/brv.12252
[48]
Katrien Verbert, Hendrik Drachsler, Nikos Manouselis, Martin Wolpers, Riina Vuorikari, and Erik Duval. 2011. Dataset-driven research for improving recommender systems for learning. In LAK.
[49]
Hajra Waheed, Saeed-Ul Hassan, Naif R. Aljohani, and Muhammad Wasif. 2018. A bibliometric perspective of learning analytics research landscape. Behaviour & Information Technology 37 (2018), 941--957.
[50]
Hanna M. Wallach. 2006. Topic modeling: beyond bag-of-words. In ICML.
[51]
Jian Wang. 2013. Citation time window choice for research impact evaluation. Scientometrics 94, 3 (2013), 851--872.
[52]
Alyssa Friend Wise. 2014. Designing pedagogical interventions to support student use of learning analytics. In LAK.
[53]
Marcelo Worsley. 2018. (Dis)Engagement Matters: Identifying Efficacious Learning Practices with Multimodal Learning Analytics. In LAK.
[54]
Marcelo Worsley and Paulo Blikstein. 2013. Towards the development of multi-modal action based assessment. In LAK.
[55]
Yi Yang, Quanming Yao, and Huamin Qu. 2017. VISTopic: A visual analytics system for making sense of large document collections using hierarchical topic modeling. Visual Informatics 1 (2017), 40--47.
[56]
Junting Ye, Shuchu Han, Yifan Hu, Baris Coskun, Meizhu Liu, Hong Qin, and Steven Skiena. 2017. Nationality Classification Using Name Embeddings. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management (CIKM '17). ACM, New York, NY, USA, 1897--1906.
[57]
Airton Zancanaro, José L. Todesco, and Fernando Ramos. 2015. A bibliometric mapping of open educational resources.
[58]
Gustavo Zurita, José María Merigó, and Valeria Lobos-Ossandón. 2016. A bibliometric analysis of journals in educational research. In Proceedings of the World Congress on Engineering, Vol. 1. 403--408.

Cited By

View all
  • (2024)Optimizing Learning: Predicting Research Competency via Statistical ProficiencyTrends in Higher Education10.3390/higheredu30300323:3(540-559)Online publication date: 8-Jul-2024
  • (2024)A Growing Community of Practice on Games and Learning: A Literature Review with Bibliometric and Thematic AnalysesGames and Learning Alliance10.1007/978-3-031-78269-5_1(3-13)Online publication date: 18-Dec-2024
  • (2023)A Comparison of Undersampling, Oversampling, and SMOTE Methods for Dealing with Imbalanced Classification in Educational Data MiningInformation10.3390/info1401005414:1(54)Online publication date: 16-Jan-2023
  • Show More Cited By

Index Terms

  1. Let's shine together!: a comparative study between learning analytics and educational data mining

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Other conferences
      LAK '20: Proceedings of the Tenth International Conference on Learning Analytics & Knowledge
      March 2020
      679 pages
      ISBN:9781450377126
      DOI:10.1145/3375462
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 23 March 2020

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. educational data mining
      2. hierarchical topic detection
      3. language modeling
      4. learning analytics

      Qualifiers

      • Research-article

      Conference

      LAK '20

      Acceptance Rates

      LAK '20 Paper Acceptance Rate 80 of 261 submissions, 31%;
      Overall Acceptance Rate 236 of 782 submissions, 30%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)60
      • Downloads (Last 6 weeks)6
      Reflects downloads up to 21 Dec 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Optimizing Learning: Predicting Research Competency via Statistical ProficiencyTrends in Higher Education10.3390/higheredu30300323:3(540-559)Online publication date: 8-Jul-2024
      • (2024)A Growing Community of Practice on Games and Learning: A Literature Review with Bibliometric and Thematic AnalysesGames and Learning Alliance10.1007/978-3-031-78269-5_1(3-13)Online publication date: 18-Dec-2024
      • (2023)A Comparison of Undersampling, Oversampling, and SMOTE Methods for Dealing with Imbalanced Classification in Educational Data MiningInformation10.3390/info1401005414:1(54)Online publication date: 16-Jan-2023
      • (2023)Non-White scientists appear on fewer editorial boards, spend more time under review, and receive fewer citationsProceedings of the National Academy of Sciences10.1073/pnas.2215324120120:13Online publication date: 20-Mar-2023
      • (2023)Early prediction of learners at risk in self-paced educationExpert Systems with Applications: An International Journal10.1016/j.eswa.2022.118868213:PAOnline publication date: 1-Mar-2023
      • (2023)Predicting Students’ Performance Employing Educational Data Mining Techniques, Machine Learning, and Learning AnalyticsCommunication, Networks and Computing10.1007/978-3-031-43140-1_15(166-177)Online publication date: 27-Sep-2023
      • (2022)Improving Student Feedback Literacy in e-Assessments: A Framework for the Higher Education ContextTrends in Higher Education10.3390/higheredu10100021:1(16-29)Online publication date: 6-Dec-2022
      • (2022)The impacts of learning analytics and A/B testing research: a case study in differential scientometricsInternational Journal of STEM Education10.1186/s40594-022-00330-69:1Online publication date: 14-Feb-2022
      • (2022)Is there order in the mess? A single paper meta-analysis approach to identification of predictors of success in learning analyticsStudies in Higher Education10.1080/03075079.2022.206145047:12(2370-2391)Online publication date: 11-Apr-2022
      • (2022)Exploring contributors, collaborations, and research topics in educational technology: A joint analysis of mainstream conferencesEducation and Information Technologies10.1007/s10639-022-11209-y28:2(1323-1358)Online publication date: 25-Jul-2022
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media