Cited By
View all- Gronberg NKnutas AHynninen THujala M(2021)Palaute: An Online Text Mining Tool for Analyzing Written Student Course FeedbackIEEE Access10.1109/ACCESS.2021.31164259(134518-134529)Online publication date: 2021
Examining manual and semi-automated methods of analysing MOOC data for computing education
Authors: 
Michael Morgan, 
Aletta Nylén, Matthew Butler, Anna Eckerdal, 
Neena Thota, Päivi KinnunenAuthors Info & Claims
Michael Morgan, Aletta Nylén, Matthew Butler, Anna Eckerdal, Neena Thota, Päivi KinnunenAuthors Info & ClaimsPages 153 - 157
Abstract
We examine a semi-automated approach to the analysis of data from MOOC discussion forums. Previous research had analysed a sample of discussion forum data and developed a manual analysis framework, however this process can be very time consuming, especially given the class size of some online courses. Therefore it is important to investigate appropriate and automated analysis techniques to improve timeliness of analysis and to reveal the topics that emerge from a semi-automated process. An analysis of a data set from a coding MOOC in 2015 using the automated Structural Topic Modeling (STM) technique in R is described and contrasted against a manual analysis conducted on a segment of data from the same course in 2014. The types of analyses available and the relevance to computing education research is highlighted, with a focus on providing a discussion of the contrasting capabilities of each approach. The aim is to enable computing education researchers to assess the relevance of these techniques for further work.
References
[1]
Robert F Bales. 1950. Interaction process analysis; a method for the study of small groups. (1950).
[2]
David M Blei. 2012. Probabilistic topic models. Commun. ACM 55, 4 (2012), 77--84.
[3]
Joseph C Bondi Jr and Richard L Ober. 1969. The effects of interaction analysis feedback on the verbal behavior of student teachers. (1969).
[4]
John Dewey. 1933. How We Think: A Restatement of the Relation of Reflective Thinking to the Educative Process (1910), revised edition. Heath.
[5]
Pierre Dillenbourg, Järvelä Sanna, and Fischer Frank. 2009. The Evolution of Research on Computer-Supported Collaborative Learning. In Technology-Enhanced Learning. Springer, 3--19.
[6]
Aysu Ezen-Can, Kristy Elizabeth Boyer, Shaun Kellogg, and Sherry Booth. 2015. Unsupervised modeling for understanding MOOC discussion forums: a learning analytics approach. In Proceedings of the fifth international conference on learning analytics and knowledge. ACM, 146--150.
[7]
Ned A Flanders and Edmund J Amidon. 1981. A Case Study of an Educational Innovation: The History of Flanders Interaction Analysis System. Ned A. Flanders.
[8]
Päivi Häkkinen. 2013. Multiphase method for analysing online discussions. Journal of Computer Assisted Learning 29, 6 (2013), 547--555.
[9]
Tobias Hecking, Irene-Angelica Chounta, and H Ulrich Hoppe. 2015. Analysis of user roles and the emergence of themes in discussion forums. In Network Intelligence Conference (ENIC), 2015 Second European. IEEE, 114--121.
[10]
D.A. Kolb. 1984. Experiential learning: experience as the source of learning and development. Prentice Hall, Englewood Cliffs, NJ.
[11]
Klaus Krippendorff. 2004. Content analysis: An introduction to its methodology. Sage.
[12]
Weizhe Liu, Łukasz Kidziński, and Pierre Dillenbourg. 2016. Semiautomatic Annotation of MOOC Forum Posts. In State-of-the-Art and Future Directions of Smart Learning. Springer, 399--408.
[13]
Christopher Lucas, Richard A Nielsen, Margaret E Roberts, Brandon M Stewart, Alex Storer, and Dustin Tingley. 2015. Computer-assisted text analysis for comparative politics. Political Analysis (2015), mpu019.
[14]
Christopher Lucas, Richard A. Nielsen, Margaret E. Roberts, Brandon M. Stewart, Alex Storer, and Dustin Tingley. 2015. Computer-Assisted Text Analysis for Comparative Politics. 23, 2 (2015), 254--277.
[15]
Sandra Milligan, Jiazhen He, James Bailey, Rui Zhang, and Benjamin IP Rubinstein. 2016. Validity: a framework for cross-disciplinary collaboration in mining indicators of learning from MOOC forums. In Proceedings of the Sixth International Conference on Learning Analytics & Knowledge. ACM, 546--547.
[16]
Aletta Nylen, Neena Thota, Anna Eckerdal, Paivi Kinnunen, Matthew Butler, and Michael Morgan. Multidimensional analysis of Creative Coding MOOC forums - a methodological discussion. In 15th Koli Calling International Conference on Computing Education Research. ACM, New York, NY, USA, 137--141.
[17]
Justin Reich, Brandon Stewart, Kimia Mavon, and Dustin Tingley. 2016. The Civic Mission of MOOCs: Measuring Engagement across Political Differences in Forums. In Proceedings of the Third (2016) ACM Conference on Learning@ Scale. ACM, 1--10.
[18]
Justin Reich, Dustin H Tingley, Jetson Leder-Luis, Margaret E Roberts, and Brandon Stewart. 2014. Computer-Assisted Reading and Discovery for Student Generated Text in Massive Open Online Courses. (2014).
[19]
Justin Reich, Dustin H Tingley, Jetson Leder-Luis, Margaret E Roberts, and Brandon Stewart. 2014. Computer-assisted reading and discovery for student generated text in massive open online courses. (2014).
[20]
Margaret E Roberts, Brandon M Stewart, and Dustin Tingley. 2014. stm: R package for structural topic models. R package 1 (2014), 12.
[21]
Margaret E Roberts, Brandon M Stewart, Dustin Tingley, and Edoardo M Airoldi. The structural topic model and applied social science. In Advances in Neural Information Processing Systems Workshop on Topic Models: Computation, Application, and Evaluation.
[22]
Margaret E. Roberts, Brandon M. Stewart, Dustin Tingley, Christopher Lucas, Jetson Leder-Luis, Shana Kushner Gadarian, Bethany Albertson, and David G. Rand. 2014. Structural Topic Models for Open-Ended Survey Responses. American Journal of Political Science 58, 4 (2014), 1064--1082.
[23]
Lorenzo A Rossi and Omprakash Gnawali. 2014. Language independent analysis and classification of discussion threads in coursera MOOC forums. In 15th International Conference on Information Reuse and Integration (IRI). IEEE, 654--661.
[24]
Donald A Schön. 2002. Educating the reflective practitioner. TPB.
[25]
Mina Shirvani Boroujeni, Tobias Hecking, H Ulrich Hoppe, and Pierre Dillenbourg. 2017. Dynamics of MOOC Discussion Forums. In 7th International Learning Analytics and Knowledge Conference (LAK17).
[26]
Glenda S Stump, Jennifer DeBoer, Jonathan Whittinghill, and Lori Breslow. 2013. Development of a framework to classify MOOC discussion forum posts: Methodology and challenges. In NIPS Workshop on Data Driven Education.
[27]
Lev Semenovič Vygotskij and Michael Cole. 1978. LS Vygotsky, Mind in Society.
[28]
Lev Vygotsky. 1978. Interaction between learning and development. Readings on the development of children 23, 3 (1978), 34--41.
[29]
Xu Wang, Miaomiao Wen, and Carolyn P Rosé. 2016. Towards triggering higher-order thinking behaviors in MOOCs. In Proceedings of the Sixth International Conference on Learning Analytics & Knowledge. ACM, 398--407.
[30]
Alyssa Friend Wise, Yi Cui, and Jovita Vytasek. 2016. Bringing order to chaos in MOOC discussion forums with content-related thread identification. In Proceedings of the Sixth International Conference on Learning Analytics & Knowledge. ACM, 188--197.
Index Terms
- Examining manual and semi-automated methods of analysing MOOC data for computing education
Recommendations
Multidimensional analysis of creative coding MOOC forums: a methodological discussion
Koli Calling '15: Proceedings of the 15th Koli Calling Conference on Computing Education ResearchThe emergence of Massive Open Online Courses (MOOCs) in higher education has led to new variations in the social and educational interactions that students have with their peers and teachers. In this paper, we focus on methodological issues and discuss ...
Perception of MOOC Pedagogical Tools and Learners' Learning Styles in MOOC Blended Teaching: a Case Study
ICEBT '19: Proceedings of the 2019 3rd International Conference on E-Education, E-Business and E-TechnologyRapid development has been achieved since the emergence of MOOC in 2008, but there are still many defects in the popularization of MOOC. Developing blended teaching by utilizing is considered to be one of effective means to overcome these shortcomings. ...
Using DACP (Data Analyzer of Coursera Platform) to Analyze MOOC Platform Data
EITT '15: Proceedings of the 2015 International Conference of Educational Innovation through TechnologyThis paper introduces DACP (Data Analyzer of Courser a Platform), a simple tool kit based on SQL commands and open source machines learning software WEKA to analyze the MOOC Courser a platform data including click stream, user information, lecture view, ...
Comments
Information & Contributors
Information
Published In
November 2017
215 pages
Copyright © 2017 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
- Univ. Eastern Finland: University of Eastern Finland
- University of Warwick: University of Warwick
- Joensuu University Foundation: Joensuu University Foundation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 16 November 2017
Check for updates
Author Tags
Qualifiers
- Short-paper
Conference
Koli Calling 2017
Sponsor:
- Univ. Eastern Finland
- University of Warwick
- Joensuu University Foundation
Koli Calling 2017: 17th Koli Calling International Conference on Computing Education Research
November 16 - 19, 2017
Koli, Finland
Acceptance Rates
Overall Acceptance Rate 80 of 182 submissions, 44%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 141Total Downloads
- Downloads (Last 12 months)4
- Downloads (Last 6 weeks)0
Reflects downloads up to 15 Oct 2024
Other Metrics
Citations
Cited By
View all- Gronberg NKnutas AHynninen THujala M(2021)Palaute: An Online Text Mining Tool for Analyzing Written Student Course FeedbackIEEE Access10.1109/ACCESS.2021.31164259(134518-134529)Online publication date: 2021
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in