Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
article

Activity sequence modelling and dynamic clustering for personalized e-learning

Published: 01 April 2011 Publication History

Abstract

Monitoring and interpreting sequential learner activities has the potential to improve adaptivity and personalization within educational environments. We present an approach based on the modeling of learners' problem solving activity sequences, and on the use of the models in targeted, and ultimately automated clustering, resulting in the discovery of new, semantically meaningful information about the learners. The approach is applicable at different levels: to detect pre-defined, well-established problem solving styles, to identify problem solving styles by analyzing learner behaviour along known learning dimensions, and to semi-automatically discover learning dimensions and concrete problem solving patterns. This article describes the approach itself, demonstrates the feasibility of applying it on real-world data, and discusses aspects of the approach that can be adjusted for different learning contexts. Finally, we address the incorporation of the proposed approach in the adaptation cycle, from data acquisition to adaptive system interventions in the interaction process.

References

[1]
Aleven, V., Stahl, E., Schworm, S., Fischer, F., Wallace, R.: Help seeking and help design in interactive learning environments. Rev. Educ. Res. 73(3), 277-320 (2003).
[2]
Aleven, V., McLaren, B., Roll, I., Koedinger, K.: Toward meta-cognitive tutoring: a model of help seeking with a cognitive tutor. Int. J. Artif. Intell. Educ. 16(2), 101-128 (2006).
[3]
Alfonseca, E., Carro, R.M., Martín, E., Ortigosa, A., Paredes, P.: The impact of learning styles on student grouping for collaborative learning: a case Study. User Model. User-Adapt. Interact. 16(3-4), 377-401 (2006).
[4]
Amershi, S., Conati, C.: Automatic recognition of learner groups in exploratory learning environments. In: Ikeda, M., Ashley, K., Chan, T.-W. (eds.) Intelligent Tutoring Systems, vol. 4053 of Lecture Notes in Computer Science, pp. 463-472. Springer, Berlin (2006).
[5]
Amershi, S., Conati, C.: Combining Unsupervised and Supervised Classification to Build User Models for Exploratory Learning Environments. J. Educ. Data Min. 1(1), 18-71 (2009).
[6]
Anaya, A.R., Boticario, J.G.: Clustering learners according to their collaboration. In: Proceedings of the 2009 13th International Conference on Computer Supported Cooperative Work in Design, pp. 540-545, (2009a).
[7]
Anaya, A.R., Boticario, J.G.: A data mining approach to reveal representative collaboration indicators in open collaboration frameworks. In: Proceedings of the 2nd International Conference on Educational Data Mining (EDM09), pp. 210-219, (2009b).
[8]
Anaya, A.R., Boticario, J.G.: Content-free collaborative learning modeling using data mining. Int. J. User Model. User-Adapt. Interact. Special Issue on Data Min. Person. Educ. Syst. (this issue) (2011).
[9]
Anderson, S., Messick, S.: Social competency in young children. Dev. Psychol. 10(2), 282-293 (1974).
[10]
Baker, R.S.: Data mining for education. In: McGaw, B., Baker, E., Peterson, P. (eds.) International Encyclopedia of Education, vol. 7, 3rd edn, pp. 112-118. Elsevier, Oxford (2010).
[11]
Baker, R.S., Yacef, K.: The state of educational data mining in 2009: a review and future visions. J. Educ. Data Min. 1(1), 3-17 (2009).
[12]
Baker, R.S., Corbett, A.T., Koedinger, K.R., Evenson, S., Roll, I., Wagner, A.Z., Naim, M., Raspat, J., Baker, D.J., Beck, J.E.: Adapting to when students game an intelligent tutoring system. In: Intelligent Tutoring Systems, vol. 4953/2006 of Lecture Notes in Computer Science, pp. 392-401. Springer, Berlin (2006).
[13]
Baker, R.S., Corbett, A.T., Roll, I., Koedinger, K.R.: Developing a generalizable detector of when students game the system. User Model. User-Adapt. Interact. 18(3), 287-314 (2008).
[14]
Bakiri, G., Dietterich, T.G.: Constructing high-accuracy letter-to-phoneme rules with machine learning. In: Damper, R. (ed.) Data-Driven Techniques in Speech Synthesis, pp. 27-44. Kluwer, Boston (2001).
[15]
Ballone, L.M., Czerniak, C.M.: Teachers' beliefs about accommodating students' learning styles in science classes. Electron. J. Sci. Educ. 6(2), 1-40 (2001).
[16]
Beal, C., Qu, L., Lee, H.: Classifying learner engagement through integration of multiple data sources. In: Proceedings of the 21st International Conference on Artificial Intelligence, pp. 151-156, (2006).
[17]
Beal, C., Mitra, S., Cohen, P.: Modeling learning patterns of students with a tutoring system using hidden Markov models. In: Proceedings of the 13th International Conference on Artificial Intelligence in Education (AIED), pp. 238-245, (2007).
[18]
Ben-Ari, M.: Constructivism in computer science education. ACM SIGCSE Bull. 30(1), 257-261 (1998).
[19]
Bengio, Y., Frasconi, P.: Input-output HMMs for sequence processing. IEEE Trans. Neural Netw. 7(5), 1231-1249 (1996).
[20]
Black, P.E.: "Euclidean Distance" in Dictionary of Algorithms and Data Structures. U.S. National Institute of Standards and Technology (2004). http://www.itl.nist.gov/div897/sqg/dads/HTML/euclidndstnc.html. Accessed Feb 2010.
[21]
Borek, A., McLaren, B.M., Karabinos, M., Yaron, D.: How much assistance is helpful to students in discovery learning?. In: Learning in the Synergy of Multiple Disciplines, vol. 5794/2009 of Lecture Notes in Computer Science, pp. 391-404, (2009).
[22]
Bottou, L., LeCun, Y.: Graph transformer networks for image recognition. In: Bulletin of the 55th Biennial Session of the International Statistical Institute (ISI), (2005). http://leon.bottou.org/papers/bottou-lecun-2005
[23]
Bottou, L., Bengio, Y., Le Cun, Y.: Global training of document processing systems using graph transformer networks. In: Proceedings of the 1997 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 489-494, (1997).
[24]
Brown, E., Fisher, T., Brailsford, T.: Real users, real results: examining the limitations of learning styles within AEH. In: Proceedings of the 18th Conference on Hypertext and Hypermedia, pp. 57-66, (2007).
[25]
Brusilovsky, P., Chavan, G., Farzan, R.: Social adaptive navigation support for open corpus electronic textbooks. In: Proceedings of the Third International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems, pp. 24-33, (2004).
[26]
Butler, T.J., Pinto-Zipp, G.: Students' learning styles and their preferences for online instructional methods. J. Educ. Technol. Syst. 34(2), 199-221 (2006).
[27]
Carro, R., Ortigosa, A., Schlichter, J.: Adaptive collaborative web-based courses. In: Lovelle, J., Rodrguez, B., Gayo, J., del Puerto Paule Ruiz, M., Aguilar, L. (eds.) Web Engineering, vol. 2722 of Lecture Notes in Computer Science, pp. 130-133. Springer, Berlin (2003a).
[28]
Carro, R.M., Ortigosa, A., Martn, E., Schlichter, J.: Dynamic Generation of Adaptive Web-Based Collaborative Courses, vol. 2806 of Lecture Notes in Computer Science. pp. 191-198. Springer, Berlin (2003b).
[29]
Cassidy, S.: Learning styles: an overview of theories, models and measures. Educ. Psychol. 24(4), 419-444 (2004).
[30]
Choi, H., Kang, M.: Analyzing learner behaviours, conflicting and facilitating factors of online collaborative learning using activity system. In: Proceedings of the 2008 International Conference on Learning Sciences, (2008). http://www.fi.uu.nl/en/icls2008/318/paper318.pdf
[31]
Dewar, T., Whittington, D.: Online learners and their learning strategies. J. Educ. Comput. Res. 23(4), 385-403 (2000).
[32]
Dietterich, T.G.: Machine learning for sequential data: a review. In: Structural, Syntactic, and Statistical Pattern Recognition, Lecture Notes in Computer Science, pp. 227-246. Springer, Berlin (2009).
[33]
Dillenbourg, P., Baker, M., Blaye, A., O'Malley, C.: The evolution of research on collaborative learning. In: Spada, E., Reiman, P. (eds.) Learning in Humans and Machine: Towards an Interdisciplinary Learning Science, pp. 189-211. Elsevier, Oxford (1996).
[34]
Fawcett, T., Provost, F.: Adaptive Fraud detection. Data Min. Knowl. Discov. 1(3), 291-316 (1997).
[35]
Felder, R.M., Brent, R.: Understanding student differences. J. Eng. Educ. 94(1), 57-72 (2005).
[36]
Felder, R.M., Silverman, L.K.: Learning and teaching styles in engineering education. J. Eng. Educ. 78(7), 674-681 (1988).
[37]
Hall, M., Eibe, F., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H.: The WEKA data mining software: an update. SIGKDD Explor. 11(1), 10-18 (2009).
[38]
Hämäläinen, W., Suhonen, J., Sutinen, E., Toivonen, H.: Data mining in personalizing distance education courses. In: Proceedings of the 21st ICDE World Conference on Open Learning and Distance Education, pp. 18-21, (2004).
[39]
Jain, A., Murty, M., Flynn, P.: Data clustering: a review. ACM Comput. Surv. 31(3), 264-323 (1999).
[40]
Jarvis, M.: The Psychology of Effective Learning and Teaching. Nelson Thornes, Cheltenham (2005).
[41]
Jeong, H., Biswas, G.: Mining student behaviour models in learning-by-teaching environments. In: Proceedings of the 1st International Conference on Educational Data Mining, pp. 127-136, (2008).
[42]
Kanninen, E.: Learning styles and e-learning. Master's thesis, Tampere University of Technology (2008).
[43]
Köck, M.: Towards intelligent adaptive e-learning systems--machine learning for learner activity classification. In: Proceedings of the 17th Workshop on Adaptivity and User Modeling in Interactive Systems (ABIS 09), pp. 26-31, (2009).
[44]
Koedinger, K.R., Aleven, V.: Exploring the assistance dilemma in experiments with cognitive tutors. Educ. Psychol. Rev. 19(3), 239-264 (2007).
[45]
Koedinger, K., Cunningham, K., Skogsholm, A., Leber, B.: An open repository and analysis tool for fine-grained, longitudinal learner data. In: Proceedings of Educational Data Mining 2008: 1st International Conference on Educational Data Mining, pp. 157-166, (2008).
[46]
Koedinger, K., Baker, R., Cunningham, K., Skogsholm, A., Leber, B., Stamper, J.: A data repository for the EDM community: the PSLC datashop. In: Romero, C., Ventura, S., Pechenizkiy, M., Baker, R.S. Handbook of Educational Data Mining, CRC Press, Boca Raton (2010).
[47]
Kolb, D.A.: Experiential Learning. Prentice Hall, Englewood Cliffs (1984).
[48]
Lafferty, J.D., McCallum, A., Pereira, F.C.: Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: Proceedings of the Eighteenth International Conference on Machine Learning, pp. 282-289, (2001).
[49]
Lefrancois, G.R.: Psychologie des Lernens, vol. 4. Springer, Heidelberg (2006).
[50]
Li, C., Yoo, J.: Modeling student online learning using clustering. In: ACM-SE 44: Proceedings of the 44th Annual Southeast Regional Conference, pp. 186-191. ACM, Melbourne (2006).
[51]
Li J., Zaïane, O.R.: Combining usage, content, and structure data to improve web site recommendation. In: Proceedings of the 5th International Conference on Electronic Commerce and Web Technologies (EC-Web), pp. 305-315, (2004).
[52]
Lichtenwalter, R., Lichtenwalter, K., Chawla, N.V.: Applying learning algorithms to music generation. In: Proceedings of the 4th Indian International Conference on Artificial Intelligence (IICAI 2009), pp. 483-502, (2009).
[53]
Liu, Y., Dean, G.: Cognitive styles and distance education. J. Distance Learn. Admin. 2(3), (1999). http://www.westga.edu/~distance/liu23.html
[54]
Liu, S., Joy, M., Griffiths, N.: Incorporating learning styles in a computer-supported collaborative learning model. In: Proceedings of the International Workshop on Cognitive Aspects in Intelligent Adaptive Web-Based Education Systems (CIAWES 2008), pp. 3-10, (2008).
[55]
LRN: LRN, 2010. www.dotlrn.org
[56]
Martínez, A.M., Kak, A.C.: PCA versus LDA. IEEE Trans. Knowl. Data Eng. 23(2), 228-233 (2001).
[57]
McCallum, A., Freitag, D., Pereira, F.C.: Maximum entropy Markov models for information extraction and segmentation. In: Proceedings of the Seventeenth International Conference on Machine Learning, pp. 591-598, (2000).
[58]
Moodle: Moodle.org: Open-source community-based tools for learning, (2010). www.moodle.org
[59]
Muldner, K., Burleson, W., Van e Sande, B., VanLehn, K.: An analysis of studentsc6 gaming behaviors in an intelligent tutoring system: predictors and impacts. Int. J. User Model. User-Adapt. Interact. Special Issue on Data Min. Person. Educ. Syst. (this issue) (2011).
[60]
Nelson-Le Gall, S.: Help-seeking: an understudied problem-solving skill in children. Dev. Rev. 1(3), 224-246 (1981).
[61]
Nelson-Le Gall, S.: Help Seeking behaviour in learning. Rev. Res. Educ. 12(1), 55-90 (1985).
[62]
Newman, R.: Adaptive help seeking: a strategy of self-regulated learning. In: Schunk, D., Zimmermann, B. (eds.) Self-Regulation of Learning and Performance: Issues and Educational Applications, pp. 283-301. Erlbaum, Hillsdale, NY (1994).
[63]
Paramythis, A.: Adaptive support for collaborative learning with ims learning design: are we there yet? In: Proceedings of the Workshop on Adaptive Collaboration Support, in Conjunction with the 5th International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems (AH'08), pp. 17-29, (2008).
[64]
Perera, D., Kay, J., Koprinska, I., Yacef, K., Zaïne, O.R.: Clustering and sequential pattern mining of online collaborative learning data. IEEE Trans. Knowl. Data Eng. 21(6), 759-772 (2009).
[65]
Piaget, J.: The Construction of Reality in the Child. Basic Books, New York (1954).
[66]
Qian, N., Sejnowski, T.J.: Predicting the secondary structure of globular proteins using neural network models. J. Mol. Biol. 202(4), 865-884 (1988).
[67]
Quignard, M., Baker, M.: Favouring modellable computer-mediated argumentative dialogue in collaborative problem-solving situtations. In: Proceedings of the 9th International Conference on Artificial Intelligence in Education, pp. 129-136, (1999).
[68]
Rabiner, L.R.: A tutorial on hidden Markov models and selected applications in speech recognition. In: Waibel, A., Lee, K.-F. (eds.) Readings in Speech Recognition, pp. 267-296. Morgan Kaufmann Publishers Inc, San Francisco (1990).
[69]
Razzaq, L.M., Heffernan, N.T.: To tutor or not to tutor: that is the question. In: Proceedings of the 2009 Artificial Intelligence in Education Conference, pp. 457-464, (2009).
[70]
Richmond, A.S., Cummings, R.: Implementing Kolb's learning styles into online distance education. Int. J. Technol. Teach. Learn. 1(1), 45-54 (2005).
[71]
Romero, C., Ventura, S. (eds.): Data Mining in E-Learning, vol. 4 of Advances in Management Information. WITPress.com, Wessex (2006).
[72]
Romero, C., Ventura, S.: Educational data mining: a review of the state-of-the-art. IEEE Trans. Syst. Man Cybernet. C Appl. Rev. 40(6), 601-618 (2010).
[73]
Romero, C., Ventura, S., García, E.: Data mining in course management systems: moodle case study and tutorial. Comput. Educ. 51(1), 368-384 (2007).
[74]
Romero, C., Ventura, S., Espejo, P.G., Hervás, C.: Data mining algorithms to classify students. In: Proceedings of the 1st International Conference on Educational Data Mining (EDM08), pp. 8-17, (2008).
[75]
Rummel, N., Krämer, N.: Computer-supported instructional communication: a multidisciplinary account of relevant factors. Educ. Psychol. Rev. 22(1), 1-7 (2010).
[76]
Ryan, A., Pintrich, P., Midgley, C.: Avoiding seeking help in the classroom: who and why?. Educ. Psychol. Rev. 13(2), 93-114 (2001).
[77]
Salas, E., Sims, D.E., Burke, C.: Is there a "Big Five" in teamwork?. Small Group Res. 36(5), 555-599 (2005).
[78]
Schaller, D.T., Borun, M., Allison-Bunnell, S., Chambers, M.: One size does not fit all: learning style, play, and on-line interactives. In: Proceedings of Museums and the Web 2007--the International Conference for Culture and Heritage On-Line, (2007). http://www.archimuse.com/mw2007/papers/schaller/schaller.html
[79]
Sejnowski, T.J., Rosenberg, C.R.: Parallel networks that learn to pronounce English text. J. Complex Syst. 1(1), 145-168 (1987).
[80]
Seymore, K., McCallum, A., Rosenfeld, R.: Learning hidden Markov model structure for information extraction. In: Proceedings of the AAAI 99 Workshop on Machine Learning for Information Extraction pp. 37-42, (1999).
[81]
Shannon, C.E.: A mathematical theory of communication. In: Slepian, D. (ed.) Key Papers in the Development of Information Theory. IEEE Press, New York (1974). http://cm.bell-labs.com/cm/ms/what/shannonday/paper.html
[82]
Simon, S.J.: The relationship of learning style and training method to end-user computer satisfaction and computer use: a structural equation model. Inf. Technol. Learn. Perform. J. 18(1) (2000). http://www.osra.org/itlpj/simon.PDF
[83]
Soller, A.: Adaptive support for distributed collaboration. In: Brusilovsky, P., Kobsa, A., Nejdl, W. (eds.) The Adaptive Web, vol. 4321 of Lecture Notes in Computer Science, pp. 573-595. Springer, Berlin (2007).
[84]
Soller, A., Lesgold, A.: Modeling the process of collaborative learning. In: Dillenbourg, P., Hoppe, H., Ogata, H., Soller, A. (eds.) The Role of Technology in CSCL, vol. 9 of Computer-Supported Collaborative Learning, pp. 63-86. Springer, New York (2007).
[85]
Soller, A., Martínez, A., Jermann, P., Muehlenbrock, M.: From mirroring to guiding: a review of state of the art technology for supporting collaborative learning. Int. J. Artif. Intell. Educ. 15(4), 261-290 (2005).
[86]
Srivastava, J., Cooley, R., Deshpande, M., Tan, P.-N.: Web usage mining: discovery and applications of usage patterns from web data. SIGKDD Explor. 1(2), 12-23 (2000).
[87]
Su, J.-M., Tseng, S.-S., Chen, C.-H., Lin, H.-Y.: A personalized learning content adaption mechanism to meet diverse user needs in mobile learning environments. Int. J. User Model. User-Adapt. Interact. Special Issue on Data Min. Person. Educ. Syst. (this issue) (2011).
[88]
Terrell, S.R.: Supporting different learning styles in an online learning environment: does it really matter in the long run? J. Distance Learn. Admin. 8(2) (2005). http://www.westga.edu/~distance/ojdla/summer82/terrell82.htm
[89]
Thorndike, E.L.: Educational Psychology. Kessinger Publishing, Whitefish (1903).
[90]
Vail, D.L., Veloso, M.M., Lafferty, J.D.: Conditional random fields for activity recognition. In: Proceedings of the 6th International Joint Conference on Autonomous Agents and Multiagent Systems, pp. 1-8, (2007).
[91]
VanLehn, K., Lynch, C., Schulze, K., Shapiro, J.A., Shelby, R.H., Taylor, L., Treacy, D., Weinstein, A., Wintersgill, M.: The Andes physics tutoring system: lessons learned. Int. J. Artif. Intell. Educ. 15(3), 147-204 (2005).
[92]
Vialardi, C., Bravo, J., Shafti, L., Ortigosa, A.: Recommendations in higher education using data mining techniques. In: Proceedings of the 2nd International Conference on Educational Data Mining (EDM09), pp. 190-199, (2009).
[93]
Walker, E., Rummel, N., Koedinger, K.R.: CTRL: a research framework for providing adaptive collaborative learning support. User Model. User-Adapt. Interact. 19(5), 387-431 (2009).
[94]
Wayang Outpost: Wayang Outpost (2010). www.wayangoutpost.com
[95]
Yoo, J., Li, C., Pettey, C.: Adaptive teaching strategy for online learning. In: Proceedings of the 10th International Conference on Intelligent User Interfaces (IUI '05), pp. 266-268. ACM, New York (2005).

Cited By

View all

Index Terms

  1. Activity sequence modelling and dynamic clustering for personalized e-learning
    Index terms have been assigned to the content through auto-classification.

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image User Modeling and User-Adapted Interaction
    User Modeling and User-Adapted Interaction  Volume 21, Issue 1-2
    April 2011
    244 pages

    Publisher

    Kluwer Academic Publishers

    United States

    Publication History

    Published: 01 April 2011

    Author Tags

    1. Adaptivity
    2. Clustering
    3. Data mining
    4. E-learning
    5. Unsupervised learning
    6. User modeling

    Qualifiers

    • Article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 17 Oct 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Intelligent techniques in e-learning: a literature reviewArtificial Intelligence Review10.1007/s10462-023-10508-156:12(14907-14953)Online publication date: 14-Jun-2023
    • (2022)Modeling and predicting students’ engagement behaviors using mixture Markov modelsKnowledge and Information Systems10.1007/s10115-022-01674-964:5(1349-1384)Online publication date: 1-May-2022
    • (2021)OrgMiner: A Framework for Discovering User-Related Process Intelligence from Event LogsInformation Systems Frontiers10.1007/s10796-020-09990-723:3(753-772)Online publication date: 1-Jun-2021
    • (2020)Research on the Online Learning Status of College Students Based on the Learning Community under the Epidemic SituationProceedings of the 2020 3rd International Conference on E-Business, Information Management and Computer Science10.1145/3453187.3453408(636-645)Online publication date: 5-Dec-2020
    • (2020)Social Relationship Mining Based on Student DataProceedings of the 2020 3rd International Conference on E-Business, Information Management and Computer Science10.1145/3453187.3453397(573-581)Online publication date: 5-Dec-2020
    • (2019)Uncovering Hidden Structure in Sequence Data via Threading Recurrent ModelsProceedings of the Twelfth ACM International Conference on Web Search and Data Mining10.1145/3289600.3291036(186-194)Online publication date: 30-Jan-2019
    • (2018)Discovery and temporal analysis of latent study patterns in MOOC interaction sequencesProceedings of the 8th International Conference on Learning Analytics and Knowledge10.1145/3170358.3170388(206-215)Online publication date: 7-Mar-2018
    • (2018)Mining theory-based patterns from Big dataComputers in Human Behavior10.1016/j.chb.2017.11.01180:C(179-196)Online publication date: 1-Mar-2018
    • (2017)Latent LSTM allocation joint clustering and non-linear dynamic modeling of sequential dataProceedings of the 34th International Conference on Machine Learning - Volume 7010.5555/3305890.3306091(3967-3976)Online publication date: 6-Aug-2017
    • (2015)Facilitating Learning Resource Retrieval for Students with Disabilities through an Ontology-Driven and Disability-Aware Virtual Learning EnvironmentInternational Journal of Information Retrieval Research10.5555/2807034.28070395:3(75-98)Online publication date: 1-Jul-2015
    • Show More Cited By

    View Options

    View options

    Get Access

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media