Abstract
Intelligent Tutoring Systems are now mature technologies that successfully help students to acquire new knowledge and competencies through various educational methods and in a personalized way. However, evaluating precisely what they recall at the end of the learning process remains a complex task. In this paper, we study if there are correlations between memory and gaze data in the context of e-education. Our long-term goal is to model the memory of students thank to an eye-tracker in a continuous and transparent way. These models could then be used to adapt recommendations of pedagogical resources to the students’ learning rate. So as to address this research question, we designed an experiment where students were asked to learn a short lesson about Esperanto. Our results show that some gaze characteristics are correlated with recall in memory.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Aben, B., Stapert, S., Blokland, A.: About the distinction between working memory and short-term memory. Front. Psychol. 3, 301 (2012)
Baddeley, A.: The episodic buffer: a new component of working memory? Trends Cogn. Sci. 4(11), 417–423 (2000). https://doi.org/10.1016/S1364-6613(00)01538-2
Bondareva, D., Conati, C., Feyzi-Behnagh, R., Harley, J.M., Azevedo, R., Bouchet, F.: Inferring learning from gaze data during interaction with an environment to support self-regulated learning. In: Lane, H.C., Yacef, K., Mostow, J., Pavlik, P. (eds.) AIED 2013. LNCS (LNAI), vol. 7926, pp. 229–238. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39112-5_24
Borkin, M.A., et al.: Beyond memorability: visualization recognition and recall. IEEE Trans. Vis. Comput. Graph. 22(1), 519–528 (2016)
Bylinskii, Z., Borkin, M.A., Kim, N.W., Pfister, H., Oliva, A.: Eye fixation metrics for large scale evaluation and comparison of information visualizations. In: Burch, M., Chuang, L., Fisher, B., Schmidt, A., Weiskopf, D. (eds.) ETVIS 2015. MV, pp. 235–255. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-47024-5_14
Clariana, R.B., Lee, D.: The effects of recognition and recall study tasks with feedback in a computer-based vocabulary lesson. Educ. Technol. Res. Dev. 49(3), 23–36 (2001)
Hannula, D.E., Ranganath, C.: The eyes have it: hippocampal activity predicts expression of memory in eye movements. Neuron 63, 592–599 (2009)
Holland, C., Komogortsev, O.V.: Biometric identification via eye movement scanpaths in reading. In: 2011 International Joint Conference on Biometrics (IJCB), pp. 1–8, October 2011. https://doi.org/10.1109/IJCB.2011.6117536
Just, M.A., Carpenter, P.A.: Eye fixations and cognitive processes. Cogn. Psychol. 8, 441–480 (1976)
Komogortsev, O., Gobert, D., Jayarathna, S., Koh, D., Gowda, S.: Standardization of automated analyses of oculomotor fixation and saccadic behaviors. IEEE Trans. Biomed. Eng. 57, 2635–2645 (2010). https://doi.org/10.1109/TBME.2010.2057429
Komogortsev, O.V., Jayarathna, S., Koh, D.H., Gowda, S.M.: Qualitative and quantitative scoring and evaluation of the eye movement classification algorithms. In: Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications, ETRA 2010, pp. 65–68. ACM, New York (2010). https://doi.org/10.1145/1743666.1743682
Shiffrin, R.M., Atkinson, R.C.: Storage and retrieval processes in long-term memory. Psychol. Rev. 76, 179–193 (1969). https://doi.org/10.1037/h0027277
Marchal, F., Castagnos, S., Boyer, A.: First attempt to predict user memoryfrom gaze data. Int. J. Artif. Intell. Tools 27(6), 1850029 (2018)
Miyake, A., Friedman, N., Emerson, J.M., Witzki, A., Howerter, A., Wager, T.: The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: a latent variable analysis. Cogn. Psychol. 41, 49–100 (2000). https://doi.org/10.1006/cogp.1999.0734
Salvucci, D.D., Goldberg, J.H.: Identifying fixations and saccades in eye-tracking protocols. In: Proceedings of the 2000 Symposium on Eye Tracking Research & Applications, ETRA 2000, pp. 71–78. ACM, New York (2000). https://doi.org/10.1145/355017.355028
Sharafi, Z., Shaffer, T., Sharif, B., Guéhéneuc, Y.: Eye-tracking metrics in software engineering. In: 2015 Asia-Pacific Software Engineering Conference (APSEC), pp. 96–103, December 2015. https://doi.org/10.1109/APSEC.2015.53
Squire, L.R., Dede, A.J.O.: Conscious and unconscious memory systems. Cold Spring Harbor Perspect. Biol. 7(3), a021667 (2015)
Steichen, B., Wu, M.M.A., Toker, D., Conati, C., Carenini, G.: Te,Te,Hi,Hi: eye gaze sequence analysis for informing user-adaptive information visualizations. In: Dimitrova, V., Kuflik, T., Chin, D., Ricci, F., Dolog, P., Houben, G.-J. (eds.) UMAP 2014. LNCS, vol. 8538, pp. 183–194. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-08786-3_16
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Beuget, M., Castagnos, S., Luxembourger, C., Boyer, A. (2019). Eye Gaze Sequence Analysis to Model Memory in E-education. In: Isotani, S., Millán, E., Ogan, A., Hastings, P., McLaren, B., Luckin, R. (eds) Artificial Intelligence in Education. AIED 2019. Lecture Notes in Computer Science(), vol 11626. Springer, Cham. https://doi.org/10.1007/978-3-030-23207-8_5
Download citation
DOI: https://doi.org/10.1007/978-3-030-23207-8_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-23206-1
Online ISBN: 978-3-030-23207-8
eBook Packages: Computer ScienceComputer Science (R0)