Abstract
Help from virtual pedagogical agents has the potential to improve student learning. Yet students often do not seek help when they need it, do not use help effectively, or ignore the agent’s help altogether. This paper seeks to better understand students’ patterns of accepting and seeking help in a computer-based science program called Betty’s Brain. Focusing on student interactions with the mentor agent, Mr. Davis, we examine the factors associated with patterns of help acceptance and help seeking; the relationship between help acceptance and help seeking; and how each behavior is related to learning outcomes. First, we examine whether students accepted help from Mr. Davis, operationalized as whether they followed his suggestions to read specific textbook pages. We find a significant positive relationship between help acceptance and student post-test scores. Despite this, help accepters made fewer positive statements about Mr. Davis in the interviews. Second, we identify how many times students proactively sought help from Mr. Davis. Students who most frequently sought help demonstrated more confusion while learning (measured using an interaction-based ML-based detector); tended to have higher science anxiety; and made more negative statements about Mr. Davis, compared to those who made few or no requests. However, help seeking was not significantly related to post-test scores. Finally, we draw from the qualitative interviews to consider how students understand and articulate their experiences with help from Mr. Davis.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Aleven, V., Stahl, E., Schworm, S., Fischer, F., Wallace, R.: Help seeking and help design in interactive learning environments. Rev. Ed. Res. 73, 277–320 (2003). https://doi.org/10.3102/00346543073003277
Aleven, V., Roll, I., McLaren, B.M., Koedinger, K.R.: Help helps, but only so much: research on help seeking with intelligent tutoring systems. Int. J. Artif. Intell. Educ. 26(1), 205–223 (2016). https://doi.org/10.1007/s40593-015-0089-1
Karumbaiah, S., Ocumpaugh, J., Baker, R.S.: Context matters: differing implications of motivation and help-seeking in educational technology. Int. J. Artif. Intell. Educ. 32, 685–724 (2021). https://doi.org/10.1007/s40593-021-00272-0
Segedy, J.R., Kinnebrew, J.S., Biswas, G.: Investigating the relationship between dialogue responsiveness and learning in a teachable agent environment. In: Biswas, G., Bull, S., Kay, J., Mitrovic, A. (eds.) AIED 2011. LNCS (LNAI), vol. 6738, pp. 547–549. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-21869-9_97
Biswas, G., Segedy, J.R., Bunchongchit, K.: From design to implementation to practice a learning by teaching system: betty’s brain. Int. J. Artif. Intell. Educ. 26(1), 350–364 (2015). https://doi.org/10.1007/s40593-015-0057-9
Karabenick, S.A., Gonida, E.N.: Academic help seeking as a self-regulated learning strategy: current issues, future directions. In: Alexander, P.A., Schunk, D.H., Green, J.A. (eds.) Handbook of Self-Regulation of Learning and Performance, pp. 421–433. Routledge Handbooks Online (2017). https://doi.org/10.4324/9781315697048.ch27
Wood, H., Wood, D.: Help seeking, learning and contingent tutoring. Comput Educ. 33, 153–169 (1999)
Segedy, J., Kinnebrew, J., Biswas, G.: Supporting student learning using conversational agents in a teachable agent environment. In: van Aalst, J., Thompson, K., Jacobson, M.J., Reimann, P. (eds.) The Future of Learning: Proceedings of the 10th International Conference of the Learning Sciences, pp. 251–255. International Society of the Learning Sciences, Sydney, Australia (2012)
Mathews, M., Mitrović, T., Thomson, D.: Analysing high-level help-seeking behaviour in ITSs. In: Nejdl, W., Kay, J., Pu, P., Herder, E. (eds.) AH 2008. LNCS, vol. 5149, pp. 312–315. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-70987-9_42
Baker, R.S., Corbett, A.T., Koedinger, K.R., Wagner, A.Z.: Off-task behavior in the cognitive tutor classroom: when students “game the system.” In: Proceedings of ACM CHI 2004: Computer-Human Interaction, pp. 383–390 (2004)
Roll, I., Baker, R., Aleven, V., Koedinger, K.R.: On the benefits of seeking (and avoiding) help in online problem-solving environments. J. Learn. Sci. 23(4), 537–560 (2014). https://doi.org/10.1080/10508406.2014.883977
Andres, J.M.A.L., Hutt, S., Ocumpaugh, J., Baker, R.S., Nasiar, N., Porter, C.: How anxiety affects affect: a quantitative ethnographic investigation using affect detectors and data-targeted interviews. In: Wasson, B., Zörgő, S. (eds.) Advances in Quantitative Ethnography: Third International Conference, ICQE 2021, Virtual Event, November 6–11, 2021, Proceedings, pp. 268–283. Springer International Publishing, Cham (2022). https://doi.org/10.1007/978-3-030-93859-8_18
Munshi, A., Biswas, G., Baker, R., Ocumpaugh, J., Hutt, S., Paquette, L.: Analysing adaptive scaffolds that help students develop self-regulated learning behaviours. J. Comput. Assist. Learn. 39, 351–368 (2022). https://doi.org/10.1111/jcal.12761
Hutt, S., Ocumpaugh, J., Andres, J.M.A.L., Munshi, A., Bosch, N., Paquette, L., Biswas, G., Baker, R.: Sharpest tool in the shed: Investigating SMART models of self-regulation and their impact on learning. In: Hsiao, I.-H., Sahebi, S., Bouchet, F., Vie, J.-J. (eds.) Proceedings of the 14th International Conference on Educational Data Mining (2021)
Jiang, Y., et al.: Expert feature-engineering vs. deep neural networks: which is better for sensor-free affect detection? In: Penstein Rosé, C., et al. (eds.) AIED 2018. LNCS (LNAI), vol. 10947, pp. 198–211. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-93843-1_15
Hutt, S., et al.: Quick red fox: an app supporting a new paradigm in qualitative research on AIED for STEM. In: Ouyang, F., Jiao, P., McLaren, B.M., Alavi, A.H. (eds.) Artificial Intelligence in STEM Education: The Paradigmatic Shifts in Research, Education, and Technology (In press)
Ocumpaugh, J., et al.: Using qualitative data from targeted interviews to inform rapid AIED development. In: Rodrigo, M.M.T., Iyer, S., and Mitrovic, A. (eds.) 29th International Conference on Computers in Education Conference, ICCE 2021 – Proceedings. pp. 69–74 (2021)
Hutt, S., et al.: Who’s stopping you? – using microanalysis to explore the impact of science anxiety on self-regulated learning operations. In: Proceedings of the Annual Meeting of the Cognitive Science Society, vol. 43 (2021)
Mahmood, S., Khatoon, T.: Development and validation of the mathematics anxiety scale for secondary and senior secondary school students. Br. J. Sociol. 2, 170–179 (2011)
McCullagh, P.: Regression models for ordinal data. J. R. Stat. Soc. Ser. B Stat. Methodol. 42, 109–142 (1980)
Ryan, A.M., Shim, S.S., Lampkins-uThando, S.A., Kiefer, S.M., Thompson, G.N.: Do gender differences in help avoidance vary by ethnicity? An examination of African American and European American students during early adolescence. Dev. Psychol. 45, 1152 (2009). https://doi.org/10.1037/a0013916
Calarco, J.M.: “I need help!” social class and children’s help-seeking in elementary school. Am. Soc. Rev. 76, 862–882 (2011). https://doi.org/10.1177/0003122411427177
Acknowledgments
This work was supported by NSF #DRL-1561567. Elena G. van Stee was supported by a fellowship from the Institute of Education Sciences under Award #3505B200035 to the University of Pennsylvania during her work on this project. Taylor Heath was supported by a NIH T32 Grant under award #5T32HD007242-40. The opinions expressed are those of the authors and do not represent views of the funding agencies.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
van Stee, E.G., Heath, T., Baker, R.S., Andres, J.M.A.L., Ocumpaugh, J. (2023). Help Seekers vs. Help Accepters: Understanding Student Engagement with a Mentor Agent. In: Wang, N., Rebolledo-Mendez, G., Matsuda, N., Santos, O.C., Dimitrova, V. (eds) Artificial Intelligence in Education. AIED 2023. Lecture Notes in Computer Science(), vol 13916. Springer, Cham. https://doi.org/10.1007/978-3-031-36272-9_12
Download citation
DOI: https://doi.org/10.1007/978-3-031-36272-9_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-36271-2
Online ISBN: 978-3-031-36272-9
eBook Packages: Computer ScienceComputer Science (R0)