Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
Springer Nature Link
Log in

Variations of Gaming Behaviors Across Populations of Students and Across Learning Environments

  • Conference paper
  • First Online:
Artificial Intelligence in Education (AIED 2017)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10331))

Included in the following conference series:

Abstract

Although gaming the system, a behavior in which students attempt to solve problems by exploiting help functionalities of digital learning environments, has been studied across multiple learning environments, little research has been done to study how (and whether) gaming manifests differently across populations of students and learning environments. In this paper, we study the differences in usage of 13 different patterns of actions associated with gaming the system by comparing their distribution across different populations of students using Cognitive Tutor Algebra and across students using one of three learning environments: Cognitive Tutor Algebra, Cognitive Tutor Middle School and ASSISTments. Results suggest that differences in gaming behavior are more strongly associated to the learning environments than to student populations and reveal different trends in how students use fast actions, similar answers and help request in different systems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Baker, R.S.J., Corbett, A.T., Roll, I., Koedinger, K.R.: Developing a generalizable detector of when students games the system. User Model. User Adap. Inter. 18, 287–314 (2008)

    Article  Google Scholar 

  2. Beck, J., Rodrigo, M.M.T.: Understanding wheel spinning in the context of affective factors. In: Proceedings of the 12th International Conference on Intelligent Tutoring Systems, pp. 162–167 (2014)

    Google Scholar 

  3. Cocea, M., Hershkovitz, A., Baker, R.S.J.: The impact of off-task and gaming behaviors on learning: immediate or aggregate? In: Proceedings of the 14th International Conference on Artificial Intelligence in Education, pp. 507–514 (2009)

    Google Scholar 

  4. Fancsali, S.E.: Data-driven causal modeling of “Gaming the System” and off-task behavior in cognitive tutor algebra. NIPS Workshop on Data Driven Education

    Google Scholar 

  5. Pardos, Z.A., Baker, R.S., San Pedro, M.O.C.Z., Gowda, S.M., Gowda, S.M.: Affective states and state tests: investigating how affect and engagement during the school year predict end of year learning outcomes. J. Learn. Anal. 1(1), 107–128 (2014)

    Article  Google Scholar 

  6. Baker, R.S.J., D’Mello, S.K., Rodrigo, M.M.T., Graesser, A.C.: Better to be frustrated than bored: the incidence, persistence, and impact of learners’ cognitive-affective states during interactions with three different computer-based learning environments. Int. J. Hum Comput Stud. 68, 223–241 (2010)

    Article  Google Scholar 

  7. San Pedro, M.O.Z., Baker, R.S.J., Bowers, A.J., Heffernan, N.T.: Predicting college enrolment from student interaction with an intelligent tutoring system in middle school. In: Proceedings of the 6th International Conference on Educational Data Mining, pp. 177–184 (2013)

    Google Scholar 

  8. Baker, R.S.J., Mitrovic, A., Mathews, M.: Detecting gaming the system in constraint-based tutors. In: Proceedings of the 18th Conference on User Modeling, Adaptation and Personalization, pp. 267–278 (2010)

    Google Scholar 

  9. Walonoski, J.A., Heffernan, N.T.: Detection and analysis of off-task gaming behavior in intelligent tutoring systems. In: Proceedings of the 8th International Conference on Intelligent Tutoring Systems, pp. 382–391 (2006)

    Google Scholar 

  10. Beal, C.R., Qu, L., Lee, H.: Classifying learner engagement through integration of multiple data sources. In: Proceedings of the National Conference on Artificial Intelligence, pp. 151–156 (2006)

    Google Scholar 

  11. Johns, J., Woolf, B.: A dynamic mixture model to detect student motivation and proficiency. In: Proceedings of the National Conference on Artificial Intelligence, pp. 163–168 (2006)

    Google Scholar 

  12. Muldner, K., Burleson, W., Van de Sande, B., VanLehn, K.: An analysis of students’ gaming behaviors in an intelligent tutoring system: predictors and impact. User Model. User Adap. Inter. 21, 99–135 (2011)

    Article  Google Scholar 

  13. Aleven, V., McLaren, B.M., Roll, I., Koedinger, K.R.: Towards meta-cognitive tutoring: a model of help seeking with a cognitive tutor. Int. J. Artif. Intell. Educ. 16, 101–130 (2006)

    Google Scholar 

  14. Gong, Y., Beck, J., Heffernan, N.T., Forbes-Summer, E.: The fine-grained impact of gaming (?) on learning. In: Proceedings of the 10th International Conference on Intelligent Tutoring Systems, pp. 194–203 (2010)

    Google Scholar 

  15. Baker, R.S.J., Gowda, S.M.: An analysis of the differences in the frequency of students’ disengagement in Urban, Rural, and Suburban High Schools. In: Proceedings of the 3rd International Conference on Educational Data Mining, pp. 11–20 (2010)

    Google Scholar 

  16. Ocumpaugh, J., Baker, R.S., Gowda, S., Heffernan, N., Heffernan, C.: Population validity for educational data mining models: a case study in affect detection. Br. J. Educ. Technol. 45(3), 487–501 (2014)

    Article  Google Scholar 

  17. Paquette, L., Baker, R.S., de Carvalho, A.M.J.A., Ocumpaugh, J.: Cross-system transfer of machine learned and knowledge engineered models of gaming the system. In: Proceedings of the 23rd Conference on User Modeling, Adaptation and Personalization, pp. 183–194 (2015)

    Google Scholar 

  18. Koedinger, K.R, Corbett, A.T.: Cognitive tutors: technology bringing learning sciences to the classroom. In: Sawyer, R.K. (ed.) The Cambridge Handbook of the Learning Sciences, pp. 61–77 (2006)

    Google Scholar 

  19. Razzaq, L., et al.: The assistment project: blending assessment and assisting. In: Proc. of the 12 Annual Conference on Artificial Intelligence in Education, pp. 555–562 (2005)

    Google Scholar 

  20. Paquette, L., de Carvalho, A.M.J.A, Baker, R.S.: Towards understanding export coding of student disengagement in online learning. In: Proceedings of the 36th Annual Cognitive Science Conference, pp. 1126–1131 (2014)

    Google Scholar 

  21. Clark, R.E., Feldon, D., van Merriënboer, J., Yates, K., Early, S.: Cognitive task analysis. In: Spector, J.M., Merrill, M.D., van Merriënboer, J.J.G., Driscoll, M.P. (eds.) Handbook of Research on Educational Communications and Technology, 3rd edn., pp. 575–593 (2008)

    Google Scholar 

  22. Cooke, N.J.: Varieties of knowledge elicitation techniques. Int. J. Hum Comput Stud. 41, 801–849 (1994)

    Article  MATH  Google Scholar 

  23. Meyer, M.A.: How to apply the anthropological technique of participant observation to knowledge acquisition for expert systems. IEEE Trans. Syst. Man Cybern. 22, 983–991 (1992)

    Article  Google Scholar 

  24. Van Someren, M.W., Barnard, Y.F., Sandberg, J.A.C.: The Think Aloud Method: A Practical Guide to Modeling Cognitive Processes. Academic Press, London (1994)

    Google Scholar 

  25. Levenshtein, A.: Binary codes capable of correcting deletions, insertions and reversals. Sov. Phys. Dokl. 10(8), 707–710 (1966)

    MATH  MathSciNet  Google Scholar 

  26. Cohen, J.: A coefficient of agreement for nominal scales. Educ. Psychol. Measur. 20(1), 37–46 (1960)

    Article  Google Scholar 

  27. Baker, R.S.J., de Carvalho, A.M.J.A.: Labeling student behavior faster and more precisely with text replays. In: Proceedings of the 1st International Conference on Educational Data Mining 2008, pp. 38–47 (2008)

    Google Scholar 

  28. Paquette, L., de Carvalho, A.M.J.A, Baker, R.S., Ocumpaugh, J.: Reengineering the feature distillation process: a case study in the detection of gaming the system. In: Proceedings of the 7th International Conference on Educational Data Mining, pp. 284–287 (2014)

    Google Scholar 

  29. Koedinger, K.R., Baker, R., Cunningham, K., Skogsholm, A., Leber, B., Stamper, J.: A Data Repository for the Community: The PLSC DataShop. CRC Press, Boca Raton (2010)

    Google Scholar 

  30. Benjamini, Y., Hochberg, Y.: Controlling the False discovery rate: a practical and powerful approach to multiple testing. J. Roy. Stat. Soc. B 57, 289–300 (2003)

    MATH  MathSciNet  Google Scholar 

  31. Murray, C., VanLehn, K.: Effects of dissuading unnecessary help requests while providing proactive help. In: Proceedings of the International Conference on Artificial Intelligence and Education, pp. 887–889 (2005)

    Google Scholar 

Download references

Acknowledgement

We would like to thank PSLC DataShop, Carnegie Learning and the ASSISTments team for providing us with access to student data. We would also like to thank support from NSF #DRL-1535340 and NSF #DRL-1252297.

Author information

Authors and Affiliations

  1. University of Illinois at Urbana-Champaign, Champaign, IL, USA

    Luc Paquette

  2. University of Pennsylvania, Philadelphia, PA, USA

    Ryan S. Baker

Authors
  1. Luc Paquette
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ryan S. Baker
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Luc Paquette .

Editor information

Editors and Affiliations

  1. Human-Centered Multimedia, University of Augsburg, Augsburg, Germany

    Elisabeth André

  2. University of Pennsylvania, Philadelphia, Pennsylvania, USA

    Ryan Baker

  3. Department of Psychology, University of Memphis, Memphis, Tennessee, USA

    Xiangen Hu

  4. Ateneo de Manila University, Quezon City, Philippines

    Ma. Mercedes T. Rodrigo

  5. University of Sussex, Brighton, United Kingdom

    Benedict du Boulay

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Paquette, L., Baker, R.S. (2017). Variations of Gaming Behaviors Across Populations of Students and Across Learning Environments. In: André, E., Baker, R., Hu, X., Rodrigo, M., du Boulay, B. (eds) Artificial Intelligence in Education. AIED 2017. Lecture Notes in Computer Science(), vol 10331. Springer, Cham. https://doi.org/10.1007/978-3-319-61425-0_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-61425-0_23

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-61424-3

  • Online ISBN: 978-3-319-61425-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation