research-article

Affect and Experience: Case Studies in Games and Test-Taking

Authors:

Blair Lehman,

Delano Hebert,

G. Tanner Jackson,

Lindsay GraceAuthors Info & Claims

CHI EA '17: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Pages 917 - 924

https://doi.org/10.1145/3027063.3053341

Published: 06 May 2017 Publication History

Get Access

Abstract

The format of conventional assessments (e.g., multiple-choice) can often make it difficult for students to be motivated or engaged, which can also make it difficult for students to perform to the best of their ability. Game-based assessments (GBA) are a new type of assessment that has been designed to address this issue. We conducted an in-depth investigation of four case studies of user experience during a GBA. The GBA was manipulated in order to investigate whether certain game features (length, feedback) impacted the user experience. The case studies revealed unique patterns in user experience for moment-to-moment changes in enjoyment and frustration. These patterns suggest that GBAs could be utilized to create both a more positive test-taking experience and offer the opportunity for students to perform to the best of their ability.

Supplementary Material

ZIP File (cs1018-file3.zip)

Download
1.81 KB

suppl.mov (cs1018p.mp4)

Supplemental video

Download
780.03 KB

References

[1]

Ryan Baker, Sidney D'Mello, Ma. Mercedes Rodrigo, and Arthur Graesser. 2010. Better to be frustrated than bored: The incidence, persistence, and impact of learners' cognitive-affective states during interactions with three different computer-based learning environments. Int J of Human-Computer Studies, 68, 4: 223--241.

Digital Library

Google Scholar

[2]

Jürgen Baumert, and Anke Demmrich. 2001. Test motivation in the assessment of student skills: The effects of incentives on motivation and performance. Eur J of Psych of Ed, 16: 441--462.

Crossref

Google Scholar

[3]

Angela Duckworth and Patrick Quinn. 2009. Development and validation of the Short Grit Scale (GritS). J of Personality Assessment, 91: 166--174.

Crossref

Google Scholar

[4]

Kiel Gilleade and Alan Dix. 2004. Using frustration in the design of adaptive videogames. In Proceedings of the 2004 ACM SIGCHI Conference on Advances in Computer Entertainment Technology, 228--232.

Digital Library

Google Scholar

[5]

Seung-A Jin. 2012. "Toward integrative models of flow": Effects of performance, skill, challenge, playfulness, and presence on flow in video games. J of Broadcasting & Electronic Media, 56, 2: 169--186.

Crossref

Google Scholar

[6]

Regan Mandryk, and M. Stella Atkins. 2007. A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies. Int J of Human-Computer Studies, 65, 4: 329--347.

Digital Library

Google Scholar

[7]

Scott McQuiggan, and James Lester. 2009. Modeling affect expressions and recognition in an interactive learning environment. Int J of Learning Technology, 4, 3--4: 216--233.

Digital Library

Google Scholar

[8]

Reinhard Pekrun. 2006. The control-value theory of achievement emotions: Assumptions, corollaries, and implications for educational research and practice. Ed Psych Rev, 18, 4: 315--341.

Crossref

Google Scholar

[9]

Reinhard Pekrun, Thomas Goetz, Anne Frenzel, Petra Barchfield, and Raymond Perry. 2011. Measuring emotions in students' learning and performance: The Achievement Emotions Questionnaire (AEQ). Cont Ed Psych, 36, 1: 36--48.

Crossref

Google Scholar

[10]

Yi Song, Paul Deane, Edith Aurora Graf, and Peter van Rijn. 2013. Using argumentation learning progressions to support teaching and assessments of English language arts. R&D Connections, 22: 114.

Google Scholar

[11]

Diego Zapata-Rivera and Malcolm Bauer. 2012. Exploring the role of games in educational assessment. In Technology-based Assessments for 21st Century Skills: Theoretical and Practical Implications for Modern Research, Michael Mayrath, Jody Clarke-Midura, Daniel Robinson, and Gregory Shaw (Eds.). Information Age Publishing, Inc., Charlotte, NC, 147--169.

Google Scholar

Cited By

View all

Gomez MRuipérez-Valiente JClemente F(2023)A Systematic Literature Review of Game-Based Assessment Studies: Trends and ChallengesIEEE Transactions on Learning Technologies10.1109/TLT.2022.322666116:4(500-515)Online publication date: Aug-2023
https://doi.org/10.1109/TLT.2022.3226661
Ma SBhagat KSpector JLin-Lipsmeyer LLiu DLeng JTiruneh DMancini J(2023)Developing Critical Thinking: A Review of Past Efforts as a Framework for a New Approach for Childhood LearningLearning, Design, and Technology10.1007/978-3-319-17727-4_161-2(1-28)Online publication date: 7-Jul-2023
https://doi.org/10.1007/978-3-319-17727-4_161-2
Ma SBhagat KSpector JLin-Lipsmeyer LLiu DLeng JTiruneh DMancini J(2023)Developing Critical Thinking: A Review of Past Efforts as a Framework for a New Approach for Childhood LearningLearning, Design, and Technology10.1007/978-3-319-17461-7_161(4007-4034)Online publication date: 15-Oct-2023
https://doi.org/10.1007/978-3-319-17461-7_161
Show More Cited By

Index Terms

Affect and Experience: Case Studies in Games and Test-Taking
1. Applied computing
  1. Computers in other domains
    1. Personal computers and PC applications
2. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Negative Emotion, Positive Experience?: Emotionally Moving Moments in Digital Games
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

Emotions are key to the player experience (PX) and interest in the potential of games to provide unique emotional, sometimes uncomfortable experiences is growing. Yet there has been little empirical investigation of what game experiences players ...
The experience of interactive storytelling: comparing “fahrenheit” with “façade”
ICEC'11: Proceedings of the 10th international conference on Entertainment Computing

At the intersection of multimedia, artificial intelligence, and gaming technology, new visions of future entertainment media arise that approximate the “Holodeck” ® idea of interactive storytelling. We report exploratory experiments on the user ...
Emotional user experience

Emotional experience has become an important topic in human-technology interaction research and design. Nevertheless, such research and design often lacks a proper explanatory basis and methodologically robust operationalisation. In this article, a ...

Comments

Information & Contributors

Information

Published In

CHI EA '17: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems

May 2017

3954 pages

ISBN:9781450346566

DOI:10.1145/3027063

General Chairs:
Gloria Mark
University of California Irvine
,
Susan Fussell
Cornell University
,
Program Chairs:
Cliff Lampe
University of Michigan
,
m.c. schraefel
University of Southampton
,
Juan Pablo Hourcade
University of Iowa
,
Caroline Appert
Université Paris-Sud
,
Daniel Wigdor
University of Toronto

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 May 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '17

Sponsor:

SIGCHI

CHI '17: CHI Conference on Human Factors in Computing Systems

May 6 - 11, 2017

Colorado, Denver, USA

Acceptance Rates

CHI EA '17 Paper Acceptance Rate 1,000 of 5,000 submissions, 20%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
219
Total Downloads

Downloads (Last 12 months)13
Downloads (Last 6 weeks)0

Reflects downloads up to 04 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Gomez MRuipérez-Valiente JClemente F(2023)A Systematic Literature Review of Game-Based Assessment Studies: Trends and ChallengesIEEE Transactions on Learning Technologies10.1109/TLT.2022.322666116:4(500-515)Online publication date: Aug-2023
https://doi.org/10.1109/TLT.2022.3226661
Ma SBhagat KSpector JLin-Lipsmeyer LLiu DLeng JTiruneh DMancini J(2023)Developing Critical Thinking: A Review of Past Efforts as a Framework for a New Approach for Childhood LearningLearning, Design, and Technology10.1007/978-3-319-17727-4_161-2(1-28)Online publication date: 7-Jul-2023
https://doi.org/10.1007/978-3-319-17727-4_161-2
Ma SBhagat KSpector JLin-Lipsmeyer LLiu DLeng JTiruneh DMancini J(2023)Developing Critical Thinking: A Review of Past Efforts as a Framework for a New Approach for Childhood LearningLearning, Design, and Technology10.1007/978-3-319-17461-7_161(4007-4034)Online publication date: 15-Oct-2023
https://doi.org/10.1007/978-3-319-17461-7_161
Grace LJackson GLehman BBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)The Effect of Positive and Negative Goal Orientation and Player Embodiment in Assessment GamesExtended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3334480.3375226(1-8)Online publication date: 25-Apr-2020
https://dl.acm.org/doi/10.1145/3334480.3375226
Ma SBhagat KSpector JLin LLiu DLeng JTiruneh DMancini J(2020)Developing Critical Thinking: A Review of Past Efforts as a Framework for a New Approach for Childhood LearningLearning, Design, and Technology10.1007/978-3-319-17727-4_161-1(1-26)Online publication date: 14-Jan-2020
https://doi.org/10.1007/978-3-319-17727-4_161-1
Kaczmarek SPetroviča S(2018)Promotion of Learning Motivation through Individualization of Learner-Game Interaction2018 IEEE Conference on Computational Intelligence and Games (CIG)10.1109/CIG.2018.8490371(1-8)Online publication date: 14-Aug-2018
https://dl.acm.org/doi/10.1109/CIG.2018.8490371
Petroviča SAnohina-Naumeca A(2017)The Adaptation Approach for Affective Game-Based AssessmentApplied Computer Systems10.1515/acss-2017-001322:1(13-20)Online publication date: 27-Dec-2017
https://doi.org/10.1515/acss-2017-0013

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Negative Emotion, Positive Experience?: Emotionally Moving Moments in Digital Games

The experience of interactive storytelling: comparing “fahrenheit” with “façade”

Emotional user experience