research-article

Fused Spectatorship: Designing Bodily Experiences Where Spectators Become Players

Authors:

Rakesh Patibanda,

Nathalie Overdevest,

Maria F. Montoya,

Elise van den Hoven,

Florian ‘Floyd’ MuellerAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 7, Issue CHI PLAY

Article No.: 403, Pages 769 - 802

https://doi.org/10.1145/3611049

Published: 04 October 2023 Publication History

Abstract

Spectating digital games can be exciting. However, due to its vicarious nature, spectators often wish to engage in the gameplay beyond just watching and cheering. To blur the boundaries between spectators and players, we propose a novel approach called "Fused Spectatorship", where spectators watch their hands play games by loaning bodily control to a computational Electrical Muscle Stimulation (EMS) system. To showcase this concept, we designed three games where spectators loan control over both their hands to the EMS system and watch them play these competitive and collaborative games. A study with 12 participants suggested that participants could not distinguish if they were watching their hands play, or if they were playing the games themselves. We used our results to articulate four spectator experience themes and four fused spectator types, the behaviours they elicited and offer one design consideration to support each of these behaviours. We also discuss the ethical design considerations of our approach to help game designers create future fused spectatorship experiences.

References

[1]

2022. https://en.wikipedia.org/w/index.php?title=Wuxing_(Chinese_philosophy)&oldid=1107074912 Page Version ID: 1107074912

[2]

2022. https://en.wikipedia.org/w/index.php?title=Godai_(Japanese_philosophy)&oldid=1094331559 Page Version ID: 1094331559

[3]

2022. https://en.wikipedia.org/w/index.php?title=Blackjack&oldid=1106791426 Page Version ID: 1106791426

[4]

2022. https://en.wikipedia.org/w/index.php?title=Mahjong&oldid=1106967385 Page Version ID: 1106967385

[5]

Josh Andres, Julian de Hoog, and Florian ‘Floyd’ Mueller. 2018. “I Had Super-Powers When EBike Riding” Towards Understanding the Design of Integrated Exertion. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY ’18). Association for Computing Machinery, New York, NY, USA. 19–31. isbn:978-1-4503-5624-4 https://doi.org/10.1145/3242671.3242688 event-place: Melbourne, VIC, Australia

Digital Library

[6]

Tetsuo Ashizawa and Guangbin Xia. 2016. Ataxia. Continuum: Lifelong Learning in Neurology, 22, 4 Movement Disorders (2016), Aug, 1208–1226. issn:1080-2371 https://doi.org/10.1212/CON.0000000000000362

[7]

Rose Baker, Karina Ramos, and John Turner. 2018. Game design for visually-impaired individuals: Creativity and innovation theories and sensory substitution devices influence on virtual and physical navigation skills. Irish Journal of Technology Enhanced Learning, 4 (2018), Oct, 36. https://doi.org/10.22554/ijtel.v4i1.51

[8]

Richard Bartle. 1996. Hearts, clubs, diamonds, spades: Players who suit MUDs. Journal of MUD research, 1, 1 (1996), 19.

[9]

Tilde Bekker, Janienke Sturm, and Emilia Barakova. 2009. 2nd Workshop on Design for Social Interaction through Physical Play. In Human-Computer Interaction - INTERACT 2009, Tom Gross, Jan Gulliksen, Paula Kotzé, Lars Oestreicher, Philippe Palanque, Raquel Oliveira Prates, and Marco Winckler (Eds.) (Lecture Notes in Computer Science). Springer, Berlin, Heidelberg. 952–953. isbn:978-3-642-03658-3 https://doi.org/10.1007/978-3-642-03658-3_127

Digital Library

[10]

Steve Benford, Richard Ramchurn, Joe Marshall, Max L. Wilson, Matthew Pike, Sarah Martindale, Adrian Hazzard, Chris Greenhalgh, Maria Kallionpää, Paul Tennent, and Brendan Walker. 2021. Contesting control: journeys through surrender, self-awareness and looseness of control in embodied interaction. Human-Computer Interaction, 36, 5-6 (2021), Oct, 361–389. issn:0737-0024 https://doi.org/10.1080/07370024.2020.1754214

[11]

Nadia Bianchi-Berthouze, Whan Woong Kim, and Darshak Patel. 2007. Does Body Movement Engage You More in Digital Game Play? and Why? Springer Berlin Heidelberg, 102–113. isbn:978-3-540-74888-5 http://link.springer.com.ezproxy.lib.rmit.edu.au/chapter/10.1007/978-3-540-74889-2_10

[12]

Tobias Blum, Valerie Kleeberger, Christoph Bichlmeier, and Nassir Navab. 2012. mirracle: An augmented reality magic mirror system for anatomy education. In 2012 IEEE Virtual Reality Workshops (VRW). 115–116. issn:2375-5334 https://doi.org/10.1109/VR.2012.6180909

Digital Library

[13]

David Bordwell, Kristin Thompson, and Jeff Smith. 2008. Film art: An introduction. 8, McGraw-Hill New York. Citation Key: bordwell2008film

[14]

Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology, 3, 2 (2006), Jan, 77–101. issn:1478-0887 https://doi.org/10.1191/1478088706qp063oa

[15]

Emily Brown and Paul Cairns. 2004. A grounded investigation of game immersion. In CHI ’04 Extended Abstracts on Human Factors in Computing Systems (CHI EA ’04). Association for Computing Machinery, New York, NY, USA. 1297–1300. isbn:978-1-58113-703-3 https://doi.org/10.1145/985921.986048

Digital Library

[16]

Catherine Burwell. 2017. Game changers: making new meanings and new media with video games. English Journal, 106, 6 (2017), 41–47.

[17]

Catherine Burwell and Thomas Miller. 2016. Let’s Play: Exploring literacy practices in an emerging videogame paratext. E-Learning and Digital Media, 13, 3-4 (2016), May, 109–125. issn:2042-7530 https://doi.org/10.1177/2042753016677858

[18]

Roger Caillois. 2001. Man, Play, and Games. University of Illinois Press. isbn:978-0-252-07033-4 Google-Books-ID: bDjOPsjzfC4C

[19]

Ann Cavoukian. 2010. Privacy by design: the definitive workshop. A foreword by Ann Cavoukian, Ph.D. Identity in the Information Society, 3, 2 (2010), Aug, 247–251. issn:1876-0678 https://doi.org/10.1007/s12394-010-0062-y

[20]

Alan Chamberlain, Andy Crabtree, Tom Rodden, Matt Jones, and Yvonne Rogers. 2012. Research in the wild: understanding “in the wild” approaches to design and development. In Proceedings of the Designing Interactive Systems Conference (DIS ’12). Association for Computing Machinery, New York, NY, USA. 795–796. isbn:978-1-4503-1210-3 https://doi.org/10.1145/2317956.2318078

Digital Library

[21]

Julia Chatain, Danielle M Sisserman, Lea Reichardt, Violaine Fayolle, Manu Kapur, Robert W Sumner, Fabio Zünd, and Amit H Bermano. 2020. DigiGlo: Exploring the Palm as an Input and Display Mechanism through Digital Gloves. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (CHI PLAY ’20). Association for Computing Machinery, New York, NY, USA. 374–385. isbn:978-1-4503-8074-4 https://doi.org/10/gj5sjb

Digital Library

[22]

Gifford Cheung and Jeff Huang. 2011. Starcraft from the stands: understanding the game spectator. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’11). Association for Computing Machinery, New York, NY, USA. 763–772. isbn:978-1-4503-0228-9 https://doi.org/10.1145/1978942.1979053

Digital Library

[23]

Michael Corballis. 2012. Human Laterality. Elsevier. isbn:978-0-323-15846-6 Google-Books-ID: tjJJXwTuCI4C

[24]

Mihaly Csikszentmihalyi and Mihaly Csikzentmihaly. 1990. Flow: The psychology of optimal experience. 1990, Harper & Row New York.

[25]

Luis De Miranda. 2018. Life Is Strange and “games are made”: A philosophical interpretation of a multiple-choice existential simulator with Copilot Sartre. Games and Culture, 13, 8 (2018), 825–842.

[26]

Christine Dearnley. 2005. A reflection on the use of semi-structured interviews. Nurse researcher, 13, 1 (2005).

[27]

Susan J. Douglas. 2004. Listening In: Radio And The American Imagination (first edition ed.). Univ Of Minnesota Press, Minneapolis. isbn:978-0-8166-4423-0

[28]

Paul Dourish. 2001. Where the Action is: The Foundations of Embodied Interaction. MIT Press. isbn:978-0-262-54178-7 Google-Books-ID: DCIy2zxrCqcC

[29]

Ben Egliston. 2020. ‘Seeing isn’t doing’: Examining tensions between bodies, videogames and technologies ‘beyond’ the game. New Media & Society, 22, 6 (2020), Jun, 984–1003. issn:1461-4448 https://doi.org/10.1177/1461444819875078

[30]

Ben Egliston. 2020. Visions of the material body: Twitch.tv and post-phenomenology. Journal of Gaming & Virtual Worlds, 12, 3 (2020), Oct, 241–257. issn:1757-191X, 1757-1928 https://doi.org/10.1386/jgvw_00018_1

[31]

Nada Elnahla. 2020. Black Mirror: Bandersnatch and how Netflix manipulates us, the new gods. Consumption Markets & Culture, 23, 5 (2020), Sep, 506–511. issn:1025-3866 https://doi.org/10.1080/10253866.2019.1653288

[32]

Xiao Fang, Nathan Semertzidis, Michaela Scary, Xinyi Wang, Josh Andres, Fabio Zambetta, and Florian ‘Floyd’ Mueller. 2021. Telepathic Play: Towards Playful Experiences Based on Brain-to-brain Interfacing. In Extended Abstracts of the 2021 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY ’21). Association for Computing Machinery, New York, NY, USA. 268–273. isbn:978-1-4503-8356-1 https://doi.org/10.1145/3450337.3483468

Digital Library

[33]

Florian ’Floyd’ Mueller, Stefan Agamanolis, and Rosalind Picard. 2003. Exertion interfaces: sports over a distance for social bonding and fun. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’03). Association for Computing Machinery, New York, NY, USA. 561–568. isbn:978-1-58113-630-2 https://doi.org/10.1145/642611.642709

Digital Library

[34]

Enrico Gandolfi. 2016. To watch or to play, it is in the game: The game culture on Twitch.tv among performers, plays and audiences. Journal of Gaming & Virtual Worlds, 8, 1 (2016), Mar, 63–82. issn:1757-191X, 1757-1928 https://doi.org/10.1386/jgvw.8.1.63_1

[35]

Graeme Gange and Jarrod Knibbe. 2021. Optimising Automatic Calibration of Electric Muscle Stimulation. Proceedings of the AAAI Conference on Artificial Intelligence, 35, 55 (2021), May, 3759–3767. issn:2374-3468 https://ojs.aaai.org/index.php/AAAI/article/view/16493

[36]

Catherine Garvey. 1974. Some Properties of Social Play. Merrill-Palmer Quarterly of Behavior and Development, 20, 3 (1974), 163–180. issn:0026-0150 https://www.jstor.org/stable/23084524

[37]

Elia Gatti, Dario Pittera, José Berna Moya, and Marianna Obrist. 2017. Haptic rules! Augmenting the gaming experience in traditional games: The case of foosball. In 2017 IEEE World Haptics Conference (WHC). 430–435. https://doi.org/10.1109/WHC.2017.7989940

[38]

William W. Gaver, Jacob Beaver, and Steve Benford. 2003. Ambiguity as a resource for design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’03). Association for Computing Machinery, New York, NY, USA. 233–240. isbn:978-1-58113-630-2 https://doi.org/10.1145/642611.642653

Digital Library

[39]

Kiel Gilleade, Alan Dix, and Jen Allanson. 2005. Affective Videogames and Modes of Affective Gaming: Assist Me, Challenge Me, Emote Me. In DiGRA 2005: Changing Views - Worlds in Play. https://eprints.lancs.ac.uk/id/eprint/12587/

[40]

Urša Golob, Medeja Kraševec, and Tanja Oblak Črnič. 2021. Video gaming spectatorship: What drives gameplay watching on YouTube? Media Studies, 12, 2323 (2021), Jul, 40–56. issn:1848-5030 https://hrcak.srce.hr/ojs/index.php/medijske-studije/article/view/10625

[41]

Tom Gunning. 2004. An aesthetic of astonishment: Early film and the (in) credulous spectator. Film theory: Critical concepts in media and cultural studies, 3 (2004), 76–95. Citation Key: gunning2004aesthetic

[42]

Michele Hilmes. 1997. Radio voices: American broadcasting, 1922-1952. U of Minnesota Press.

[43]

Johan Huizinga. 2016. Homo Ludens: A Study of the Play-Element in Culture. Angelico Press, Kettering, OH. isbn:978-1-62138-999-6

[44]

Katherine Isbister. 2010. Enabling Social Play: A Framework for Design and Evaluation. Springer, London. 11–22. isbn:978-1-84882-963-3 https://doi.org/10.1007/978-1-84882-963-3_2

[45]

Katherine Isbister and Florian ‘Floyd’ Mueller. 2015. Guidelines for the Design of Movement-Based Games and Their Relevance to HCI. Human-Computer Interaction, 30, 3-4 (2015), May, 366–399. issn:0737-0024 https://doi.org/10.1080/07370024.2014.996647

Digital Library

[46]

Mads Møller Jensen, Majken Kirkegaard Rasmussen, and Kaj Grønbæ k. 2013. Exploring opponent formats: Game mechanics for computer-supported physical games. 8215, 48–60. https://doi.org/10.1007/978-3-642-41106-9_6

[47]

Patrik Jonell and Pedro Lopes. 2016. Affordance++: The Tale of Animating IoT Objects. XRDS, 22, 2 (2016), Dec, 20–21. issn:1528-4972 https://doi.org/10.1145/2849487

Digital Library

[48]

Victor Kaptelinin and Bonnie Nardi. 2012. Activity Theory in HCI: Fundamentals and Reflections. Springer International Publishing, Cham. isbn:978-3-031-01068-2 https://doi.org/10.1007/978-3-031-02196-1

[49]

Shunichi Kasahara, Jun Nishida, and Pedro Lopes. 2019. Preemptive Action: Accelerating Human Reaction Using Electrical Muscle Stimulation Without Compromising Agency. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19). Association for Computing Machinery, New York, NY, USA. 1–15. isbn:978-1-4503-5970-2 https://doi.org/10.1145/3290605.3300873 event-place: Glasgow, Scotland Uk

Digital Library

[50]

Shunichi Kasahara, Kazuma Takada, Jun Nishida, Kazuhisa Shibata, Shinsuke Shimojo, and Pedro Lopes. 2021. Preserving Agency During Electrical Muscle Stimulation Training Speeds up Reaction Time Directly After Removing EMS. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21). Association for Computing Machinery, New York, NY, USA. 1–9. isbn:978-1-4503-8096-6 https://doi.org/10.1145/3411764.3445147

Digital Library

[51]

Rohit Ashok Khot, Josh Andres, Jennifer Lai, Juerg von Kaenel, and Florian ‘Floyd’ Mueller. 2016. Fantibles: Capturing Cricket Fan’s Story in 3D. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS ’16). Association for Computing Machinery, New York, NY, USA. 883–894. isbn:978-1-4503-4031-1 https://doi.org/10.1145/2901790.2901886

Digital Library

[52]

Jarrod Knibbe, Adrian Alsmith, and Kasper Hornbæ k. 2018. Experiencing Electrical Muscle Stimulation. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., 2, 3 (2018), Sep, https://doi.org/10.1145/3264928

Digital Library

[53]

Jarrod Knibbe, Rachel Freire, Marion Koelle, and Paul Strohmeier. 2021. Skill-Sleeves: Designing Electrode Garments for Wearability. In Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI ’21). Association for Computing Machinery, New York, NY, USA. 1–16. isbn:978-1-4503-8213-7 https://doi.org/10.1145/3430524.3440652

Digital Library

[54]

Michinari Kono, Takumi Takahashi, Hiromi Nakamura, Takashi Miyaki, and Jun Rekimoto. 2018. Design Guideline for Developing Safe Systems That Apply Electricity to the Human Body. ACM Trans. Comput.-Hum. Interact., 25, 3 (2018), Jun, issn:1073-0516 https://doi.org/10.1145/3184743

Digital Library

[55]

Joseph La Delfa, Mehmet Aydin Baytas, Rakesh Patibanda, Hazel Ngari, Rohit Ashok Khot, and Florian ‘Floyd’ Mueller. 2020. Drone Chi: Somaesthetic Human-Drone Interaction. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ’20). Association for Computing Machinery, New York, NY, USA. 1–13. isbn:978-1-4503-6708-0 https://doi.org/10.1145/3313831.3376786

Digital Library

[56]

Xiang Li, Yuzheng Chen, Rakesh Patibanda, and Florian ‘Floyd’ Mueller. 2021. vrCAPTCHA: Exploring CAPTCHA Designs in Virtual Reality. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (CHI EA ’21). Association for Computing Machinery, New York, NY, USA. 1–4. isbn:978-1-4503-8095-9 https://doi.org/10.1145/3411763.3451985

Digital Library

[57]

Xiang Li, Yuzheng Chen, and Xiaohang Tang. 2022. GesPlayer: Using Augmented Gestures to Empower Video Players. In Companion Proceedings of the 2022 Conference on Interactive Surfaces and Spaces (ISS ’22). Association for Computing Machinery, New York, NY, USA. 4–8. isbn:9781450393560 https://doi.org/10.1145/3532104.3571456

Digital Library

[58]

Xiang Li, Xiaohang Tang, Xin Tong, Rakesh Patibanda, Florian ‘Floyd’ Mueller, and Hai-Ning Liang. 2021. Myopic Bike and Say Hi: Games for Empathizing with The Myopic. In Extended Abstracts of the 2021 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY ’21). Association for Computing Machinery, New York, NY, USA. 333–338. isbn:978-1-4503-8356-1 https://doi.org/10.1145/3450337.3483505

Digital Library

[59]

Zhuying Li, Tianze Huang, Rakesh Patibanda, and Florian Mueller. 2023. AI in the Shell: Towards an Understanding of Integrated Embodiment. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (CHI EA ’23). Association for Computing Machinery, New York, NY, USA. 1–7. isbn:978-1-4503-9422-2 https://doi.org/10.1145/3544549.3585867

Digital Library

[60]

Zhuying Li, Rakesh Patibanda, Felix Brandmueller, Wei Wang, Kyle Berean, Stefan Greuter, and Florian ‘Floyd’ Mueller. 2018. The Guts Game: Towards Designing Ingestible Games. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY ’18). Association for Computing Machinery, New York, NY, USA. 271–283. isbn:978-1-4503-5624-4 https://doi.org/10.1145/3242671.3242681

Digital Library

[61]

Holin Lin and Chuen-Tsai Sun. 2011. The Role of Onlookers in Arcade Gaming: Frame Analysis of Public Behaviours. Convergence, 17, 2 (2011), May, 125–137. issn:1354-8565 https://doi.org/10.1177/1354856510397111

[62]

Robyn Longhurst. 2003. Semi-structured interviews and focus groups. Key methods in geography, 3, 2 (2003), 143–156.

[63]

Pedro Lopes and Patrick Baudisch. 2013. Muscle-Propelled Force Feedback: Bringing Force Feedback to Mobile Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’13). Association for Computing Machinery, New York, NY, USA. 2577–2580. isbn:978-1-4503-1899-0 https://doi.org/10.1145/2470654.2481355 event-place: Paris, France

Digital Library

[64]

Pedro Lopes and Patrick Baudisch. 2017. Immense Power in a Tiny Package: Wearables Based on Electrical Muscle Stimulation. IEEE Pervasive Computing, 16, 3 (2017), 12–16. issn:1558-2590 https://doi.org/10.1109/MPRV.2017.2940953

Digital Library

[65]

Pedro Lopes, Lewis L Chuang, and Pattie Maes. 2021. Physiological I/O. Association for Computing Machinery, New York, NY, USA. 1–4. isbn:978-1-4503-8095-9 http://doi.org/10.1145/3411763.3450407

Digital Library

[66]

Pedro Lopes, Alexandra Ion, Willi Mueller, Daniel Hoffmann, Patrik Jonell, and Patrick Baudisch. 2015. Proprioceptive Interaction. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI ’15). Association for Computing Machinery, New York, NY, USA. 939–948. isbn:978-1-4503-3145-6 https://doi.org/10/gj37np

Digital Library

[67]

Pedro Lopes, Doăa Yüksel, François Guimbretière, and Patrick Baudisch. 2016. Muscle-Plotter: An Interactive System Based on Electrical Muscle Stimulation That Produces Spatial Output. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST ’16). Association for Computing Machinery, New York, NY, USA. 207–217. isbn:978-1-4503-4189-9 https://doi.org/10.1145/2984511.2984530 event-place: Tokyo, Japan

Digital Library

[68]

Martin Ludvigsen and Rune Veerasawmy. 2010. Designing technology for active spectator experiences at sporting events. In Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction (OZCHI ’10). Association for Computing Machinery, New York, NY, USA. 96–103. isbn:978-1-4503-0502-0 https://doi.org/10.1145/1952222.1952243

Digital Library

[69]

Henrik Hautop Lund and Patrizia Marti. 2009. Designing modular robotic playware. In RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication. 115–121. issn:1944-9437 https://doi.org/10.1109/ROMAN.2009.5326286

[70]

Judith Mayne. 1993. Cinema and spectatorship. https://www.semanticscholar.org/paper/Cinema-and-spectatorship-Mayne/24b798333c78625b45c6eccbf3871abf54cdb98e

[71]

John McClelland. 2006. Body and Mind: Sport in Europe from the Roman Empire to the Renaissance. Routledge, London. isbn:978-0-203-96773-7 https://doi.org/10.4324/9780203967737

[72]

Alberto Monge Roffarello and Luigi De Russis. 2019. The Race Towards Digital Wellbeing: Issues and Opportunities. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI ’19). Association for Computing Machinery, New York, NY, USA. 1–14. isbn:978-1-4503-5970-2 https://doi.org/10.1145/3290605.3300616 event-place: Glasgow, Scotland Uk

Digital Library

[73]

Salama A. Mostafa, Mohd Sharifuddin Ahmad, and Aida Mustapha. 2019. Adjustable autonomy: a systematic literature review. Artificial Intelligence Review, 51, 2 (2019), Feb, 149–186. issn:1573-7462 https://doi.org/10.1007/s10462-017-9560-8

Digital Library

[74]

Florian ‘Floyd’ Mueller, Josh Andres, Joe Marshall, Dag Svanæ s, m. c. schraefel, Kathrin Gerling, Jakob Tholander, Anna Lisa Martin-Niedecken, Elena Márquez Segura, Elise van den Hoven, Nicholas Graham, Kristina Höök, and Corina Sas. 2018. Body-centric computing: results from a weeklong Dagstuhl seminar in a German castle. Interactions, 25, 4 (2018), Jun, 34–39. issn:1072-5520 https://doi.org/10.1145/3215854

Digital Library

[75]

Florian ‘Floyd’ Mueller, Martin R. Gibbs, and Frank Vetere. 2008. Taxonomy of exertion games. In Proceedings of the 20th Australasian Conference on Computer-Human Interaction: Designing for Habitus and Habitat (OZCHI ’08). Association for Computing Machinery, New York, NY, USA. 263–266. isbn:978-0-9803063-4-7 https://doi.org/10.1145/1517744.1517772

Digital Library

[76]

Florian ‘Floyd’ Mueller, Pedro Lopes, Paul Strohmeier, Wendy Ju, Caitlyn Seim, Martin Weigel, Suranga Nanayakkara, Marianna Obrist, Zhuying Li, Joseph Delfa, Jun Nishida, Elizabeth M. Gerber, Dag Svanaes, Jonathan Grudin, Stefan Greuter, Kai Kunze, Thomas Erickson, Steven Greenspan, Masahiko Inami, Joe Marshall, Harald Reiterer, Katrin Wolf, Jochen Meyer, Thecla Schiphorst, Dakuo Wang, and Pattie Maes. 2020. Next Steps for Human-Computer Integration. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ’20). Association for Computing Machinery, New York, NY, USA. 1–15. isbn:978-1-4503-6708-0 https://doi.org/10.1145/3313831.3376242

Digital Library

[77]

Florian ‘Floyd’ Mueller, Rakesh Patibanda, Richard Byrne, Zhuying Li, Yan Wang, Josh Andres, Xiang Li, Jonathan Marquez, Stefan Greuter, Jonathan Duckworth, and Joe Marshall. 2021. Limited Control Over the Body as Intriguing Play Design Resource. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21). Association for Computing Machinery, New York, NY, USA. 1–16. isbn:978-1-4503-8096-6 https://doi.org/10.1145/3411764.3445744

Digital Library

[78]

Florian ‘Floyd’ Mueller, Marianne Graves Petersen, and Zhuying Li. 2023. Technology futures: Towards understanding how to design awe-inspiring futures. International Journal of Human-Computer Studies, 170 (2023), Feb, 102961. issn:1071-5819 https://doi.org/10.1016/j.ijhcs.2022.102961

Digital Library

[79]

Florian ‘Floyd’ Mueller, Nathan Semertzidis, Josh Andres, Joe Marshall, Steve Benford, Xiang Li, Louise Matjeka, and Yash Mehta. 2023. Towards Understanding the Design of Intertwined Human-Computer Integrations. ACM Trans. Comput.-Hum. Interact., apr, issn:1073-0516 https://doi.org/10.1145/3590766 Just Accepted

Digital Library

[80]

Shreyas Nisal, Rakesh Patibanda, Aryan Saini, Elise Van Den Hoven, and Florian ‘Floyd’ Mueller. 2022. TouchMate: Understanding the Design of Body Actuating Games using Physical Touch. In Extended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY ’22). Association for Computing Machinery, New York, NY, USA. 153–158. isbn:978-1-4503-9211-2 https://doi.org/10.1145/3505270.3558332

Digital Library

[81]

Romain Nith, Shan-Yuan Teng, Pengyu Li, Yujie Tao, and Pedro Lopes. 2021. DextrEMS: Increasing Dexterity in Electrical Muscle Stimulation by Combining it with Brakes. In The 34th Annual ACM Symposium on User Interface Software and Technology. 414–430.

Digital Library

[82]

Stephanie Orme. 2021. “Just watching”: A qualitative analysis of non-players’ motivations for video game spectatorship. New Media & Society, Feb, 1461444821989350. issn:1461-4448 https://doi.org/10.1177/1461444821989350

[83]

Selina M. Parry, Sue Berney, Catherine L. Granger, René Koopman, Doa El-Ansary, and Linda Denehy. 2013. Electrical Muscle Stimulation in the Intensive Care Setting: A Systematic Review. Critical Care Medicine, 41, 10 (2013), Oct, 2406–2418. issn:0090-3493 https://doi.org/10.1097/CCM.0b013e3182923642

[84]

Rakesh Patibanda, Xiang Li, Yuzheng Chen, Aryan Saini, Christian N Hill, Elise van den Hoven, and Florian ‘Floyd’ Mueller. 2021. Actuating Myself: Designing Hand-Games Incorporating Electrical Muscle Stimulation. In Extended Abstracts of the 2021 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY ’21). Association for Computing Machinery, New York, NY, USA. 228–235. isbn:978-1-4503-8356-1 https://doi.org/10.1145/3450337.3483464

Digital Library

[85]

Rakesh Patibanda, Florian ‘Floyd’ Mueller, Matevz Leskovsek, and Jonathan Duckworth. 2017. Life Tree: Understanding the Design of Breathing Exercise Games. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (CHI PLAY ’17). Association for Computing Machinery, New York, NY, USA. 19–31. isbn:978-1-4503-4898-0 https://doi.org/10.1145/3116595.3116621

Digital Library

[86]

Rakesh Patibanda, Nathan Arthur Semertzidis, Michaela Scary, Joseph Nathan La Delfa, Josh Andres, Mehmet Aydin Baytaş, Anna Lisa Martin-Niedecken, Paul Strohmeier, Bruno Fruchard, and Sang-won Leigh. 2020. Motor Memory in HCI. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA ’20). Association for Computing Machinery, New York, NY, USA. 1–8. isbn:978-1-4503-6819-3 https://doi.org/10.1145/3334480.3375163

Digital Library

[87]

Rakesh Patibanda, Elise Van Den Hoven, and Florian ‘Floyd’ Mueller. 2022. Towards Understanding the Design of Body-Actuated Play. In Extended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY ’22). Association for Computing Machinery, New York, NY, USA. 388–391. isbn:978-1-4503-9211-2 https://doi.org/10.1145/3505270.3558367

Digital Library

[88]

Max Pfeiffer, Tim Dünte, Stefan Schneegass, Florian Alt, and Michael Rohs. 2015. Cruise Control for Pedestrians: Controlling Walking Direction using Electrical Muscle Stimulation. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI ’15). Association for Computing Machinery, New York, NY, USA. 2505–2514. isbn:978-1-4503-3145-6 https://doi.org/10.1145/2702123.2702190

Digital Library

[89]

Stuart Reeves, Steve Benford, Claire O’Malley, and Mike Fraser. 2005. Designing the spectator experience. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’05). Association for Computing Machinery, New York, NY, USA. 741–750. isbn:978-1-58113-998-3 https://doi.org/10.1145/1054972.1055074

Digital Library

[90]

Raquel Robinson, Katelyn Wiley, Amir Rezaeivahdati, Madison Klarkowski, and Regan L. Mandryk. 2020. “Let’s Get Physiological, Physiological!”: A Systematic Review of Affective Gaming. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (CHI PLAY ’20). Association for Computing Machinery, New York, NY, USA. 132–147. isbn:978-1-4503-8074-4 https://doi.org/10.1145/3410404.3414227

Digital Library

[91]

Yvonne Rogers and Paul Marshall. 2017. Research in the Wild. Synthesis Lectures on Human-Centered Informatics, 10, 3 (2017), Apr, i–97. issn:1946-7680 https://doi.org/10.2200/S00764ED1V01Y201703HCI037

[92]

Katie Salen and Eric Zimmerman. 2004. Rules of Play: Game Design Fundamentals. MIT Press. isbn:978-0-262-24045-1

Digital Library

[93]

Rainforest Scully-Blaker, Jason Begy, Mia Consalvo, and Sarah Ganzon. 2017. Playing along and Playing for on Twitch: Livestreaming from Tandem Play to Performance. Hawaii International Conference on System Sciences 2017 (HICSS-50), Jan, https://aisel.aisnet.org/hicss-50/dsm/games_and_gaming/4

[94]

Joseph Seering, Saiph Savage, Michael Eagle, Joshua Churchin, Rachel Moeller, Jeffrey P. Bigham, and Jessica Hammer. 2017. Audience Participation Games: Blurring the Line Between Player and Spectator. In Proceedings of the 2017 Conference on Designing Interactive Systems (DIS ’17). Association for Computing Machinery, New York, NY, USA. 429–440. isbn:978-1-4503-4922-2 https://doi.org/10.1145/3064663.3064732

Digital Library

[95]

Nathan Semertzidis, Michaela Scary, Josh Andres, Brahmi Dwivedi, Yutika Chandrashekhar Kulwe, Fabio Zambetta, and Florian ‘Floyd’ Mueller. 2020. Neo-Noumena: Augmenting Emotion Communication. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI ’20). Association for Computing Machinery, New York, NY, USA. 1–13. isbn:978-1-4503-6708-0 https://doi.org/10.1145/3313831.3376599

Digital Library

[96]

Aric Sigman. 2007. Visual voodoo: The biological impact of watching TV. Biologist, 54, 1 (2007), 12–17.

[97]

Steven Skultety. 2011. Categories of Competition. Sport, Ethics and Philosophy, 5, 4 (2011), Nov, 433–446. issn:1751-1321 https://doi.org/10.1080/17511321.2011.561255

[98]

Jurgen Steimle, Joanna Bergström, Martin Weigel, Aditya Nittala, Sebastian Boring, Alex Olwal, and Kasper Hornbak. 2017. On-Skin Interaction Using Body Landmarks. Computer, 50 (2017), Jan, 19–27. https://doi.org/10.1109/MC.2017.3641636

Digital Library

[99]

Alina Striner, Andrew M. Webb, Jessica Hammer, and Amy Cook. 2021. Mapping Design Spaces for Audience Participation in Game Live Streaming. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21). Association for Computing Machinery, New York, NY, USA. 1–15. isbn:978-1-4503-8096-6 https://doi.org/10.1145/3411764.3445511

Digital Library

[100]

Brian Sutton-Smith. 2001. The Ambiguity of Play (1st edition ed.). *Harvard University Press, Cambridge, Mass. isbn:978-0-674-00581-5

[101]

Nicholas Taylor. 2016. Play to the camera: Video ethnography, spectatorship, and e-sports. Convergence, 22, 2 (2016), Apr, 115–130. issn:1354-8565 https://doi.org/10.1177/1354856515580282

[102]

T. L. Taylor. 2018. Watch Me Play: Twitch and the Rise of Game Live Streaming. Princeton University Press. isbn:978-0-691-18497-5 https://doi.org/10.1515/9780691184975

[103]

Burak S. Tekin and Stuart Reeves. 2017. Ways of Spectating: Unravelling Spectator Participation in Kinect Play. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). Association for Computing Machinery, New York, NY, USA. 1558–1570. isbn:978-1-4503-4655-9 https://doi.org/10.1145/3025453.3025813

Digital Library

[104]

TGC. 2017. Journey. https://thatgamecompany.com/journey/

[105]

Martin Tomitsch, Wolfgang Aigner, and Thomas Grechenig. 2007. A Concept to Support Seamless Spectator Participation in Sports Events Based on Wearable Motion Sensors. https://doi.org/10.1109/ICPCA.2007.4365441

[106]

Philip J. Trocchia, Diane L. Swanson, and Marc Orlitzky. 2007. Digging Deeper: the Laddering Interview, a Tool for Surfacing Values. Journal of Management Education, 31, 5 (2007), Oct, 713–729. issn:1052-5629 https://doi.org/10.1177/1052562906293611

[107]

Ibo van de Poel. 2016. An Ethical Framework for Evaluating Experimental Technology. Science and Engineering Ethics, 22, 3 (2016), Jun, 667–686. issn:1471-5546 https://doi.org/10.1007/s11948-015-9724-3

[108]

Mirjam Vosmeer and Ben Schouten. 2014. Interactive cinema: engagement and interaction. In Interactive Storytelling: 7th International Conference on Interactive Digital Storytelling, ICIDS 2014, Singapore, Singapore, November 3-6, 2014, Proceedings 7. 140–147.

[109]

Alan R. Wagner, Paul Robinette, and Ayanna Howard. 2018. Modeling the Human-Robot Trust Phenomenon: A Conceptual Framework based on Risk. ACM Transactions on Interactive Intelligent Systems, 8, 4 (2018), Nov, 26:1–26:24. issn:2160-6455 https://doi.org/10.1145/3152890

Digital Library

[110]

Fiona Wiltshier. 2011. Researching With NVivo. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 12, 11 (2011), Jan, issn:1438-5627 https://doi.org/10.17169/fqs-12.1.1628

[111]

Jacob O. Wobbrock and Julie A. Kientz. 2016. Research contributions in human-computer interaction. Interactions, 23, 3 (2016), Apr, 38–44. issn:1072-5520 https://doi.org/10.1145/2907069

Digital Library

[112]

Jamie Woodcock and Mark R. Johnson. 2019. The Affective Labor and Performance of Live Streaming on Twitch.tv. Television & New Media, 20, 8 (2019), Dec, 813–823. issn:1527-4764 https://doi.org/10.1177/1527476419851077

Cited By

Zhou HAyesh TFan CSarsenbayeva ZWithana A(2024)CoplayingVR: Understanding User Experience in Shared Control in Virtual RealityProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785088:3(1-25)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678508
Saini AVan Den Hoven EMueller F(2024)PneuExtensio: Designing Pneumatic-based Bodily Extensions to Facilitate Embodiment across Everyday Life ExperiencesCompanion Publication of the 2024 ACM Designing Interactive Systems Conference10.1145/3656156.3665136(19-23)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3656156.3665136
Patibanda ROverdevest NSaini ALi ZAndres JKnibbe Jvan den Hoven EMueller F(2024)Exploring Shared Bodily Control: Designing Augmented Human Systems for Intra- and Inter-CorporealityProceedings of the Augmented Humans International Conference 202410.1145/3652920.3653037(318-323)Online publication date: 4-Apr-2024
https://dl.acm.org/doi/10.1145/3652920.3653037
Show More Cited By

Index Terms

Fused Spectatorship: Designing Bodily Experiences Where Spectators Become Players
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms

Recommendations

Actuating Myself: Designing Hand-Games Incorporating Electrical Muscle Stimulation
CHI PLAY '21: Extended Abstracts of the 2021 Annual Symposium on Computer-Human Interaction in Play

Motor movements are performed while playing hand-games such as Rock-paper-scissors or Thumb-war. These games are believed to benefit both physical and mental health and are considered cultural assets. Electrical Muscle Stimulation (EMS) is a technology ...
Auto-Paizo Games: Towards Understanding the Design of Games That Aim to Unify a Player’s Physical Body and the Virtual World

Most digital bodily games focus on the body as they use movement as input. However, they also draw the player’s focus away from the body as the output occurs on visual displays, creating a divide between the physical body and the virtual world. We ...
Towards Understanding the Design of Body-Actuated Play
CHI PLAY '22: Extended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play

Bodily games often use players’ physiology as input to provide output via screen-based modalities. Game design researchers could extend the use of the body as input and output (I/O) by using body-actuating technologies such as Electrical Muscle ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 7, Issue CHI PLAY

November 2023

1360 pages

EISSN:2573-0142

DOI:10.1145/3554313

Editor:
Jeffrey Nichols
Apple, USA

Issue’s Table of Contents

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 October 2023

Published in PACMHCI Volume 7, Issue CHI PLAY

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Australian Research Council

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
196
Total Downloads

Downloads (Last 12 months)196
Downloads (Last 6 weeks)18

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhou HAyesh TFan CSarsenbayeva ZWithana A(2024)CoplayingVR: Understanding User Experience in Shared Control in Virtual RealityProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785088:3(1-25)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678508
Saini AVan Den Hoven EMueller F(2024)PneuExtensio: Designing Pneumatic-based Bodily Extensions to Facilitate Embodiment across Everyday Life ExperiencesCompanion Publication of the 2024 ACM Designing Interactive Systems Conference10.1145/3656156.3665136(19-23)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3656156.3665136
Patibanda ROverdevest NSaini ALi ZAndres JKnibbe Jvan den Hoven EMueller F(2024)Exploring Shared Bodily Control: Designing Augmented Human Systems for Intra- and Inter-CorporealityProceedings of the Augmented Humans International Conference 202410.1145/3652920.3653037(318-323)Online publication date: 4-Apr-2024
https://dl.acm.org/doi/10.1145/3652920.3653037
Patibanda ROverdevest NNisal SSaini AElvitigala DKnibbe JVan Den Hoven EMueller F(2024)Shared Bodily Fusion: Leveraging Inter-Body Electrical Muscle Stimulation for Social PlayProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660723(2088-2106)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660723
Saini APatibanda ROverdevest NVan Den Hoven EMueller FCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)PneuMa: Designing Pneumatic Bodily Extensions for Supporting Movement in Everyday LifeProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633349(1-16)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633349
Saini APatibanda ROverdevest NVan Den Hoven EMueller F(2024)PneuMa: Designing Pneumatic Bodily Extensions for Supporting Movement in Everyday LifeExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3649125(1-4)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3649125
Gao ZLi XLiu CWang XWang AYang LWang YHui PBraud T(2023)VR PreM+: An Immersive Pre-learning Branching Visualization System for Museum ToursProceedings of the Eleventh International Symposium of Chinese CHI10.1145/3629606.3629643(374-385)Online publication date: 13-Nov-2023
https://dl.acm.org/doi/10.1145/3629606.3629643

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents