Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3357236.3395484acmconferencesArticle/Chapter ViewAbstractPublication PagesdisConference Proceedingsconference-collections
research-article

InsideOut: Towards an Understanding of Designing Playful Experiences with Imaging Capsules

Published: 03 July 2020 Publication History

Abstract

Imaging capsules are ingestible sensors that capture the video of one's gastrointestinal tract for medical diagnosis. We believe that the capsule's experiential perspective is often overlooked by associated medical applications. This work explores the design of this experiential perspective through combining imaging capsules with digital play. We designed a playful wearable system called "InsideOut", where users play with the real-time video of their gastrointestinal tract captured by an imaging capsule. Based on an in-the-wild study, we derived four themes articulating the play experiences and discussed key design implications to guide future playful designs using imaging capsules. Our research highlights the opportunity of using medical imaging technologies to enable intriguing bodily play experiences. Furthermore, such experiences can deepen the players' engagement with and understanding of their bodies, ultimately contributing to a more playful and humanized health care agenda.

Supplementary Material

MP4 File (disfp5320.mp4)
Supplemental video

References

[1]
Teresa Almeida, Rob Comber, Gavin Wood, Dean Saraf, and Madeline Balaam. 2016. On Looking at the Vagina through Labella. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). Association for Computing Machinery, New York, NY, USA, 1810--1821.
[2]
Ferran Altarriba Bertran, Samvid Jhaveri, Rosa Lutz, Katherine Isbister, and Danielle Wilde. 2019. Making Sense of Human-Food Interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). Association for Computing Machinery, New York, NY, USA, Article Paper 678, 13 pages.
[3]
Peter Arnold, Rohit Ashok Khot, and Florian'Floyd' Mueller. 2018. "You Better Eat to Survive" Exploring Cooperative Eating in Virtual Reality Games. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction. 398--408.
[4]
Shaowen Bardzell, Jeffrey Bardzell, Jodi Forlizzi, John Zimmerman, and John Antanitis. 2012. Critical Design and Critical Theory: The Challenge of Designing for Provocation. In Proceedings of the Designing Interactive Systems Conference (DIS '12). ACM, New York, NY, USA, 288--297.
[5]
Frédérique Baumgartner. 2019. Corps étranger. http://www.newmedia-art.org/cgi-bin/show-oeu.asp?ID= 150000000007761&lg=GBR. (2019). Accessed Jul 5, 2019.
[6]
Steve Benford, Chris Greenhalgh, Gabriella Giannachi, Brendan Walker, Joe Marshall, and Tom Rodden. 2012. Uncomfortable Interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 2005--2014.
[7]
Virginia Braun and Victoria Clarke. 2006. Using Thematic Analysis in Psychology. Qualitative Research in Psychology 3, 2 (2006), 77--101.
[8]
Encyclopaedia Britannica. 2020a. Skeletal muscle. https://www.britannica.com/science/skeletal-muscle. (2020). Accessed Sep 28, 2020.
[9]
Encyclopaedia Britannica. 2020b. Smooth muscle. https://www.britannica.com/science/intercostalis-muscle. (2020). Accessed Sep 28, 2020.
[10]
Marion Buchenau and Jane Fulton Suri. 2000. Experience Prototyping. In Proceedings of the 3rd Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques (DIS '00). Association for Computing Machinery, New York, NY, USA, 424--433.
[11]
Richard Byrne, Joe Marshall, and Florian Floyd Mueller. 2018. AR Fighter: Using HMDs to Create Vertigo Play Experiences. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '18). Association for Computing Machinery, New York, NY, USA, 45--57.
[12]
Roger Caillois. 2001. Man, play, and games. University of Illinois Press.
[13]
Elizabeth J. Carey, Jonathan A Leighton, Russell I. Heigh, Arthur D. Shiff, Virender K. Sharma, Janice K. Post, and David E. Fleischer. 2007. A single-center experience of 260 consecutive patients undergoing capsule endoscopy for obscure gastrointestinal bleeding. American Journal of Gastroenterology 102, 1 (1 2007), 89--95.
[14]
Rodney P Carlisle. 2009. Encyclopedia of play in today's society. Vol. 1. Sage.
[15]
André K H Chong, Andrew C F Taylor, Ashley M Miller, and Paul V Desmond. 2003. Initial experience with capsule endoscopy at a major referral hospital. Medical Journal of Australia 178, 11 (2003), 537--540.
[16]
OBS Studio Contributors. 2020. Open Broadcaster Software. https://obsproject.com/. (2020). Accessed Jan 21, 2020.
[17]
Stephanie de Smale. 2015. Level Up: A Media-Archaeological Study on the Rhetoric of Progress about Serious Health Games. Master's thesis. Utrecht University.
[18]
Linda de Valk, Tilde Bekker, and Berry Eggen. 2013. Leaving Room for Improvisation: Towards a Design Approach for Open-ended Play. In Proceedings of the 12th International Conference on Interaction Design and Children (IDC '13). ACM, New York, NY, USA, 92--101.
[19]
Derivative. 2019. Derivative TouchDesigner. https://www.derivative.ca/. (2019). Accessed Sep 19, 2019.
[20]
Elisabetta Di Stefano. 2018. Cosmetic Practices: The Intersection with Aesthetics and Medicine. In Aesthetic Experience and Somaesthetics. Brill, 162--179.
[21]
Michelle M Donovan. 2018. Mindful Eating: A Guide to Rediscovering a Healthy and Joyful Relationship With Food. Journal of Nutrition Education and Behavior 50, 7 (2018), 752.
[22]
Duet. 2020. Duet Display. https://www.duetdisplay.com/. (2020). Accessed Apr 14, 2020.
[23]
Scott G Eberle. 2014. The elements of play: Toward a philosophy and a definition of play. American Journal of Play 6, 2 (2014), 214--233.
[24]
Satoshi Fujisawa, Takeo Hamada, Ryota Kondo, Ryohei Okamoto, and Michiteru Kitazaki. 2017. A body odyssey: exploring the human body as digested food. In Proceedings of the 8th Augmented Human International Conference. 1--2.
[25]
Sally Gadow. 1980. Body and self: A dialectic. The journal of medicine and philosophy 5, 3 (1980), 172--185.
[26]
William W. Gaver, Jacob Beaver, and Steve Benford. 2003. Ambiguity As a Resource for Design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). ACM, New York, NY, USA, 233--240.
[27]
Tom Giraud, Matthieu Courgeon, Marion Tardieu, Alexandra Roatis, and Xavier Maitre. 2014. A Three-dimensional Mirror Augmented by Medical Imaging: Questioning Self-portraying at the Limit of Iintimacy. In CHI '14 Extended Abstracts on Human Factors in Computing Systems (CHI EA '14). ACM, New York, NY, USA, 845--854.
[28]
Eberhard Graether and Florian Mueller. 2012. Joggobot: A Flying Robot As Jogging Companion. In CHI '12 Extended Abstracts on Human Factors in Computing Systems (CHI EA '12). ACM, New York, NY, USA, 1063--1066.
[29]
Cecil Helman. 2007. Culture, health and illness. CRC press.
[30]
Thomas S Henricks. 2015. Play and the human condition. University of Illinois Press.
[31]
Thuong Hoang, Martin Reinoso, Zaher Joukhadar, Frank Vetere, and David Kelly. 2017. Augmented Studio: Projection Mapping on Moving Body for Physiotherapy Education. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 1419--1430.
[32]
Ruth Sancho Huerga, Jennifer Lade, and Florian Mueller. 2016. Designing Play to Support Hospitalized Children. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '16). ACM, New York, NY, USA, 401--412.
[33]
Amy Huggard, Anushka De Mel, Jayden Garner, Cagdas "Chad" Toprak, Alan D. Chatham, and Florian Mueller. 2013. Musical Embrace: Facilitating Engaging Play Experiences through Social Awkwardness. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (CHI EA '13). Association for Computing Machinery, New York, NY, USA, 3067--3070.
[34]
Gavriel Iddan, Gavriel Meron, Arkady Glukhovsky, and Paul Swain. 2000. Wireless capsule endoscopy. Nature 405, 6785 (2000), 417.
[35]
Kalle Jegers. 2007. Pervasive game flow: understanding player enjoyment in pervasive gaming. computers in Entertainment (CIE) 5, 1 (2007), 9--es.
[36]
JinShan. 2019. OMOM Capsule Endoscopy. https://english.jinshangroup.com/capsuleendoscopy.html. (2019). Accessed Sep 19, 2019.
[37]
Kourosh Kalantar-zadeh, Nam Ha, Jian Zhen Ou, and Kyle J. Berean. 2017. Ingestible Sensors. ACS Sensors 2, 4 (2017), 468--483.
[38]
Pamela M. Kato. 2010. Video Games in Health Care: Closing the Gap. Review of General Psychology 14, 2 (2010), 113--121.
[39]
Rohit Ashok Khot and Florian Mueller. 2019. Human-Food Interaction. Foundations and Trends® Human--Computer Interaction 12, 4 (2019), 238--415.
[40]
Martijn J.L. Kors, Gabriele Ferri, Erik D. van der Spek, Cas Ketel, and Ben A.M. Schouten. 2016. A Breathtaking Journey. On the Design of an Empathy-Arousing Mixed-Reality Game. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '16). ACM, New York, NY, USA, 91--104.
[41]
Nicole Lazzaro. 2009. Why we play: affect and the fun of games. Human-computer interaction: Designing for diverse users and domains 155 (2009), 679--700.
[42]
Drew Leder. 1990. The absent body. University of Chicago Press.
[43]
BS Lewis, GM Eisen, and S Friedman. 2005. A pooled analysis to evaluate results of capsule endoscopy trials. Endoscopy 37, 10 (2005), 960--965.
[44]
Zhuying Li, Felix Brandmueller, Florian Mueller, and Stefan Greuter. 2017. Ingestible Games: Swallowing a Digital Sensor to Play a Game. In Extended Abstracts Publication of the Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '17 Extended Abstracts). ACM, New York, NY, USA, 511--518.
[45]
Zhaoshen Li, Dan Carter, Rami Eliakim, Wenbin Zou, Hao Wu, Zhuan Liao, Zhaotao Gong, Jinshan Wang, Joo Won Chung, Si Young Song, Guohua Xiao, Xiaodong Duan, and Xinhong Wang. 2014. The Current Main Types of Capsule scopy. Springer Netherlands, Dordrecht, 5--45.
[46]
Zhuying Li, Weikang Chen, Yan Wang, Ti Hoang, Wei Wang, Mario Boot, Stefan Greuter, and Florian 'Floyd' Mueller. 2018a. HeatCraft: Playing with Ingestible Sensors via Localised Sensations. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts (CHI PLAY '18 Extended Abstracts). ACM, New York, NY, USA, 521--530.
[47]
Zhuying Li, Rakesh Patibanda, Felix Brandmueller, Wei Wang, Kyle Berean, Stefan Greuter, and Florian Mueller. 2018b. The Guts Game: Towards Designing Ingestible Games. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '18). ACM, New York, NY, USA.
[48]
Zhuying Li, Yan Wang, Wei Wang, Weikang Chen, Ti Hoang, Stefan Greuter, and Florian Floyd Mueller. 2019. HeatCraft: Designing Playful Experiences with Ingestible Sensors via Localized Thermal Stimuli. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, Article 576, 12 pages.
[49]
Andrés Lucero, Evangelos Karapanos, Juha Arrasvuori, and Hannu Korhonen. 2014. Playful or Gameful?: Creating Delightful User Experiences. interactions 21, 3 (May 2014), 34--39.
[50]
Deborah Lupton. 2013. The Digitally Engaged Patient: Self-monitoring and Self-care in the Digital Health Era. Social Theory & Health 11, 3 (01 Aug 2013), 256--270.
[51]
John McCarthy, Peter Wright, Jayne Wallace, and Andy Dearden. 2006. The experience of enchantment in human--computer interaction. Personal and ubiquitous computing 10, 6 (2006), 369--378.
[52]
Florian Mueller, Josh Andres, Joe Marshall, Dag Svanæs, MC Schraefel, Kathrin Gerling, Jakob Tholander, Anna Lisa Martin-Niedecken, Elena Márquez Segura, Elise van den Hoven, and others. 2018a. Body-centric computing: results from a weeklong Dagstuhl seminar in a German castle. interactions 25, 4 (2018), 34--39.
[53]
Florian Mueller, Richard Byrne, Josh Andres, and Rakesh Patibanda. 2018b. Experiencing the Body As Play. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 210, 13 pages.
[54]
Florian Mueller and Katherine Isbister. 2014. Movement-based Game Guidelines. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 2191--2200.
[55]
Florian Mueller, Rohit Ashok Khot, Kathrin Gerling, and Regan Mandryk. 2016. Exertion Games. Foundations and Trends® in Human--Computer Interaction 10, 1 (2016), 1--86.
[56]
Florian Mueller, Sophie Stellmach, Saul Greenberg, Andreas Dippon, Susanne Boll, Jayden Garner, Rohit Khot, Amani Naseem, and David Altimira. 2014. Proxemics Play: Understanding Proxemics for Designing Digital Play Experiences. In Proceedings of the 2014 Conference on Designing Interactive Systems (DIS '14). Association for Computing Machinery, New York, NY, USA, 533--542.
[57]
Andi Nahmias. 2010--2011. Phillip Warnell. https://istanbulmuseum.org/artists/phillip%20warnell.html. (2010--2011). Accessed Jul 5, 2019.
[58]
Simone Natale. 2011. The Invisible Made Visible: X-rays as attraction and visual medium at the end of the nineteenth century. Media History 17, 4 (2011), 345--358.
[59]
Leyla Norooz, Matthew Louis Mauriello, Anita Jorgensen, Brenna McNally, and Jon E. Froehlich. 2015. BodyVis: A New Approach to Body Learning Through Wearable Sensing and Visualization. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). Association for Computing Machinery, New York, NY, USA, 1025--1034.
[60]
Claudia Nunez-Pacheco and Lian Loke. 2014. Crafting the Body-tool: A Body-centred Perspective on Wearable Technology. In Proceedings of the 2014 Conference on Designing Interactive Systems (DIS '14). ACM, New York, NY, USA, 553--566.
[61]
Jan Poope. 2015. Audiopill. http://www.audiopill.net/en/. (2015). Accessed Dec 12, 2019.
[62]
Maud Radstake. 2007. Visions of Illness: an Endography of Real-time Medical Imaging.
[63]
Yvonne Rogers. 2011. Interaction Design Gone Wild: Striving for Wild Theory. interactions 18, 4 (July 2011), 58--62.
[64]
Karen Schultheis, Lizette Peterson, and Vanessa Selby. 1987. Preparation for stressful medical procedures and person × treatment interactions. Clinical Psychology Review 7, 3 (1987), 329--352.
[65]
Bit Shape. 2010. GyrOSC. http://www.bitshapesoftware.com/instruments/gyrosc/. (2010). Accessed Apr 14, 2020.
[66]
Jenny Slatman. 2007. Recognition beyond Narcissism: Imaging the Body's Ownness and Strangeness. Palgrave Macmillan UK, London, 186--204.
[67]
Jenny Slatman. 2009. Transparent bodies: Revealing the myth of interiority. The body within: Art, medicine and visualization 3 (2009), 107--122.
[68]
Jenny Slatman. 2016. Our Strange Body: Philosophical Reflections on Identity and Medical Interventions. Amsterdam University Press.
[69]
Stelarc. 2019. Stomach Sculpture. https://stelarc.org/?catID=20349. (2019). Accessed Sep 19, 2019.
[70]
Paul Swain. 2003. Wireless capsule endoscopy. Gut 52, suppl 4 (2003), iv48--iv50.
[71]
Penelope Sweetser and Peta Wyeth. 2005. GameFlow: A Model for Evaluating Player Enjoyment in Games.comput. Entertain. 3, 3 (July 2005), 3--3.
[72]
José van Dijck. 2001. Bodies without borders: The endoscopic gaze. International Journal of Cultural Studies 4, 2 (2001), 219--237.
[73]
José Van Dijck. 2011. The transparent body: A cultural analysis of medical imaging. University of Washington Press.
[74]
Lieselotte Van Leeuwen and Diane Westwood. 2008. Adult play, psychology and design. Digital Creativity 19, 3 (2008), 153--161.
[75]
Catherine Waldby. 1997. The body and the digital archive: the Visible Human Project and the computerization of medicine. Health 1, 2 (1997), 227--243.
[76]
Phillip Warnell. 2006. Endo Ecto. http://www.phillipwarnell.com/Performance. (2006). Accessed Jul 5, 2019.

Cited By

View all
  • (2024)Shared Bodily Fusion: Leveraging Inter-Body Electrical Muscle Stimulation for Social PlayProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660723(2088-2106)Online publication date: 1-Jul-2024
  • (2024)Grand challenges in human-food interactionInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103197183(103197)Online publication date: Mar-2024
  • (2023)A Design Framework for Ingestible PlayACM Transactions on Computer-Human Interaction10.1145/358995430:4(1-39)Online publication date: 11-Sep-2023
  • Show More Cited By

Index Terms

  1. InsideOut: Towards an Understanding of Designing Playful Experiences with Imaging Capsules

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      DIS '20: Proceedings of the 2020 ACM Designing Interactive Systems Conference
      July 2020
      2264 pages
      ISBN:9781450369749
      DOI:10.1145/3357236
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 03 July 2020

      Permissions

      Request permissions for this article.

      Check for updates

      Badges

      • Honorable Mention

      Author Tags

      1. bodily play
      2. imaging capsules
      3. ingestible play
      4. ingestible sensors
      5. medical imaging technology
      6. play
      7. well-being

      Qualifiers

      • Research-article

      Conference

      DIS '20
      Sponsor:
      DIS '20: Designing Interactive Systems Conference 2020
      July 6 - 10, 2020
      Eindhoven, Netherlands

      Acceptance Rates

      Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

      Upcoming Conference

      DIS '25
      Designing Interactive Systems Conference
      July 5 - 9, 2025
      Funchal , Portugal

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)43
      • Downloads (Last 6 weeks)1
      Reflects downloads up to 01 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Shared Bodily Fusion: Leveraging Inter-Body Electrical Muscle Stimulation for Social PlayProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660723(2088-2106)Online publication date: 1-Jul-2024
      • (2024)Grand challenges in human-food interactionInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103197183(103197)Online publication date: Mar-2024
      • (2023)A Design Framework for Ingestible PlayACM Transactions on Computer-Human Interaction10.1145/358995430:4(1-39)Online publication date: 11-Sep-2023
      • (2021)Playing with the interior bodyInteractions10.1145/347796228:5(44-49)Online publication date: 31-Aug-2021
      • (2021)Limited Control Over the Body as Intriguing Play Design ResourceProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445744(1-16)Online publication date: 6-May-2021
      • (2021)What Can HCI Learn from Sexual Consent?Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445107(1-13)Online publication date: 6-May-2021
      • (2021)Do Cyborgs dream of Electric Limbs? Experiential Factors in Human-Computer Integration Design and EvaluationExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3441355(1-6)Online publication date: 8-May-2021
      • (2021)The Future of Human-Food InteractionExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3441312(1-6)Online publication date: 8-May-2021

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media