Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3544549.3573807acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
extended-abstract

Body x Materials: A workshop exploring the role of material-enabled body-based multisensory experiences

Published: 19 April 2023 Publication History

Abstract

Over the last 15 years, HCI and Interaction Design have experienced a “material turn” characterized by a growing interest in the materiality of technology and computation, and in methods that support exploring, envisioning, and crafting with and through materials. The community has experienced a similar turn focused on the body, on how to best design for and from a first-person, lived experience, and the moving and sensual body. In this workshop, we focus on the intersection of these two turns. The emerging developments in multimodal interfaces open opportunities to bring in materiality to the digital world as well as to transform the materiality of objects and bodies in the real-world, including the materiality of our own bodies. The different sensory qualities of (touchable and untouchable, physical and digital) objects and bodies, including our own, can be brought into the design of digital technologies to enrich, augment, and transform embodied experiences. In this “materials revolution” [15], what are the current theories, approaches, methods, and tools that emphasize the critical role of materiality to body-based interactions with technology? To explore this, in this workshop we will focus on five related themes: material enabling expression, material as a catalyst for human action, material enabling reflection and awareness, material enabling transformation and material supporting the design process for the re-creation of the existing and the yet-to-exist. This workshop with technology presentations, panel sessions with experts, and multidisciplinary discussions will: (i) bring together researchers who work on (re)creating sensory properties of materials through technology with those who investigate experiential effects of materials and material-enabled interactions, (ii) discuss methods, opportunities, difficulties in designing materiality and material-enabled interactions, and (iii) form a multidisciplinary community to build synergies and collaborations.

References

[1]
Maryam Bandukda, Aneesha Singh, Catherine Holloway, Nadia Berthouze, Emeline Brulé, Ana Tajadura-Jiménez, Oussama Metatla, Ana Javornik, and Anja Thieme. 2021. Rethinking the Senses: A Workshop on Multisensory Embodied Experiences and Disability Interactions. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, 1–5. https://doi.org/10.1145/3411763.3441356.
[2]
Robert Benedetti. 1997. The Actor at Work. Retrieved October 11, 2022 from https://books.google.es/books?id=ZdyGAAAAIAAJ
[3]
Eva Brandt. 2000. Evoking the future: Drama and props in user centered design | PDC. 11–20. Retrieved October 11, 2022 from https://ojs.ruc.dk/index.php/pdc/article/view/188.
[4]
Giada Brianza, Ana Tajadura-Jiménez, Emanuela Maggioni, Dario Pittera, Nadia Bianchi-Berthouze, and Marianna Obrist. 2019. As Light as Your Scent: Effects of Smell and Sound on Body Image Perception. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 11749 LNCS: 179–202. https://doi.org/10.1007/978-3-030-29390-1_10/COVER
[5]
Jas Brooks, Shan-Yuan Teng, Jingxuan Wen, Romain Nith, Jun Nishida, and Pedro Lopes. 2021. Stereo-Smell via Electrical Trigeminal Stimulation. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 1–13. https://doi.org/10.1145/3411764.3445300
[6]
Colin Burns, Eric Dishman, William Verplank, and Bud Lassiter. 1994. Actors, hairdos & videotape-informance design. In Conference companion on Human factors in computing systems - CHI ’94, 119–120. https://doi.org/10.1145/259963.260102
[7]
Otto Von Busch and Daye Hwang. 2018. Feeling Fashion: The Embodied Gamble of our Social Skin. New York: SelfPassage.
[8]
L. M. Carey. 1995. Somatosensory loss after stroke. Critical Reviews in Physical and Rehabilitation Medicine 7. https://doi.org/10.1615/CritRevPhysRehabilMed.v7.i1.40
[9]
Thomas F. Cash and Edwin A. Deagle. 1997. The nature and extent of body-image disturbances in anorexia nervosa and bulimia nervosa: A meta-analysis. International Journal of Eating Disorders 22, 2. https://doi.org/10.1002/(SICI)1098-108X(199709)22:2%3c107::AID-EAT1%3e3.0.CO;2-J
[10]
Sonny Chan, Chase Tymms, and Nicholas Colonnese. 2021. Hasti: Haptic and Audio Synthesis for Texture Interactions. 2021 IEEE World Haptics Conference, WHC 2021: 733–738. https://doi.org/10.1109/WHC49131.2021.9517177
[11]
Sünje Clausen, Ana Tajadura-Jiménez, Christian P. Janssen, and Nadia Bianchi-Berthouze. 2021. Action Sounds Informing Own Body Perception Influence Gender Identity and Social Cognition. Frontiers in Human Neuroscience 15: 382. https://doi.org/10.3389/FNHUM.2021.688170/BIBTEX
[12]
Jean Costa, Alexander T. Adams, Malte F. Jung, François Guimbetière, and Tanzeem Choudhury. 2016. EmotionCheck: Leveraging bodily signals and false feedback to regulate our emotions. UbiComp 2016 - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: 758–769. https://doi.org/10.1145/2971648.2971752
[13]
Heather Culbertson and Katherine J. Kuchenbecker. 2017. Importance of matching physical friction, hardness, and texture in creating realistic haptic virtual surfaces. IEEE Transactions on Haptics 10, 1: 63–74. https://doi.org/10.1109/TOH.2016.2598751
[14]
Heather Culbertson, Juan José López Delgado, and Katherine J. Kuchenbecker. 2014. One hundred data-driven haptic texture models and open-source methods for rendering on 3D objects. IEEE Haptics Symposium, HAPTICS: 319–325. https://doi.org/10.1109/HAPTICS.2014.6775475
[15]
Adam Drazin and Susanne Küchler. 2015. The social life of materials: studies in materials and society. Bloomsbury Publishing.
[16]
Elisa Giaccardi and Elvin Karana. 2015. Foundations of materials experience: An approach for HCI. Conference on Human Factors in Computing Systems - Proceedings 2015-April: 2447–2456. https://doi.org/10.1145/2702123.2702337
[17]
Oonagh M. Giggins, Ulrik Mc Carthy Persson, and Brian Caulfield. 2013. Biofeedback in rehabilitation. Journal of NeuroEngineering and Rehabilitation 10, 1: 1–11. https://doi.org/10.1186/1743-0003-10-60/FIGURES/1
[18]
Kristina Höök, Caroline Hummels, Katherine Isbister, Patrizia Marti, Elena Márquez Segura, Martin Jonsson, Florian Mueller, Pedro A.N. Sanches, Thecla Schiphorst, Anna Ståhl, Dag Svanaes, Ambra Trotto, Marianne Graves Petersen, and Youn Kyung Lim. 2017. Soma-based design theory. Conference on Human Factors in Computing Systems - Proceedings Part F127655: 550–557. https://doi.org/10.1145/3027063.3027082
[19]
Steve Howard, Jennie Carroll, John Murphy, and Jane Peck. 2002. Using “endowed props” in scenario-based design. ACM International Conference Proceeding Series 31: 1–9. https://doi.org/10.1145/572020.572022
[20]
IEEE Robotics and Automation Society. 2022. LearnHaptics. Retrieved October 13, 2022 from https://www.learnhaptics.org/
[21]
Katherine Isbister, Kia Höök, Jarmo Laaksolahti, and Michael Sharp. 2007. The sensual evaluation instrument: Developing a trans-cultural self-report measure of affect. International Journal of Human-Computer Studies 65, 4: 315–328. https://doi.org/10.1016/j.ijhcs.2006.11.017
[22]
Kathryn L. Jackson, Imke Janssen, Bradley M. Appelhans, Rasa Kazlauskaite, Kelly Karavolos, Sheila A. Dugan, Elizabeth A. Avery, Karla J. Shipp-Johnson, Lynda H. Powell, and Howard M. Kravitz. 2014. Body image satisfaction and depression in midlife women: The Study of Women's Health Across the Nation (SWAN). Archives of Women's Mental Health 17, 3. https://doi.org/10.1007/s00737-014-0416-9
[23]
Ana Javornik, Yvonne Rogers, Ana Maria Moutinho, and Russell Freeman. 2016. Revealing the shopper experience of using a “Magic Mirror” augmented reality make-up application. DIS 2016 - Proceedings of the 2016 ACM Conference on Designing Interactive Systems: Fuse: 871–882. https://doi.org/10.1145/2901790.2901881
[24]
Ke Jing, Natalie Nygaard, and Theresa Jean Tanenbaum. 2017. Magia transformo: Designing for mixed reality transformative play. CHI PLAY 2017 Extended Abstracts - Extended Abstracts Publication of the Annual Symposium on Computer-Human Interaction in Play: 421–429. https://doi.org/10.1145/3130859.313133
[25]
Keith. Johnstone and Irving Wardle. 1992. Impro: improvisation and the theatre. 208.
[26]
Anouk Keizer, Monique A. M. Smeets, H. Chris Dijkerman, Siarhei A. Uzunbajakau, Annemarie van Elburg, and Albert Postma. 2013. Too Fat to Fit through the Door: First Evidence for Disturbed Body-Scaled Action in Anorexia Nervosa during Locomotion. PLoS ONE 8, 5: e64602. https://doi.org/10.1371/journal.pone.0064602
[27]
Roberta L. Klatzky and Joann Peck. 2012. Please Touch: Object Properties that Invite Touch. IEEE Transactions on Haptics 5, 2: 139–147. https://doi.org/10.1109/TOH.2011.54
[28]
Simone Kriglstein, Anna Lisa Martin-Niedecken, Laia Turmo Vidal, Madison Klarkowski, Katja Rogers, Selen Turkay, Magy Seif El-Nasr, Elena Márquez Segura, Anders Drachen, and Perttu Hämäläinen. 2021. Special Interest Group: The Present and Future of Esports in HCI. Conference on Human Factors in Computing Systems - Proceedings. https://doi.org/10.1145/3411763.3450402
[29]
Anatole Lécuyer, Jean-Marie Burkhardt, and Laurent Etienne. 2004. Feeling Bumps and Holes without a Haptic Interface: the Perception of Pseudo-Haptic Textures. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/985692
[30]
Judith Ley-Flores, Laia Turmo, Vidal Nadia Bianchi Berthouze, Aneesha Singh, Frederic Bevilacqua, and Ana Tajadura-Jimenez. 2021. Soniband: Understanding the efects of metaphorical movement sonifications on body perception and physical activity. Conference on Human Factors in Computing Systems - Proceedings. https://doi.org/10.1145/3411764.3445558
[31]
Quan Liu, Hong Z. Tan, Liang Jiang, and Yulei Zhang. 2018. Perceptual dimensionality of manual key clicks. IEEE Haptics Symposium, HAPTICS 2018-March: 112–118. https://doi.org/10.1109/HAPTICS.2018.8357162
[32]
Karon E. MacLean, Oliver S. Schneider, and Hasti Seifi. 2017. Multisensory haptic interactions: understanding the sense and designing for it. The Handbook of Multimodal-Multisensor Interfaces: Foundations, User Modeling, and Common Modality Combinations - Volume 1: 97–142. https://doi.org/10.1145/3015783.3015788
[33]
Elena Márquez Segura, Laia Turmo Vidal, and Asreen Rostami. 2016. Bodystorming for movement-based interaction design. Human Technology 12, 2: 193–251. https://doi.org/10.17011/ht/urn.201611174655
[34]
Tiago Martins, Ricardo Nascimento, Andreas Zingerle, Christa Sommerer, Laurent Mignonneau, and Nuno Correia. 2009. Headbang hero. ACM International Conference Proceeding Series: 454. https://doi.org/10.1145/1690388.1690501
[35]
Edward McAuley. 1993. Self-efficacy and the maintenance of exercise participation in older adults. Journal of behavioral medicine 16, 1: 103–113.
[36]
Claudia Nunez-Pacheco and Lian Loke. 2014. Crafting the body-tool: A body-centred perspective on wearable technology. Proceedings of the Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques, DIS: 553–562. https://doi.org/10.1145/2598510.2598546
[37]
Marianna Obrist, Rob Comber, Sriram Subramanian, Betina Piqueras-Fiszman, Carlos Velasco, and Charles Spence. 2014. Temporal, Affective, and Embodied Characteristics of Taste Experiences: A Framework for Design. https://doi.org/10.1145/2556288.2557007
[38]
Antti Oulasvirta, Esko Kurvinen, and Tomi Kankainen. 2003. Understanding contexts by being there: case studies in bodystorming. Personal and Ubiquitous Computing 2003 7:2 7, 2: 125–134. https://doi.org/10.1007/S00779-003-0238-7
[39]
Chaeyong Park, Jinhyuk Yoon, Seungjae Oh, and Seungmoon Choi. 2020. Augmenting physical buttons with vibrotactile feedback for programmable feels. UIST 2020 - Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology: 924–937. https://doi.org/10.1145/3379337.3415837
[40]
Bruna Petreca, Sharon Baurley, Nadia Bianchi-Berthouze, and Ana Tajadura-Jiménez. 2016. Investigating nuanced sensory experiences in textiles selection. UbiComp 2016 Adjunct - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: 989–994. https://doi.org/10.1145/2968219.2968264
[41]
Neung Ryu, Woojin Lee, Myung Jin Kim, and Andrea Bianchi. 2020. ElaStick: A handheld variable stiffness display for rendering dynamic haptic response of flexible object. UIST 2020 - Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology: 1035–1045. https://doi.org/10.1145/3379337.3415862
[42]
Dennis Schleicher, Peter Jones, and Oksana Kachur. 2010. Bodystorming as embodied designing. Interactions 17, 6: 47–51. https://doi.org/10.1145/1865245.1865256
[43]
Elena Márquez Segura, Laia Turmo Vidal, Asreen Rostami, and Annika Waern. 2016. Embodied sketching. Conference on Human Factors in Computing Systems - Proceedings: 6014–6027. https://doi.org/10.1145/2858036.2858486
[44]
Hasti Seifi, Matthew Chun, Colin Gallacher, Oliver Schneider, and Karon E. MacLean. 2020. How Do Novice Hapticians Design? A Case Study in Creating Haptic Learning Environments. IEEE Transactions on Haptics 13, 4: 791–805. https://doi.org/10.1109/TOH.2020.2968903
[45]
Hasti Seifi, Farimah Fazlollahi, Michael Oppermann, John Andrew Sastrillo, Jessica Ip, Ashutosh Agrawal, Gunhyuk Park, Katherine J. Kuchenbecker, and Karon E. MacLean. 2019. Haptipedia: Accelerating Haptic Device Discovery to Support Interaction & Engineering Design. Conference on Human Factors in Computing Systems - Proceedings 2019-January: 12. https://doi.org/10.1145/3290605.3300788
[46]
Hasti Seifi, Kailun Zhang, and Karon E. MacLean. 2015. VibViz: Organizing, visualizing and navigating vibration libraries. In IEEE World Haptics Conference, WHC 2015. https://doi.org/10.1109/WHC.2015.7177722
[47]
Aneesha Singh, Nikki Newhouse, Jo Gibbs, Ann E. Blandford, Yunan Chen, Pam Briggs, Helena Mentis, Kate M. Sellen, and Jakob E. Bardram. 2017. HCI and health: Learning from interdisciplinary interactions. Conference on Human Factors in Computing Systems - Proceedings Part F127655: 1322–1325. https://doi.org/10.1145/3027063.3049287
[48]
Aneesha Singh, Ana Tajadura-Jiménez, Nadia Bianchi-Berthouze, Nic Marquardt, Monica Tentori, Roberto Bresin, and Dana Kulic. 2016. Mind the gap: A sig on bridging the gap in research on body sensing, body perception and multisensory feedback. Conference on Human Factors in Computing Systems - Proceedings 07-12-May-2016: 1092–1095. https://doi.org/10.1145/2851581.2886440
[49]
Joel Smith. 2007. How the Body Shapes the Mind By Shaun Gallagher Oxford: Oxford University Press, 2005. pp. 284. Philosophy 82, 1: 196–200. https://doi.org/10.1017/S003181910731913X
[50]
Franziska Tachtler, Konstantin Aal, Tanja Ertl, Daniel Diethei, Jasmin Niess, Mohammed Khwaja, Reem Talhouk, Giovanna Nunes Vilaza, Shaimaa Lazem, Aneesha Singh, Marguerite Barry, Volker Wulf, and Geraldine Fitzpatrick. 2021. Artificially Intelligent Technology for the Margins: A Multidisciplinary Design Agenda. Conference on Human Factors in Computing Systems - Proceedings. https://doi.org/10.1145/3411763.3441333
[51]
Ana Tajadura-Jiménez, Maria Basia, Ophelia Deroy, Merle Fairhurst, Nicolai Marquardt, and Nadia Bianchi-Berthouze. 2015. As Light as your Footsteps: Altering Walking Sounds to Change Perceived Body Weight, Emotional State and Gait. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 2943–2952. https://doi.org/10.1145/2702123.2702374
[52]
Ana Tajadura-Jiménez, Bin Liu, Nadia Bianchi-Berthouze, and Frédéric Bevilacqua. 2014. Using sound in multi-touch interfaces to change materiality and touch behavior. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational, 199–202. https://doi.org/10.1145/2639189.2639217
[53]
Ana Tajadura-Jiménez and Manos Tsakiris. 2014. Balancing the “inner” and the “outer” self: Interoceptive sensitivity modulates self-other boundaries. Journal of Experimental Psychology: General 143, 2: 736–744. https://doi.org/10.1037/A0033171
[54]
Ana Tajadura-Jiménez, Aleksander Väljamäe, Iwaki Toshima, Toshitaka Kimura, Manos Tsakiris, and Norimichi Kitagawa. 2012. Action sounds recalibrate perceived tactile distance. Current Biology 22, 13: R516–R517. https://doi.org/10.1016/j.cub.2012.04.028
[55]
Jakob Tholander, Maria Normark, and Chiara Rossitto. 2012. Understanding agency in interaction design materials. In Conference on Human Factors in Computing Systems - Proceedings. https://doi.org/10.1145/2207676.2208417
[56]
M. E. Tinetti and L. Powell. 1993. Fear of falling and low self-efficacy: a case of dependence in elderly persons. Journal of gerontology 48 Spec No, SPEC. ISS.: 35–38. https://doi.org/10.1093/GERONJ/48.SPECIAL_ISSUE.35
[57]
A. Tsay, T. J. Allen, U. Proske, and M. J. Giummarra. 2015. Sensing the body in chronic pain: A review of psychophysical studies implicating altered body representation. Neuroscience & Biobehavioral Reviews 52: 221–232. https://doi.org/10.1016/J.NEUBIOREV.2015.03.004
[58]
Laia Turmo Vidal, Elena Márquez Segura, and Annika Waern. 2018. Sensory bodystorming for collocated physical training design. In ACM International Conference Proceeding Series. https://doi.org/10.1145/3240167.3240224
[59]
Annika Waern and Paulina Rajkowska. 2022. Sensitizing Design Teams to Theory. In Hybrid Museum Experiences. Amsterdam University Press, Nieuwe Prinsengracht 89 1018 VR Amsterdam, Nederland, 125–144. https://doi.org/10.2307/j.ctv2cxx8x6.10

Cited By

View all
  • (2024)Towards Robot and Technologies that Touch Well – Shaping an Experience-driven Design ParadigmCompanion Publication of the 2024 ACM Designing Interactive Systems Conference10.1145/3656156.3658401(409-412)Online publication date: 1-Jul-2024
  • (2024)Resistive Threads: Electronic Streetwear as Social Movement MaterialProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661537(69-85)Online publication date: 1-Jul-2024
  • (2024)Body Sensations as Design Material: An Approach to Design Sensory Technology for Altering Body PerceptionProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660701(2545-2561)Online publication date: 1-Jul-2024

Index Terms

  1. Body x Materials: A workshop exploring the role of material-enabled body-based multisensory experiences

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems
    April 2023
    3914 pages
    ISBN:9781450394222
    DOI:10.1145/3544549
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 19 April 2023

    Check for updates

    Qualifiers

    • Extended-abstract
    • Research
    • Refereed limited

    Funding Sources

    • Spanish Agencia Estatal de Investigación
    • Engineering and Physical Sciences Research Council
    • Research Funds for Beatriz Galindo Fellowships
    • European Union?s Horizon 2020 research and innovation programme
    • UKRI Digital Economy Programme Sustainable Digital Society

    Conference

    CHI '23
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

    Upcoming Conference

    CHI 2025
    ACM CHI Conference on Human Factors in Computing Systems
    April 26 - May 1, 2025
    Yokohama , Japan

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)186
    • Downloads (Last 6 weeks)15
    Reflects downloads up to 06 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Towards Robot and Technologies that Touch Well – Shaping an Experience-driven Design ParadigmCompanion Publication of the 2024 ACM Designing Interactive Systems Conference10.1145/3656156.3658401(409-412)Online publication date: 1-Jul-2024
    • (2024)Resistive Threads: Electronic Streetwear as Social Movement MaterialProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661537(69-85)Online publication date: 1-Jul-2024
    • (2024)Body Sensations as Design Material: An Approach to Design Sensory Technology for Altering Body PerceptionProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660701(2545-2561)Online publication date: 1-Jul-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media