research-article

Towards Affective Chronometry: Exploring Smart Materials and Actuators for Real-time Representations of Changes in Arousal

Authors:

Muhammad Umair,

Muhammad Hamza LatifAuthors Info & Claims

DIS '19: Proceedings of the 2019 on Designing Interactive Systems Conference

Pages 1479 - 1494

https://doi.org/10.1145/3322276.3322367

Published: 18 June 2019 Publication History

Abstract

Increasing HCI work on affective interfaces aimed to capture and communicate users' emotions in order to support self-understanding. While most such interfaces employ traditional screen-based displays, more novel approaches have started to investigate smart materials and actuators-based prototypes. In this paper, we describe our exploration of smart materials and actuators leveraging their temporal qualities as well as common metaphors for real-time representation of changes in arousal through visual and haptic modalities. This exploration provided rationale for the design and implementation of six novel wrist-worn prototypes evaluated with 12 users who wore them over 2 days. Our findings describe how people use them in daily life, and how their material-driven qualities such as responsiveness, duration, rhythm, inertia, aliveness and range shape people's emotion identification, attribution, and regulation. Our findings led to four design implications including support for affective chronometry for both raise and decay time of emotional response, design for slowness, and for expressiveness.

References

[1]

Moses Akazue, Martin Halvey, Lynne Baillie, and Stephen Brewster. 2016. The Effect of Thermal Stimuli on the Emotional Perception of Images. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16, 4401--4412.

Digital Library

[2]

Wolfram Boucsein. 2012. Electrodermal Activity. Springer US, Boston, MA.

[3]

Margaret M Bradley and Peter J Lang. 2000. Measuring emotion: Behavior, feeling, and physiology. In Series in affective science. Cognitive neuroscience of emotion. Oxford University Press, 242--276.

[4]

John T Cacioppo and Louis G Tassinary. 1990. Inferring psychological significance from physiological signals. American Psychologist 45, 1: 16--28.

[5]

Jessica R Cauchard, Janette L Cheng, Thomas Pietrzak, and James A Landay. 2016. ActiVibe: Design and Evaluation of Vibrations for Progress Monitoring. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16, 3261--3271.

Digital Library

[6]

Angela Chang, Sile O'Modhrain, Rob Jacob, Eric Gunther, and Hiroshi Ishii. 2002. ComTouch: design of a vibrotactile communication device. In Proceedings of the conference on Designing interactive systems processes, practices, methods, and techniques - DIS '02, 312--320.

Digital Library

[7]

Munmun De Choudhury, Sanket S. Sharma, Tomaz Logar, Wouter Eekhout, and René Clausen Nielsen. 2017. Gender and Cross-Cultural Differences in Social Media Disclosures of Mental Illness. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing - CSCW '17, 353--369.

Digital Library

[8]

Jean Costa, Alexander T Adams, Malte F Jung, François Guimbetière, and Tanzeem Choudhury. 2016. EmotionCheck: leveraging bodily signals and false feedback to regulate our emotions. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing - UbiComp '16, 758--769.

Digital Library

[9]

Anna L Cox, Sandy J.J. Gould, Marta E Cecchinato, Ioanna Iacovides, and Ian Renfree. 2016. Design Frictions for Mindful Interactions: The Case for Microboundaries. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '16, 1389--1397.

Digital Library

[10]

Claudia Daudén Roquet and Corina Sas. 2018. Evaluating Mindfulness Meditation Apps. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18.

Digital Library

[11]

Richard J Davidson. 2015. Comment: Affective Chronometry Has Come of Age. Emotion Review 7, 4: 368--370.

[12]

Richard J Davidson and Shelly Benjamim Irwin. 1999. The functional neuroanatomy of emotion and affective style. Trends in cognitive sciences 3, 1: 11--21.

[13]

Michael E Dawson, Anne M Schell, Diane L Filion, and Gary G. Berntson. 2007. The Electrodermal System. In Handbook of Psychophysiology, John T. Cacioppo, Louis G. Tassinary and Gary Berntson (eds.). Cambridge University Press, Cambridge, 159--181.

[14]

Laura Devendorf, Kimiko Ryokai, Joanne Lo, Noura Howell, Jung Lin Lee, Nan-Wei Gong, M. Emre Karagozler, Shiho Fukuhara, Ivan Poupyrev, Eric Paulos, and Kimiko Ryokai. 2016. "I don't Want to Wear a Screen": Probing Perceptions of and Possibilities for Dynamic Displays on Clothing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16, 6028--6039.

Digital Library

[15]

Alan Dix and Corina Sas. Mobile Personal Devices meet Situated Public Displays: Synergies and Opportunities. International Journal of Ubiquitous Computing (IJUC) 1, 1: 11--28.

[16]

Alan Dix and Corina Sas. 2008. Public displays and private devices: A design space analysis. New York, New York, USA. Retrieved from https://alandix.com/academic/papers/Dix-Sas-PDPD-2008/

[17]

Gavin Doherty, David Coyle, and John Sharry. 2012. Engagement with online mental health interventions: an exploratory clinical study of a treatment for depression. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI '12, 1421--1430.

Digital Library

[18]

Tanja Döring. 2016. The Interaction Material Profile: Understanding and Inspiring How Physical Materials Shape Interaction. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '16, 2446--2453.

Digital Library

[19]

Paul Dourish and Melissa Mazmanian. 2013. Media as Material: Information Representations as Material Foundations for Organizational Practice. In How Matter Matters: Objects, Artifacts, and Materiality in Organization Studies, Paul R. Carlile, Davide Nicolini, Ann Langley and Haridimos Tsoukas (eds.). Oxford University Press, 92--118.

[20]

Andrew J Elliot and Markus A Maier. 2014. Color psychology: effects of perceiving color on psychological functioning in humans. Annual Review of Psychology 65, 1: 95--120.

[21]

Jennifer Fereday and Eimear Muir-Cochrane. 2006. Demonstrating Rigor Using Thematic Analysis: A Hybrid Approach of Inductive and Deductive Coding and Theme Development. International Journal of Qualitative Methods 5, 1: 80--92.

[22]

Pedro Ferreira, Pedro Sanches, Kristina Höök, and Tove Jaensson. 2008. License to chill!: how to empower users to cope with stress. In Proceedings of the 5th Nordic conference on Human-computer interaction building bridges - NordiCHI '08, 123.

Digital Library

[23]

Thomas Fuchs and Sabine C Koch. 2014. Embodied affectivity: on moving and being moved. Frontiers in Psychology 5: 508.

[24]

William W Gaver, Jacob Beaver, and Steve Benford. 2003. Ambiguity as a resource for design. In Proceedings of the conference on Human factors in computing systems - CHI '03, 233--240.

Digital Library

[25]

Maliheh Ghajargar, Mikael Wiberg, and Erik Stolterman. 2018. Designing IoT Systems that Support Reflective Thinking: A Relational Approach. International Journal of Design 12, 1: 21--35.

[26]

Asma Ghandeharioun and Rosalind Picard. 2017. BrightBeat: Effortlessly Influencing Breathing for Cultivating Calmness and Focus. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '17, 1624--1631.

Digital Library

[27]

Elisa Giaccardi and Elvin Karana. 2015. Foundations of Materials Experience: An Approach for HCI. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15, 2447--2456.

Digital Library

[28]

Aakar Gupta, Antony Albert Raj Irudayaraj, and Ravin Balakrishnan. 2017. HapticClench: Investigating Squeeze Sensations using Memory Alloys. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology - UIST '17, 109--117.

Digital Library

[29]

Lars Hallnäs and Johan Redström. 2001. Slow Technology -- Designing for Reflection. Personal and Ubiquitous Computing 5, 3: 201--212.

Digital Library

[30]

Yu Hao, James Budd, Melody Moore Jackson, Mukul Sati, and Sandeep Soni. 2014. A visual feedback design based on a brain-computer interface to assist users regulate their emotional state. In Proceedings of the extended abstracts of the 32nd annual ACM conference on Human factors in computing systems - CHI EA '14, 2491--2496.

Digital Library

[31]

Clyde L Hardin and Luisa Maffi. 1997. Color Categories in Thought and Language. Cambridge University Press.

[32]

Matthew J Hertenstein, Rachel Holmes, Margaret McCullough, and Dacher Keltner. 2009. The communication of emotion via touch. Emotion 9, 4: 566--573.

[33]

Victoria Hollis, Artie Konrad, Aaron Springer, Matthew Antoun, Christopher Antoun, Rob Martin, and Steve Whittaker. 2017. What Does All This Data Mean for My Future Mood? Actionable Analytics and Targeted Reflection for Emotional Well-Being. Human--Computer Interaction 32, 5--6: 208--267.

Digital Library

[34]

Noura Howell, Laura Devendorf, Rundong Kevin Tian, Tomás Vega Galvez, Nan-Wei Gong, Ivan Poupyrev, Eric Paulos, and Kimiko Ryokai. 2016. Biosignals as Social Cues: Ambiguity and Emotional Interpretation in Social Displays of Skin Conductance. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems - DIS '16, 865--870.

Digital Library

[35]

Noura Howell, Laura Devendorf, Tomás Alfonso Vega Gálvez, Rundong Tian, and Kimiko Ryokai. 2018. Tensions of Data-Driven Reflection: A Case Study of Real-Time Emotional Biosensing. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18, 1--13.

Digital Library

[36]

Ellen Isaacs, Artie Konrad, Alan Walendowski, Thomas Lennig, Victoria Hollis, and Steve Whittaker. 2013. Echoes from the past: how technology mediated reflection improves well-being. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI '13, 1071--1080.

Digital Library

[37]

Heekyoung Jung and Erik Stolterman. 2012. Digital form and materiality: propositions for a new approach to interaction design research. In Proceedings of the 7th Nordic Conference on Human-Computer Interaction Making Sense Through Design - NordiCHI '12, 645.

Digital Library

[38]

Hsin-Liu Cindy Kao, Christian Holz, Asta Roseway, Andres Calvo, and Chris Schmandt. 2016. DuoSkin: rapidly prototyping on-skin user interfaces using skin-friendly materials. In Proceedings of the 2016 ACM International Symposium on Wearable Computers - ISWC '16, 16--23.

[39]

Hsin-Liu Cindy Kao, Manisha Mohan, Chris Schmandt, Joseph A Paradiso, and Katia Vega. 2016. ChromoSkin: Towards Interactive Cosmetics Using Thermochromic Pigments. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '16, 3703--3706.

Digital Library

[40]

Christina Kelley, Bongshin Lee, and Lauren Wilcox. 2017. Self-tracking for Mental Wellness: Understanding Expert Perspectives and Student Experiences. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17, 629--641.

Digital Library

[41]

George (Poonkhin) Khut. 2016. Designing Biofeedback Artworks for Relaxation. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '16, 3859--3862.

Digital Library

[42]

Ilpo Koskinen, John Zimmerman, Thomas Binder, Johan Redstrom, and Stephan Wensveen. 2011. Design research through practice: From the lab, field, and showroom. Elsevier.

Digital Library

[43]

Christian Kray, Keith Cheverst, Dan Fitton, Corina Sas, John Patterson, Mark Rouncefield, and Christoph Stahl. 2006. Sharing control of dispersed situated displays between nand residential users. In Proceedings of the 8th conference on Human-computer interaction with mobile devices and services - MobileHCI '06, 61--68.

Digital Library

[44]

Richard D Lane and Gary E Schwartz. 1987. Levels of emotional awareness: a cognitive-developmental theory and its application to psychopathology {published erratum appears in Am J Psychiatry 1987 Apr;144(4):542}. American Journal of Psychiatry 144, 4: 133--143.

[45]

Peter J Lang, Margaret M Bradley, and Bruce N Cuthbert. 1998. Emotion, motivation, and anxiety: brain mechanisms and psychophysiology. Biological psychiatry 44, 12: 1248--63.

[46]

Adam Lobel, Marientina Gotsis, Erin Reynolds, Michael Annetta, Rutger C.M.E. Engels, and Isabela Granic. 2016. Designing and Utilizing Biofeedback Games for Emotion Regulation. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '16, 1945--1951.

Digital Library

[47]

Diana MacLean, Asta Roseway, and Mary Czerwinski. 2013. MoodWings: a wearable biofeedback device for real-time stress intervention. In Proceedings of the 6th International Conference on PErvasive Technologies Related to Assistive Environments - PETRA '13.

Digital Library

[48]

Mark Matthews, Jaime Snyder, Lindsay Reynolds, Jacqueline T Chien, Adam Shih, Jonathan W Lee, and Geri Gay. 2015. Real-Time Representation Versus Response Elicitation in Biosensor Data. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15, 605--608.

Digital Library

[49]

John McCarthy and Peter Wright. 2005. Putting "felt-life' at the centre of human--computer interaction (HCI). Cognition, Technology & Work 7, 4: 262--271.

Digital Library

[50]

Daniel McDuff, Amy Karlson, Ashish Kapoor, Asta Roseway, and Mary Czerwinski. 2012. AffectAura: an intelligent system for emotional memory. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI '12, 849.

Digital Library

[51]

Pardis Miri, Andero Uusberg, Heather Culbertson, Robert Flory, Helen Uusberg, James J Gross, Keith Marzullo, and Katherine Isbister. 2018. Emotion Regulation in the Wild: Introducing WEHAB System Architecture. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18.

Digital Library

[52]

Jaronie Mohd Jani, Martin Leary, Aleksandar Subic, and Mark A Gibson. 2014. A review of shape memory alloy research, applications and opportunities. Materials & Design (1980--2015) 56: 1078--1113.

[53]

Keith Oatley, Dacher Keltner, and Jennifer M Jenkins. 1996. Understanding Emotions. Blackwell Publishing.

[54]

William Odom, Richard Banks, Abigail Durrant, David Kirk, and James Pierce. 2012. Slow technology: critical reflection and future directions. In Proceedings of the Designing Interactive Systems Conference on - DIS '12, 816--817.

Digital Library

[55]

Mika Pantzar and Minna Ruckenstein. 2015. The heart of everyday analytics: emotional, material and practical extensions in self-tracking market. Consumption Markets & Culture 18, 1: 92--109.

[56]

Pablo Paredes, Ryuka Ko, Arezu Aghaseyedjavadi, John Chuang, John Canny, and Linda Babler. 2015. Synestouch: Haptic + audio affective design for wearable devices. In 2015 International Conference on Affective Computing and Intelligent Interaction (ACII), 595--601.

Digital Library

[57]

Stefano Parisi, Valentina Rognoli, and Marieke Sonneveld. 2017. Material Tinkering. An inspirational approach for experiential learning and envisioning in product design education. The Design Journal 20, sup1: S1167--S1184.

[58]

Helena Pongrac. 2007. Vibrotactile perception: examining the coding of vibrations and the just noticeable difference under various conditions. Multimedia Systems 13, 4: 297--307.

Digital Library

[59]

Isabel P. S. Qamar, Rainer Groh, David Holman, and Anne Roudaut. 2018. HCI meets Material Science: A Literature Review of Morphing Materials for the Design of Shape-Changing Interfaces. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18, 23.

Digital Library

[60]

Chengcheng Qu, Corina Sas, and Gavin Doherty. 2019. Exploring and Designing for Memory Impairments in Depression. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19.

Digital Library

[61]

Rainer Reisenzein. 1983. The Schachter theory of emotion: Two decades later. Psychological Bulletin 94, 2: 239--264.

[62]

Marieke van Rooij, Adam Lobel, Owen Harris, Niki Smit, and Isabela Granic. 2016. DEEP: A Biofeedback Virtual Reality Game for Children At-risk for Anxiety. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '16, 1989--1997.

Digital Library

[63]

Morris Rosenberg. 1990. Reflexivity and Emotions. Social Psychology Quarterly 53, 1: 3.

[64]

James A Russell. 1980. A circumplex model of affect. Journal of Personality and Social Psychology 39, 6: 1161--1178.

[65]

Ian Sage. 2011. Thermochromic liquid crystals. Liquid crystals 38, 11--12: 1551--1561.

[66]

Katri Salminen, Veikko Surakka, Jukka Raisamo, Jani Lylykangas, Johannes Pystynen, Roope Raisamo, Kalle Mäkelä, and Teemu Ahmaniemi. 2011. Emotional responses to thermal stimuli. In Proceedings of the 13th international conference on multimodal interfaces - ICMI '11, 193--196.

Digital Library

[67]

Pedro Sanches, Kristina Höök, Elsa Vaara, Claus Weymann, Markus Bylund, Pedro Ferreira, Nathalie Peira, and Marie Sjölinder. 2010. Mind the body!: designing a mobile stress management application encouraging personal reflection. In Proceedings of the 8th ACM Conference on Designing Interactive Systems - DIS '10, 47.

Digital Library

[68]

Pedro Sanches, Axel Janson, Pavel Karpashevich, Camille Nadal, Chengcheng Qu, Claudia Dauden Roquet, Muhammad Umair, Charles Windlin, Gavin Doherty, Kristina Hook, and others. 2019. HCI and Affective Health: Taking stock of a decade of studies and charting future research directions. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19.

Digital Library

[69]

Karin Sandström. 2006. When motion becomes emotion: A study of emotion metaphors derived from motion verbs. Retrieved from http://www.diva-portal.org/smash/record.jsf?pid=diva2%3A1027700&dswid=-7486

[70]

Corina Sas and Carman Neustaedter. 2017. Exploring DIY Practices of Complex Home Technologies. ACM Transactions on Computer-Human Interaction (TOCHI) - Special Issue EUD for IoT 24, 2.

Digital Library

[71]

Corina Sas, Muhammad Umair, and Muhammad Hamza Latif. 2018. Designing for Self-Regulation from both Pragmatic and Critical Design Lenses. Retrieved from http://eprints.lancs.ac.uk/125125/4/Designing_for_Self_Regulation.pdf

[72]

Stanley Schachter and Jerome Singer. 1962. Cognitive, social, and physiological determinants of emotional state. Psychological Review 69, 5: 379--399.

[73]

Donald A Schön. 2017. The Reflective Practitioner: How Professionals Think in Action. Routledge.

[74]

Eunbi Seol, Chul-Hyun Cho, Seungmoon Choi, Dooyoung Jung, Seulki Min, Sungho Seo, Seoyeon Jung, Youngil Lee, Jaedong Lee, Gerard Kim, Chungyean Cho, and Seungmoo Lee. 2017. "Drop the beat": virtual reality based mindfulness and cognitive behavioral therapy for panic disorder -- a pilot study. In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology - VRST '17, 1--3.

Digital Library

[75]

Adam C Siegel, Scott T Phillips, Benjamin J Wiley, and George M Whitesides. 2009. Thin, lightweight, foldable thermochromic displays on paper. Lab on a Chip 9, 19: 2775--81.

[76]

Jocelyn Smith and Karon MacLean. 2007. Communicating emotion through a haptic link: Design space and methodology. International Journal of Human-Computer Studies 65, 4: 376--387.

Digital Library

[77]

Jaime Snyder, Mark Matthews, Jacqueline Chien, Pamara F Chang, Emily Sun, Saeed Abdullah, and Geri Gay. 2015. MoodLight: Exploring Personal and Social Implications of Ambient Display of Biosensor Data. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing - CSCW '15, 143--153.

Digital Library

[78]

Anna Ståhl, Kristina Höök, Martin Svensson, Alex S Taylor, and Marco Combetto. 2009. Experiencing the Affective Diary. Personal and Ubiquitous Computing 13, 5: 365--378.

Digital Library

[79]

Anna Ståhl, Petra Sundström, and Kristina Höök. 2005. A foundation for emotional expressivity. In Proceedings of the 2005 conference on Designing for User eXperience - DUX '05.

Digital Library

[80]

Petra Sundström, Anna Ståhl, and Kristina Höök. 2007. In situ informants exploring an emotional mobile messaging system in their everyday practice. International Journal of Human-Computer Studies 65, 4: 388--403.

Digital Library

[81]

Petra Sundström, Alex Taylor, Katja Grufberg, Niklas Wirström, Jordi Solsona Belenguer, and Marcus Lundén. 2011. Inspirational bits: towards a shared understanding of the digital material. In Proceedings of the 2011 annual conference on Human factors in computing systems - CHI '11, 1561--1570.

Digital Library

[82]

Petra Sundström, Elsa Vaara, Jordi Solsona, Niklas Wirström, Marcus Lundén, Jarmo Laaksolhati, Annika Waern, and Kristina Höök. 2011. Experiential artifacts as a design method for somaesthetic service development. In Proceedings of the 2011 ACM symposium on The role of design in UbiComp research & practice - RDURP '11, 33--36.

Digital Library

[83]

Ruben T. Azevedo, Nell Bennett, Andreas Bilicki, Jack Hooper, Fotini Markopoulou, and Manos Tsakiris. 2017. The calming effect of a new wearable device during the anticipation of public speech. Scientific Reports 7, 1: 2285.

[84]

Jordan Tewell, Jon Bird, and George R Buchanan. 2017. The Heat is On: A Temperature Display for Conveying Affective Feedback. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17, 1756--1767.

Digital Library

[85]

Anja Thieme, Jayne Wallace, Paula Johnson, John McCarthy, Siân Lindley, Peter Wright, Patrick Olivier, and Thomas D Meyer. 2013. Design to promote mindfulness practice and sense of self for vulnerable women in secure hospital services. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI '13, 2647--2656.

Digital Library

[86]

Panagiotis Tsiamyrtzis, Malcolm Dcosta, Dvijesh Shastri, Eswar Prasad, and Ioannis Pavlidis. 2016. Delineating the Operational Envelope of Mobile and Conventional EDA Sensing on Key Body Locations. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16, 5665--5674.

Digital Library

[87]

Secil Ugur Yavuz, Monica Bordegoni, and Marina Carulli. 2018. A design practice on communicating emotions through sensory signals. Concurrent Engineering 26, 2: 147--156.

[88]

Muhammad Umair, Muhammad Hamza Latif, and Corina Sas. 2018. Dynamic displays at wrist for real time visualization of affective data. In DIS 2018 - Companion Publication of the 2018 Designing Interactive Systems Conference.

Digital Library

[89]

Muhammad Umair and Corina Sas. 2019. Problems in Practice: Critiquing on Thermochromic based Displays for Representing Skin Conductance. Retrieved from http://eprints.lancs.ac.uk/131738/4/Muhammad_Umair_Critiquing_on_Thermochromic_based_Displays_for_Representing_Skin_Conductance.pdf

[90]

Patricia Valdez and Albert Mehrabian. 1994. Effects of color on emotions. Journal of Experimental Psychology: General 123, 4: 394--409.

[91]

Anna Vallgårda and Johan Redström. 2007. Computational composites. In Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '07, 513--522.

Digital Library

[92]

Jay Vidyarthi and Bernhard E Riecke. 2013. Mediated meditation: cultivating mindfulness with sonic cradle. In CHI '13 Extended Abstracts on Human Factors in Computing Systems on - CHI EA '13, 2305--2314.

Digital Library

[93]

Torben Wallbaum, Wilko Heuten, and Susanne Boll. 2016. Comparison of in-situ mood input methods on mobile devices. In Proceedings of the 15th International Conference on Mobile and Ubiquitous Multimedia - MUM '16, 123--127.

Digital Library

[94]

Lois B Wexner. 1954. The degree to which colors (hues) are associated with mood-tones. Journal of Applied Psychology 38, 6: 432--435.

[95]

Mikael Wiberg. 2014. Methodology for materiality: interaction design research through a material lens. Personal and Ubiquitous Computing 18, 3: 625--636.

Digital Library

[96]

Graham Wilson and Stephen A Brewster. 2017. Multi-moji: Combining Thermal, Vibrotactile & Visual Stimuli to Expand the Affective Range of Feedback. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17, 1743--1755.

Digital Library

[97]

Graham Wilson, Dobromir Dobrev, and Stephen A Brewster. 2016. Hot Under the Collar: Mapping Thermal Feedback to Dimensional Models of Emotion. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16, 4838--4849.

Digital Library

[98]

Graham Wilson, Martin Halvey, Stephen A Brewster, and Stephen A Hughes. 2011. Some like it hot: thermal feedback for mobile devices. InProceedings of the 2011 annual conference on Human factors in computing systems - CHI '11, 2555--2564.

[99]

Graham Wilson, Pietro Romeo, and Stephen A Brewster. 2016. Mapping Abstract Visual Feedback to a Dimensional Model of Emotion. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '16, 1779--1787.

Digital Library

[100]

Bin Yu, Rogier Arents, Mathias Funk, Jun Hu, and Loe M.G. Feijs. 2016. HeartPlotter: Visualizing Bio-data by Drawing on Paper. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '16, 1794--1799.

Digital Library

[101]

Bin Yu, Nienke Bongers, Alissa van Asseldonk, Jun Hu, Mathias Funk, and Loe Feijs. 2016. LivingSurface: Biofeedback through Shape-changing Display. In Proceedings of the TEI '16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction - TEI '16, 168--175.

Digital Library

[102]

Bin Yu, Mathias Funk, Jun Hu, and Loe Feijs. 2017. StressTree: A Metaphorical Visualization for Biofeedback-assisted Stress Management. In Proceedings of the 2017 Conference on Designing Interactive Systems - DIS '17, 333--337.

Digital Library

[103]

Welltory: measure and manage your stress & energy. Retrieved January 7, 2019 from https://welltory.com/how-it-works/

[104]

(r)evolution Board Kit BT. Retrieved January 7, 2019 from https://bitalino.com/en/board-kit-bt

[105]

Grove - GSR Sensor. Retrieved January 7, 2019 from http://wiki.seeedstudio.com/Grove-GSR_Sensor/

[106]

Moving average. Retrieved January 7, 2019 from https://en.wikipedia.org/wiki/Moving_average

[107]

Heating Pad - SparkFun Electronics. Retrieved January 7, 2019 from https://www.sparkfun.com/products/11288

[108]

E4 wristband. Retrieved January 7, 2019 from https://www.empatica.com/en-int/research/e4/

Cited By

Sun JCai SYang WLeng HGe ZLiu T(2024)Microrobots Based on Smart Materials with Their Manufacturing Methods and ApplicationsInventions10.3390/inventions90300679:3(67)Online publication date: 14-Jun-2024
https://doi.org/10.3390/inventions9030067
Zhang LYuan YLi JCassinelli AZhu K(2024)WhisperCup: A Design Exploration for Improving the Remote Communication between Chinese Parents and Their Adult Children through Digitally-Augmented Everyday ObjectsProceedings of the ACM on Human-Computer Interaction10.1145/36765348:MHCI(1-26)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676534
Claisse C(2024)Designing for Spiritual Informatics: Exploring a Design Space to Support People's Spiritual JourneyCompanion Publication of the 2024 ACM Designing Interactive Systems Conference10.1145/3656156.3663723(140-143)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3656156.3663723
Show More Cited By

Index Terms

Towards Affective Chronometry: Exploring Smart Materials and Actuators for Real-time Representations of Changes in Arousal
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. User studies
  2. Interaction design
    1. Interaction design theory, concepts and paradigms

Recommendations

Evaluating multimodal affective fusion using physiological signals
IUI '11: Proceedings of the 16th international conference on Intelligent user interfaces

In this paper we present an evaluation of an affective multimodal fusion approach utilizing dimensional representations of emotion. The evaluation uses physiological signals as a reference measure of users' emotional states. Surface electromyography (...
SenToy in FantasyA: Designing an Affective Sympathetic Interface to a Computer Game

We describe the design process of an affective control toy, named SenToy, used to control a synthetic character in a computer game. SenToy allows players to influence the emotions of a synthetic character placed in FantasyA, a 3D virtual game. By ...
Affective interactions: the computer in the affective loop
IUI '05: Proceedings of the 10th international conference on Intelligent user interfaces

There has been an increasing interest in exploring how recognition of a user's affective state can be exploited in creating more effective human-computer interaction. It has been argued that IUIs may be able to improve interaction by including affective ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

DIS '19: Proceedings of the 2019 on Designing Interactive Systems Conference

June 2019

1628 pages

ISBN:9781450358507

DOI:10.1145/3322276

General Chairs:
Steve Harrison
Virginia Tech, USA
,
Shaowen Bardzell
Indiana University, USA
,
Program Chairs:
Carman Neustaedter
Simon Fraser University, Canada
,
Deborah Tatar
Virginia Tech, USA

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

European Commission

Conference

DIS '19

Sponsor:

SIGCHI

DIS '19: Designing Interactive Systems Conference 2019

June 23 - 28, 2019

CA, San Diego, USA

Acceptance Rates

DIS '19 Paper Acceptance Rate 105 of 415 submissions, 25%;

Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

27
Total Citations
View Citations
776
Total Downloads

Downloads (Last 12 months)99
Downloads (Last 6 weeks)13

Reflects downloads up to 03 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sun JCai SYang WLeng HGe ZLiu T(2024)Microrobots Based on Smart Materials with Their Manufacturing Methods and ApplicationsInventions10.3390/inventions90300679:3(67)Online publication date: 14-Jun-2024
https://doi.org/10.3390/inventions9030067
Zhang LYuan YLi JCassinelli AZhu K(2024)WhisperCup: A Design Exploration for Improving the Remote Communication between Chinese Parents and Their Adult Children through Digitally-Augmented Everyday ObjectsProceedings of the ACM on Human-Computer Interaction10.1145/36765348:MHCI(1-26)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676534
Claisse C(2024)Designing for Spiritual Informatics: Exploring a Design Space to Support People's Spiritual JourneyCompanion Publication of the 2024 ACM Designing Interactive Systems Conference10.1145/3656156.3663723(140-143)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3656156.3663723
Cho HLee YLee WLee CCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)Thermo-Play: Exploring the Playful Qualities of Thermochromic MaterialsProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633376(1-16)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633376
Messerschmidt MCortes JNanayakkara S(2024)CoTacs: A Haptic Toolkit to Explore Effective On-Body Haptic Feedback by Ideating, Designing, Evaluating and Refining Haptic Designs Using Group CollaborationInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2358460(1-21)Online publication date: 7-Jun-2024
https://doi.org/10.1080/10447318.2024.2358460
Haliburton LSchött SHirsch LWelsch RSchmidt A(2023)Feeling the Temperature of the RoomProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35808207:1(1-21)Online publication date: 28-Mar-2023
https://dl.acm.org/doi/10.1145/3580820
Sas CLotankar YAdam RBradbury KCooper JHill DMartinez VPowell D(2023)“A Switch Went off in my Whole Body”: Lived Experiences of Fatigue and Post-Exertional Malaise in Long CovidExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585846(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585846
Vyas PDesai UYamakawa KMaclean K(2023)A Descriptive Analysis of a Formative Decade of Research in Affective Haptic System DesignProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580735(1-23)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580735
Peeters DRanasinghe CDegbelo AAhmed F(2023)EmoClock: Communicating Real-Time Emotional States Through Data PhysicalizationsHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42280-5_26(416-425)Online publication date: 25-Aug-2023
https://doi.org/10.1007/978-3-031-42280-5_26
Almoallim SSas C(2022)Toward Research-Informed Design Implications for Interventions Limiting Smartphone Use: Functionalities Review of Digital Well-being AppsJMIR Formative Research10.2196/317306:4(e31730)Online publication date: 19-Apr-2022
https://doi.org/10.2196/31730
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents