research-article

The Heat is On: A Temperature Display for Conveying Affective Feedback

Authors:

George R. BuchananAuthors Info & Claims

CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

Pages 1756 - 1767

https://doi.org/10.1145/3025453.3025844

Published: 02 May 2017 Publication History

Abstract

Previous research has investigated whether temperature can augment a range of media including music, images and video. We describe the first experiment to investigate whether temperature can augment emotion conveyed by text messages. A challenge in prior work has been ensuring users can discern different thermal signals. We present an improved technique for thermal feedback that uses an array of three thermal stimulators. We demonstrate that the Thermal Array Display (TAD) increases users' ability to identify temperatures within a narrower range, compared to using a single thermal stimulator. While text messages dominate valence in the absence of context for temperature, the TAD consistently conveys arousal, and can enhance arousal of text messages, especially those that are emotionally neutral. We discuss potential applications of augmenting text with temperature.

References

[1]

Shimon Akiyama, Katsunari Sato, Yasutoshi Makino, and Takashi Maeno. 2012. Presentation of thermal sensation through preliminary adjustment of adapting skin temperature. In Haptics Symposium (HAPTICS '12), 355--358.

[2]

Margaret M. Bradley and Peter J. Lang. 1994. Measuring emotion: the self-assessment manikin and the semantic differential. Journal of behavior therapy and experimental psychiatry 25, 1: 49--59.

[3]

Lorna M. Brown, Stephen A. Brewster, and Helen C. Purchase. 2006. Multidimensional tactons for nonvisual information presentation in mobile devices. In Proceedings of the 8th conference on Human-computer interaction with mobile devices and services (MobileHCI '06). ACM, NY, NY, USA, 231238.

Digital Library

[4]

Paul Cairns and Anna L. Cox. 2008. Research Methods for Human-Computer Interaction (1st ed.). Cambridge University Press, NY, NY, USA.

[5]

Arthur. D. Craig and M.C. Bushnell. 1994. The thermal grill illusion: unmasking the burn of cold pain. Science 256, 5169: 252--255.

[6]

Arthur D. Craig, Chen Kewei, D. Bandy, and Eric M. Reiman. 2000. Thermosensory activation of insular cortex. Nature neuroscience 3, 2: 184--190.

[7]

CMDMessenger Library. Retrieved March 22, 2016 from http://playground.arduino.cc/Code/CmdMessenger

[8]

Hidenori Fujita and Kazushi Nishimoto. 2004. Lovelet: a heartwarming communication tool for intimate people by constantly conveying situation data. In CHI '04 Extended Abstracts on Human Factors in Computing Systems (CHI EA '04), 1553--1553.

Digital Library

[9]

Alastair J. Gill, Darren Gergle, Robert M. French, and Jon Oberlander. 2008. Emotion rating from short blog texts. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08), 1121--1124.

Digital Library

[10]

Daniel Gooch, and Leon Watts. 2010. Communicating social presence through thermal hugs.

[11]

Barry G. Green. 1977. Localization of thermal sensation: An illusion and synthetic heat. Perception & Psychophysics 22, 4: 331--337.

[12]

Martin Halvey, Michael Henderson, Stephen A. Brewster, Graham Wilson, and Stephen A. Hughes. 2012. Augmenting media with thermal stimulation. In International Conference on Haptic and Audio Interaction Design, 91--100.

Digital Library

[13]

Martin Halvey, Graham Wilson, Stephen Brewster, and Stephen Hughes. 2012. Baby it's cold outside: the influence of ambient temperature and humidity on thermal feedback. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12), 715--724.

Digital Library

[14]

Martin Halvey, Graham Wilson, Stephen A. Brewster, and Stephen A. Hughes. 2013. Perception of thermal stimuli for continuous interaction. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (CHI EA '13), 1587--1592.

Digital Library

[15]

Martin Halvey, Graham Wilson, Yolanda Vazquez Alvarez, Stephen A. Brewster, and Stephen A. Hughes. 2011. The effect of clothing on thermal feedback perception. In Proceedings of the 13th international conference on multimodal interfaces (ICMI '11), 217220.

Digital Library

[16]

David Hannah, Martin Halvey, Graham Wilson, and Stephen A. Brewster. 2011. Using multimodal interactions for 3D television and multimedia browsing. In Proceedings of the 9th international interactive conference on Interactive television (EuroITV '11), 181--184.

Digital Library

[17]

Hans IJzerman, and Gün R. Semin. 2009. "The thermometer of social relations mapping social proximity on temperature." Psychological science 20, 10: 1214--1220.

[18]

Ken Iwasaki, Takashi Miyaki, and Jun Rekimoto. 2010. AffectPhone: a handset device to present user's emotional state with warmth/coolness. In Proceedings of the 1st International Workshop on Bio-inspired Human-Machine Interfaces and Healthcare Applications, 83--88.

[19]

Lynette A. Jones, and Michal Berris. 2002. The psychophysics of temperature perception and thermal interface design. In Proceedings of the 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (HAPTICS '02), 137--142.

[20]

Dan R. Kenshalo and Harley A. Scott. 1966. Temporal course of thermal adaptation. Science 151, 3714: 1095--1096.

[21]

Wonjun Lee and Youn-kyung Lim. 2010. Thermomessage: exploring the potential of heat as a modality of peripheral expression. In CHI '10 Extended Abstracts on Human Factors in Computing Systems (CHI EA '10) 4231--4236.

[22]

Wonjun Lee and Youn-kyung Lim. 2012. Explorative research on the heat as an expression medium: focused on interpersonal communication. Personal and Ubiquitous Computing 16, 8: 1039--1049.

Digital Library

[23]

Michael W. Levine and Jeremy M. Shefner. 2000. Fundamentals of Sensation and Perception (3rd. ed.). Oxford University Press.

[24]

Markus Löchtefeld, Nadine Lautemann, Sven Gehring, and Antonio Krüger. 2014. ambiPad: enriching mobile digital media with ambient feedback. In Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services (MobileHCI '14), 295--298.

Digital Library

[25]

Homei Miyashita and Kazushi Nishimoto. 2004. Thermoscore: a new-type musical score with temperature sensation. In Proceedings of the 2004 Conference on New Interfaces for Musical Expression (NIME '04), 104--107.

[26]

Takuji Narumi, Akagawa Tomohiro, Young Ah Seong, and Michitaka Hirose. 2009. Characterizing the Space by thermal feedback through a wearable device. In Virtual and Mixed Reality, Randall Shumaker (ed.). Springer Berlin Heidelberg, 355--364.

Digital Library

[27]

Tal Oron-Gilad, Yael Salzer, and Adi Ronen. 2008. Thermoelectric tactile display based on the thermal grill illusion. In Haptics: Perception, Devices and Scenarios, Manuel Ferre (ed.). Springer Berlin Heidelberg, 343--348.

Digital Library

[28]

Preotiuc-Pietro, D., Schwartz, H.A., Park, G., Eichstaedt, J.C., Kern, M., Ungar, L. and Shulman, E.P., 2016. Modelling Valence and Arousal in Facebook posts. Proceedings of the Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis (WASSA), NAACL.

[29]

James A Russell. 1980. A Circumplex Model of Affect. Journal of Personality and Social Psychology 39, 6: 1161--1178.

[30]

Katri Salminen, Veikko Surakka, Jukka Raisamo, Jani Lylykangas, Johannes Pystynen, Roope Raisamo, Kalle Mäkelä, and Teemu Ahmaniemi. 2011. Emotional responses to thermal stimuli. In Proceedings of the 13th international conference on multimodal interfaces (ICMI '11), 193--196.

Digital Library

[31]

Katsunari Sato and Takashi Maeno. 2012. Presentation of sudden temperature change using spatially divided warm and cool stimuli. In Haptics: Perception, Devices, Mobility, and Communication, Poika Isokoski and Jukka Springare (eds.). Springer Berlin Heidelberg, 457--468.

Digital Library

[32]

Katja Suhonen, Sebastian Müller, Jussi Rantala, Kaisa Väänänen-Vainio-Mattila, Roope Raisamo, and Vuokko Lantz. 2012. Haptically augmented remote speech communication: a study of user practices and experiences. In Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design (NordiCHI '12), 361--369.

Digital Library

[33]

Eun-Jung Sung, Seung-Schik Yoo, Hyo Woon Yoon, Sung-Suk Oh, Yeji Han, and Hyun Wook Park. Brain activation related to affective dimension during thermal stimulation in humans: a functional magnetic resonance imaging study. 2007. International Journal of Neuroscience 117, 7: 1011--1027.

[34]

Caroline Tagg. 2009. A corpus linguistics study of SMS text messaging. Ph.D Dissertation. The University of Birmingham, Birmingham, UK.

[35]

Cati Vaucelle, Leonardo Bonanni, and Hiroshi Ishii. 2009. Design of haptic interfaces for therapy. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09), 467--470.

Digital Library

[36]

Ryuji Watanabe, Ryuta Okazaki, and Hiroyuki Kajimoto. 2014. Mutual referral of thermal sensation between two thermal-tactile stimuli. In Haptics Symposium (HAPTICS '14), 299--302.

[37]

Lawrence E. Williams, and John A. Bargh. 2008. Experiencing physical warmth promotes interpersonal warmth. Science 322, 5901: 606--607.

[38]

Graham Alasdair Wilson. 2013. Using pressure input and thermal feedback to broaden haptic interaction with mobile devices. Ph.D Dissertation. University of Glasgow, UK.

[39]

Graham Wilson, Stephen Brewster, Martin Halvey, and Stephen Hughes. 2012. Thermal icons: evaluating structured thermal feedback for mobile interaction. In Proceedings of the 14th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '12), 309--312.

Digital Library

[40]

Graham Wilson, Gavin Davidson, and Stephen A. Brewster. 2015. In the heat of the moment: subjective interpretations of thermal feedback during interaction. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), 2063--2072.

Digital Library

[41]

Graham Wilson, Dobromir Dobrev, and Stephen A. Brewster. 2016. Hot Under the Collar: Mapping Thermal Feedback to Dimensional Models of Emotion. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), 4838--4849.

Digital Library

[42]

Graham Wilson, Martin Halvey, Stephen A. Brewster, and Stephen A. Hughes. 2011. Some like it hot: thermal feedback for mobile devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11), 2555--2564.

Digital Library

[43]

Chen-Bo Zhong and Geoffrey J. Leonardelli. 2008. Cold and lonely does social exclusion literally feel cold?. Psychological Science 19, 9: 838--842.

Cited By

He SZeng HXue MHuang GYao CYing F(2024)Affective Stroking: Design Thermal Mid-Air Tactile for Assisting People in Stress RegulationApplied Sciences10.3390/app1420949414:20(9494)Online publication date: 17-Oct-2024
https://doi.org/10.3390/app14209494
Nasser AHasan K(2024)ThermoGrasp: Enabling Localized Thermal Feedback on Fingers for Precision Grasps in Virtual RealityProceedings of the ACM on Human-Computer Interaction10.1145/36765268:MHCI(1-21)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676526
Cui MYuan CLiu YZheng YKostakos VKay JHoang T(2024)More Than Shapes: Exploring the Tactile Parameters of Art Appreciation for the Visually ImpairedCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678391(786-790)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3678391
Show More Cited By

Index Terms

The Heat is On: A Temperature Display for Conveying Affective Feedback
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

ThermoVR: Exploring Integrated Thermal Haptic Feedback with Head Mounted Displays
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

Head Mounted Displays (HMDs) provide a promising opportunity for providing haptic feedback on the head for an enhanced immersive experience. In ThermoVR, we integrated five thermal feedback modules on the HMD to provide thermal feedback directly onto ...
Heat-Nav: Using Temperature Changes as Navigation Cues
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

HCI is increasingly exploring how temperature can be used as an interaction modality. One challenge is that temperature changes are perceived over the course of seconds. This can be attributed to both the slow response time of skin thermoreceptors and ...
The Effect of Thermal Stimuli on the Emotional Perception of Images
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

Thermal stimulation is a feedback channel that has the potential to influence the emotional response of people to media such as images. While previous work has demonstrated that thermal stimuli might have an effect on the emotional perception of images, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

May 2017

7138 pages

ISBN:9781450346559

DOI:10.1145/3025453

General Chairs:
Gloria Mark
University of California Irvine
,
Susan Fussell
Cornell University
,
Program Chairs:
Cliff Lampe
University of Michigan
,
m.c. schraefel
University of Southampton
,
Juan Pablo Hourcade
University of Iowa
,
Caroline Appert
Université Paris-Sud
,
Daniel Wigdor
University of Toronto

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '17

Sponsor:

SIGCHI

CHI '17: CHI Conference on Human Factors in Computing Systems

May 6 - 11, 2017

Colorado, Denver, USA

Acceptance Rates

CHI '17 Paper Acceptance Rate 600 of 2,400 submissions, 25%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

44
Total Citations
View Citations
1,052
Total Downloads

Downloads (Last 12 months)114
Downloads (Last 6 weeks)8

Reflects downloads up to 26 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

He SZeng HXue MHuang GYao CYing F(2024)Affective Stroking: Design Thermal Mid-Air Tactile for Assisting People in Stress RegulationApplied Sciences10.3390/app1420949414:20(9494)Online publication date: 17-Oct-2024
https://doi.org/10.3390/app14209494
Nasser AHasan K(2024)ThermoGrasp: Enabling Localized Thermal Feedback on Fingers for Precision Grasps in Virtual RealityProceedings of the ACM on Human-Computer Interaction10.1145/36765268:MHCI(1-21)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676526
Cui MYuan CLiu YZheng YKostakos VKay JHoang T(2024)More Than Shapes: Exploring the Tactile Parameters of Art Appreciation for the Visually ImpairedCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678391(786-790)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3678391
Feng FBennett DMekler E(2024)Smiles Summon the Warmth of Spring: A Design Framework for Thermal-Affective Interaction based in Chinese Cí PoetryProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661620(2802-2819)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661620
Armstrong MYang CSkiers KLim MGunasekaran TWang ZNarumi TMinamizawa KPai Y(2024)SealMates: Improving Communication in Video Conferencing using a Collective Behavior-Driven AvatarProceedings of the ACM on Human-Computer Interaction10.1145/36373958:CSCW1(1-23)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637395
Moesgen TCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)Understanding and Designing Thermal ExperiencesProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3634893(1-4)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3634893
Moesgen TGowrishankar RXiao YCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)Designing Beyond Hot and Cold – Exploring Full-Body Heat Experiences in SaunaProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633364(1-14)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633364
Ezer TGiron JErel HZuckerman O(2024)Somaesthetic Meditation Wearable: Exploring the Effect of Targeted Warmth Technology on Meditators' ExperiencesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642557(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642557
Moesgen THo HXiao Y(2024)Apparent Thermal Motion on the ForearmHaptics: Understanding Touch; Technology and Systems; Applications and Interaction10.1007/978-3-031-70058-3_5(56-68)Online publication date: 30-Jun-2024
https://dl.acm.org/doi/10.1007/978-3-031-70058-3_5
Haliburton LSchött SHirsch LWelsch RSchmidt A(2023)Feeling the Temperature of the RoomProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35808207:1(1-21)Online publication date: 28-Mar-2023
https://dl.acm.org/doi/10.1145/3580820
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten