Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3229434.3229467acmconferencesArticle/Chapter ViewAbstractPublication PagesmobilehciConference Proceedingsconference-collections
research-article

Review of unconventional user interfaces for emotional communication between long-distance partners

Published: 03 September 2018 Publication History

Abstract

New form factors and user interfaces for computer-mediated communication are emerging. The possibilities to use these systems for emotional communication are interesting, and recent years have witnessed the appearance of a versatile range of prototypes. In this paper, we present the results of a systematic literature review on research addressing the design of systems with unconventional user interfaces for emotional communication, focusing on the use case of facilitating long-distance relationships. We reviewed a body of 150 papers resulting from a systematic search, further analysis scoping the body to 47 papers, containing altogether 52 prototypes that were relevant for our focus. We then analysed the characteristics affecting the interaction mediated by these systems and their user interfaces. We present the results related to the design attributes, e.g., form factors, modalities, and message types of the systems, as well as to the evaluation approaches. As salient findings, touch input and visual output are the most common interaction modalities in these systems, and their evaluations lack in-the-wild studies, especially on long-term usage.

References

[1]
Tamara Alsheikh, Jennifer A. Rode, and Siân E. Lindley. 2011. (Whose) value-sensitive design: a study of long- distance relationships in an Arabic cultural context. In Proceedings of the ACM 2011 conference on Computer supported cooperative work (CSCW '11). ACM, New York, NY, USA, 75--84.
[2]
Uddipana Baishya and Carman Neustaedter. 2017. In Your Eyes: Anytime, Anywhere Video and Audio Streaming for Couples. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, USA, 84--97.
[3]
Elizabeth Bales, Kevin A. Li, and William Griwsold. 2011. CoupleVIBE: mobile implicit communication to improve awareness for (long-distance) couples. In Proceedings of the ACM 2011 conference on Computer supported cooperative work (CSCW '11). ACM, New York, NY, USA, 65--74.
[4]
Min Zhen Chai, Alessandro Soro, Paul Roe, and Margot Brereton. 2017. Cooking Together at a Distance: Sustain Connectedness for Long Distance Families. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '17). ACM, New York, NY, USA, 2437--2444.
[5]
Wei-Chi Chien, Sarah Diefenbach, and Marc Hassenzahl. 2013. The whisper pillow: a study of technology-mediated emotional expression in close relationships. In Proceedings of the 6th International Conference on Designing Pleasurable Products and Interfaces (DPPI '13). ACM, New York, NY, USA, 51--59.
[6]
Wei-Chi Chien, Marc Hassenzahl, and Julika Welge. 2016. Sharing a Robotic Pet as a Maintenance Strategy for Romantic Couples in Long-Distance Relationships.: An Autobiographical Design Exploration. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, New York, NY, USA, 1375--1382.
[7]
Chia-Fang Chung, James Hwang, and Sean A. Munson. 2014. Temperature sharing to support remote relationships. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication (UbiComp '14 Adjunct). ACM, New York, NY, USA, 27--30.
[8]
Tanja Döring, Axel Sylvester, and Albrecht Schmidt. 2013. A design space for ephemeral user interfaces. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction (TEI '13). ACM, New York, NY, USA, 75--82.
[9]
Luís Duarte, Tiago Antunes, and Luís Carriço. 2012. Can you feel it?: sharing heart beats with Augmento. In Proceedings of the 3rd Augmented Human International Conference (AH '12). ACM, New York, NY, USA, Article 4, 5 pages.
[10]
Jacob Farny, Matthew Jennex, Rebekah Olsen, and Melissa Rodriguez. 2012. Anchor: connecting sailors to home. In CHI '12 Extended Abstracts on Human Factors in Computing Systems (CHI EA '12). ACM, New York, NY, USA, 1267--1272.
[11]
Allan Fong, Zahra Ashktorab, and Jon Froehlich. 2013. Bear-with-me: an embodied prototype to explore tangible two-way exchanges of emotional language. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (CHI EA '13). ACM, New York, NY, USA, 1011--1016.
[12]
Daniel Gooch and Leon Watts. 2011. The Magic Sock Drawer project. In CHI '11 Extended Abstracts on Human Factors in Computing Systems (CHI EA '11). ACM, New York, NY, USA, 243--252.
[13]
Daniel Gooch and Leon Watts. 2011. A design framework for mediated personal relationship devices. In Proceedings of the 25th BCS Conference on Human-Computer Interaction. British Computer Society, 237--242.
[14]
Daniel Gooch and Leon Watts. 2012. It's neat to feel the heat: how can we hold hands at a distance? In CHI '12 Extended Abstracts on Human Factors in Computing Systems (CHI EA '12). ACM, New York, NY, USA, 1535--1540.
[15]
Daniel Gooch and Leon Watts. 2012. sleepyWhispers: sharing goodnights within distant relationships. In Adjunct proceedings of the 25th annual ACM symposium on User interface software and technology (UIST Adjunct Proceedings '12). ACM, New York, NY, USA, 61--62.
[16]
Catherine Grevet, Anthony Tang, and Elizabeth Mynatt. 2012. Eating alone, together: new forms of commensality. In Proceedings of the 17th ACM international conference on Supporting group work (GROUP '12). ACM, New York, NY, USA, 103--106.
[17]
Jonna Häkkilä, Tuomas Lappalainen, and Saara Koskinen. 2016. In the candle light: pervasive display concept for emotional communication. In Proceedings of the 5th ACM International Symposium on Pervasive Displays (PerDis '16). ACM, New York, NY, USA, 161--167.
[18]
Antal Haans and Wijnand IJsselsteijn. 2006. Mediated social touch: a review of current research and future directions. Virtual Reality 9, no. 2--3 (2006), 149--159. Springer.
[19]
Gerhard Johann Hagerer, Michael Lux, Stefan Ehrlich, and Gordon Cheng. 2015. Augmenting Affect from Speech with Generative Music. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '15). ACM, New York, NY, USA, 977--982.
[20]
Marc Hassenzahl, Stephanie Heidecker, Kai Eckoldt, Sarah Diefenbach, and Uwe Hillmann. 2012. All You Need is Love: Current Strategies of Mediating Intimate Relationships through Technology. ACM Trans. Comput.-Hum. Interact. 19, 4, Article 30 (December 2012), 19 pages.
[21]
Eve Hoggan, Craig Stewart, Laura Haverinen, Giulio Jacucci, and Vuokko Lantz. 2012. Pressages: augmenting phone calls with non-verbal messages. In Proceedings of the 25th annual ACM symposium on User interface software and technology (UIST '12). ACM, New York, NY, USA, 555--562.
[22]
Gijs Huisman. 2012. A touch of affect: mediated social touch and affect. In Proceedings of the 14th ACM international conference on Multimodal interaction (ICMI '12). ACM, New York, NY, USA, 317--320.
[23]
Cindy Jacob and Bruno Dumas. 2014. Designing for intimacy: how fashion design can address privacy issues in wearable computing. In Proceedings of the 2014 ACM International Symposium on Wearable Computers: Adjunct Program (ISWC '14 Adjunct). ACM, New York, NY, USA, 185--192.
[24]
Ryan Kelly, Daniel Gooch, Bhagyashree Patil, and Leon Watts. 2017. Demanding by Design: Supporting Effortful Communication Practices in Close Personal Relationships. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, USA, 70--83.
[25]
Jina Kim, Young-Woo Park, and Tek-Jin Nam. 2015. BreathingFrame: An Inflatable Frame for Remote Breath Signal Sharing. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '15). ACM, New York, NY, USA, 109--112.
[26]
Dimitrios Kontaris, Daniel Harrison, Evgenia-Eleni Patsoule, Susan Zhuang, and Annabel Slade. 2012. Feelybean: communicating touch over distance. In CHI '12 Extended Abstracts on Human Factors in Computing Systems (CHI EA '12). ACM, New York, NY, USA, 1273--1278.
[27]
Robert Kowalski, Sebastian Loehmann, and Doris Hausen. 2013. cubble: a multi-device hybrid approach supporting communication in long-distance relationships. In Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction (TEI '13). ACM, New York, NY, USA, 201--204.
[28]
Tiffany C.K. Kwok, Michael Xuelin Huang, Wai Cheong Tam, and Grace Ngai. 2015. Emotar: Communicating Feelings through Video Sharing. In Proceedings of the 20th International Conference on Intelligent User Interfaces (IUI '15). ACM, New York, NY, USA, 374--378.
[29]
Hajin Lim and Bongwon Suh. 2014. Now here or nowhere: conflict resolution strategies for intimate relationship in diverse geographical contexts. In Proceedings of the companion publication of the 17th ACM conference on Computer supported cooperative work & social computing (CSCW Companion '14). ACM, New York, NY, USA, 197--200.
[30]
Margaret E. Morris, Douglas M. Carmean, Artem Minyaylov, and Luis Ceze. 2017. Augmenting Interpersonal Communication through Connected Lighting. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '17). ACM, New York, NY, USA, 1924--1931.
[31]
Joe Mullenbach, Craig Shultz, J. Edward Colgate, and Anne Marie Piper. 2014. Exploring affective communication through variable-friction surface haptics. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 3963--3972.
[32]
Maki Nakagawa, Koji Tsukada, and Itiro Siio. 2012. CalMate: communication support system for couples using a calm avatar. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing (UbiComp '12). ACM, New York, NY, USA, 604--605.
[33]
Mamoun Nawahdah and Tomoo Inoue. 2013. Virtually dining together in time-shifted environment: KIZUNA design. In Proceedings of the 2013 conference on Computer supported cooperative work (CSCW '13). ACM, New York, NY, USA, 779--788.
[34]
Carman Neustaedter and Saul Greenberg. 2012. Intimacy in long-distance relationships over video chat. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 753--762.
[35]
Marianna Obrist, Sriram Subramanian, Elia Gatti, Benjamin Long, and Thomas Carter. 2015. Emotions Mediated Through Mid-Air Haptics. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2053--2062.
[36]
Rui Pan, Carman Neustaedter, Alissa N. Antle, and Brendan Matkin. 2017. Puzzle Space: A Distributed Tangible Puzzle for Long Distance Couples. In Companion of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17 Companion). ACM, New York, NY, USA, 271--274.
[37]
Rui Pan, Samarth Singhal, Bernhard E. Riecke, Emily Cramer, and Carman Neustaedter. 2017. "MyEyes": The Design and Evaluation of First Person View Video Streaming for Long-Distance Couples. In Proceedings of the 2017 Conference on Designing Interactive Systems (DIS '17). ACM, New York, NY, USA, 135--146.
[38]
Dimitris Papanikolaou, A.J. Bernheim Brush, and Asta Roseway. 2015. BodyPods: Designing Posture Sensing Chairs for Capturing and Sharing Implicit Interactions. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (TEI '15). ACM, New York, NY, USA, 375--382.
[39]
Joohee Park, Young-Woo Park, and Tek-Jin Nam. 2014. Wrigglo: shape-changing peripheral for interpersonal mobile communication. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 3973--3976.
[40]
Young-Woo Park, Seok-Hyung Bae, and Tek-Jin Nam. 2012. How do couples use CheekTouch over phone calls?. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 763--766.
[41]
Gilang Andi Pradana, Adrian David Cheok, Masahiko Inami, Jordan Tewell, and Yongsoon Choi. 2014. Emotional priming of mobile text messages with ring-shaped wearable device using color lighting and tactile expressions. In Proceedings of the 5th Augmented Human International Conference (AH '14). ACM, New York, NY, USA, Article 14, 8 pages.
[42]
Hooman Aghaebrahimi Samani, Rahul Parsani, Lenis Tejada Rodriguez, Elham Saadatian, Kumudu Harshadeva Dissanayake, and Adrian David Cheok. 2012. Kissenger: design of a kiss transmission device. In Proceedings of the Designing Interactive Systems Conference (DIS '12). ACM, New York, NY, USA, 48--57.
[43]
Thecla Schiphorst, Frank Nack, Michiel KauwATjoe, Simon de Bakker, Stock, Lora Aroyo, Angel Perez Rosillio, Hielke Schut, and Norm Jaffe. 2007. PillowTalk: can we afford intimacy?. In Proceedings of the 1st international conference on Tangible and embedded interaction (TEI '07). ACM, New York, NY, USA, 23--30.
[44]
Johanna Schmeer and Tom Baffi. 2010. Touch trace mirror: asynchronous, collaborative messaging as a concept for creating a relatedness experience. In Proceedings of the fifth international conference on Tangible, embedded, and embodied interaction (TEI '11). ACM, New York, NY, USA, 303--304.
[45]
Lauren E. Scissors and Darren Gergle. 2013. "Back and forth, back and forth": channel switching in romantic couple conflict. In Proceedings of the 2013 conference on Computer supported cooperative work (CSCW '13). ACM, New York, NY, USA, 237--248.
[46]
Samarth Singhal and Carman Neustaedter. 2017. BeWithMe: An Immersive Telepresence System for Distance Separated Couples. In Companion of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17 Companion). ACM, New York, NY, USA, 307--310.
[47]
Samarth Singhal, Carman Neustaedter, Yee Loong Ooi, Alissa N. Antle, and Brendan Matkin. 2017. Flex-N-Feel: The Design and Evaluation of Emotive Gloves for Couples to Support Touch Over Distance. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, USA, 98--110.
[48]
Katarzyna Stawarz, Jesper Garde, Ciaran McLoughlin, Robert Nicolaides, and Jennifer Walters. 2012. Silka: a domestic technology to mediate the threshold between connection and solitude. In CHI '12 Extended Abstracts on Human Factors in Computing Systems (CHI EA '12). ACM, New York, NY, USA, 1309--1314.
[49]
S. Shyam Sundar and Sampada S. Marathe. Personalization versus customization: The importance of agency, privacy, and power usage. Human Communication Research 36, no. 3 (2010): 298--322.
[50]
Leila Takayama and Helen Harris. 2013. Presentation of (telepresent) self: on the double-edged effects of mirrors. In Proceedings of the 8th ACM/IEEE international conference on Human-robot interaction (HRI '13). IEEE Press, Piscataway, NJ, USA, 381--388.
[51]
Dzmitry Tsetserukou and Alena Neviarouskaya. 2010. World's first wearable humanoid robot that augments our emotions. In Proceedings of the 1st Augmented Human International Conference (AH '10). ACM, New York, NY, USA, Article 8, 10 pages.
[52]
Katherine M. Tsui, Munjal Desai, and Holly A. Yanco. 2012. Towards measuring the quality of interaction: communication through telepresence robots. In Proceedings of the Workshop on Performance Metrics for Intelligent Systems (PerMIS '12). ACM, New York, NY, USA, 101--108.
[53]
Hitomi Tsujita, Koji Tsukada, and Siio Itiro. 2010. InPhase: evaluation of a communication system focused on "happy coincidences" of daily behaviors. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 2481--2490.
[54]
Hansen Wei, Elisa Giaccardi, and Marieke Sonneveld. 2013. Exploring design opportunities for social intimacy through everyday objects and practices. In Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication (UbiComp '13 Adjunct). ACM, New York, NY, USA, 1401--1404.
[55]
Jun Wei, Xuan Wang, Roshan Lalintha Peiris, Yongsoon Choi, Xavier Roman Martinez, Remi Tache, Jeffrey Tzu Kwan Valino Koh, Veronica Halupka, and Adrian David Cheok. 2011. CoDine: an interactive multi-sensory system for remote dining. In Proceedings of the 13th international conference on Ubiquitous computing (UbiComp '11). ACM, New York, NY, USA, 21--30.
[56]
Lillian Yang, Carman Neustaedter, and Thecla Schiphorst. 2017. Communicating Through A Telepresence Robot: A Study of Long Distance Relationships. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '17). ACM, New York, NY, USA, 3027--3033.
[57]
Salu Ylirisku, Antti Jylhä, Anu Lehtiö, Imtiaj Ahmed, Craig Stewart, Abigail Sellen, Richard Harper, and Giulio Jacucci. 2016. Designing for Active Place Presence at Home: The Hole in Space Design Experiment. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS '16). ACM, New York, NY, USA, 1341--1352.

Cited By

View all
  • (2024)Miles apart but close at heart?i-com10.1515/icom-2024-001023:1(95-107)Online publication date: 14-Feb-2024
  • (2024)Supporting Hard Conversations in Close Relationships Through DesignProceedings of the ACM on Human-Computer Interaction10.1145/36869188:CSCW2(1-22)Online publication date: 8-Nov-2024
  • (2024)WhisperCup: A Design Exploration for Improving the Remote Communication between Chinese Parents and Their Adult Children through Digitally-Augmented Everyday ObjectsProceedings of the ACM on Human-Computer Interaction10.1145/36765348:MHCI(1-26)Online publication date: 24-Sep-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MobileHCI '18: Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services
September 2018
552 pages
ISBN:9781450358989
DOI:10.1145/3229434
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 September 2018

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. communication of emotions
  2. emotional communication
  3. intimate communication
  4. literature review
  5. long-distance relationship
  6. presence-in-absence
  7. remote presence
  8. romantic
  9. romantic communication

Qualifiers

  • Research-article

Conference

MobileHCI '18
Sponsor:

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)182
  • Downloads (Last 6 weeks)18
Reflects downloads up to 01 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Miles apart but close at heart?i-com10.1515/icom-2024-001023:1(95-107)Online publication date: 14-Feb-2024
  • (2024)Supporting Hard Conversations in Close Relationships Through DesignProceedings of the ACM on Human-Computer Interaction10.1145/36869188:CSCW2(1-22)Online publication date: 8-Nov-2024
  • (2024)WhisperCup: A Design Exploration for Improving the Remote Communication between Chinese Parents and Their Adult Children through Digitally-Augmented Everyday ObjectsProceedings of the ACM on Human-Computer Interaction10.1145/36765348:MHCI(1-26)Online publication date: 24-Sep-2024
  • (2024)HoneyPot: Connecting Through a Mediated Ambient PlantProceedings of the 2024 International Conference on Advanced Visual Interfaces10.1145/3656650.3656735(1-3)Online publication date: 3-Jun-2024
  • (2024)Affective Computing for Mobile TechnologiesAdjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction10.1145/3640471.3680459(1-5)Online publication date: 21-Sep-2024
  • (2024)There is an “I” in “We”: Relatedness Technologies Viewed Through the Lens of the Need for AutonomyExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650985(1-7)Online publication date: 11-May-2024
  • (2023)DisClose: Negative Body-Related Self-Disclosure to Mediate Intimacy over DistanceProceedings of the 35th Australian Computer-Human Interaction Conference10.1145/3638380.3638391(114-127)Online publication date: 2-Dec-2023
  • (2023)Social Wormholes: Exploring Preferences and Opportunities for Distributed and Physically-Grounded Social ConnectionsProceedings of the ACM on Human-Computer Interaction10.1145/36102087:CSCW2(1-29)Online publication date: 4-Oct-2023
  • (2023)A Social Awareness Interface for Helping Immigrants Maintain Connections to Their Families and Cultural Roots: The Case of Venezuelan ImmigrantsProceedings of the 2023 ACM International Conference on Interactive Media Experiences10.1145/3573381.3596461(188-193)Online publication date: 12-Jun-2023
  • (2023)Embodied Telepresent Connection (ETC): Exploring Virtual Social Touch Through PseudohapticsExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585843(1-7)Online publication date: 19-Apr-2023
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media