Towards a wearable system for assessing couples' dyadic interactions in daily life
Pages 208 - 211
Abstract
Researchers are interested in understanding the dyadic interactions of couples as they relate to relationship quality and chronic disease management. Currently, ambulatory assessment of couples' interactions entail collecting data at random times in the day. There is no ubiquitous system that leverages the dyadic nature of couples' interactions (eg. collecting data when partners are interacting) and also performs real-time inference relevant for relationship quality and chronic disease management. In this work, we seek to develop a smartwatch system that can collect data about couples' dyadic interactions, and infer and track indicators of relationship quality and chronic disease management. We plan to collect data from couples in the field and use the data to develop methods to detect the indicators. Then, we plan to implement these methods as a smartwatch system and evaluate its performance in real-time and everyday life through another field study. Such a system can be used by social psychology researchers to understand the social dynamics of couples in everyday life and their impact on relationship quality, and also by health psychology researchers for developing and delivering behavioral interventions for couples who are managing chronic diseases.
References
[1]
[n.d.]. Open Sourcing German BERT. https://deepset.ai/german-bert. Accessed: 2020-05-1.
[2]
[n.d.]. YAMNet. https://github.com/tensorflow/models/tree/master/research/audioset/yamnet.
[3]
Saeed Abdullah and Tanzeem Choudhury. 2018. Sensing technologies for monitoring serious mental illnesses. IEEE MultiMedia 25, 1 (2018), 61--75.
[4]
Alberto Betella and Paul FMJ Verschure. 2016. The affective slider: A digital self-assessment scale for the measurement of human emotions. PloS one 11, 2 (2016), e0148037.
[5]
George Boateng. 2020. Towards Real-Time Multimodal Emotion Recognition amongCouples. In In 22nd ACM International Conference on Multimodal Interaction (ICMI), Utrecht, the Netherlands, October 25--29, 2020. (Submitted and under review).
[6]
George Boateng, John A Batsis, Ryan Halter, and David Kotz. 2017. ActivityAware: an app for real-time daily activity level monitoring on the amulet wrist-worn device. In 2017 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops). IEEE, 431--435.
[7]
George Boateng, John A Batsis, Patrick Proctor, Ryan Halter, and David Kotz. 2018. GeriActive: Wearable app for monitoring and encouraging physical activity among older adults. In 2018 IEEE 15th International Conference on Wearable and Implantable Body Sensor Networks (BSN). IEEE, 46--49.
[8]
George Boateng and David Kotz. 2016. StressAware: An app for real-time stress monitoring on the amulet wearable platform. In 2016 IEEE MIT Undergraduate Research Technology Conference (URTC). IEEE, 1--4.
[9]
George Boateng, Janina Lüscher, Urte Scholz, and Tobias Kowatsch. 2020. Emotion Capture among Real Couples in Everyday Life. In 1st Momentary Emotion Elicitation & Capture workshop (MEEC 2020), co-located with the ACM CHI Conference on Human Factors in Computing Systems.
[10]
George Boateng, Prabhakaran Santhanam, Janina Lüscher, Urte Scholz, and Tobias Kowatsch. 2019. Poster: DyMand-An Open-Source Mobile and Wearable System for Assessing Couples' Dyadic Management of Chronic Diseases. In The 25th Annual International Conference on Mobile Computing and Networking. 1--3.
[11]
George Boateng, Prabhakaran Santhanam, Janina Lüscher, Urte Scholz, and Tobias Kowatsch. 2019. VADLite: an open-source lightweight system for realtime voice activity detection on smartwatches. In Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers. 902--906.
[12]
George Boateng, Laura Sels, Peter Kuppens, Peter Hilpert, Urte Scholz, and Tobias Kowatsch. 2020. Speech Emotion Recognition among Couples using the Peak-End Rule and Transfer Learning. In In 22nd ACM International Conference on Multimodal Interaction (ICMI), Utrecht, the Netherlands, October 25--29, 2020. (Submitted and under review).
[13]
Guy Bodenmann. 2005. Dyadic coping and its significance for marital functioning. (2005).
[14]
Niall Bolger and David Amarel. 2007. Effects of social support visibility on adjustment to stress: Experimental evidence. Journal of personality and social psychology 92, 3 (2007), 458.
[15]
Sheldon Cohen, Lynn G Underwood, and Benjamin H Gottlieb. 2000. Social support measurement and intervention: A guide for health and social scientists. (2000).
[16]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018).
[17]
Masumi Iida, Mary Ann Parris Stephens, Karen S Rook, Melissa M Franks, and James K Salem. 2010. When the going gets tough, does support get going? Determinants of spousal support provision to type 2 diabetic patients. Personality and Social Psychology Bulletin 36, 6 (2010), 780--791.
[18]
Alexander Karan, Robert C Wright, and Megan L Robbins. 2017. Everyday emotion word and personal pronoun use reflects dyadic adjustment among couples coping with breast cancer. Personal Relationships 24, 1 (2017), 36--48.
[19]
Timothy J Loving and Richard B Slatcher. 2013. Romantic relationships and health. The Oxford handbook of close relationships (2013), 617--637.
[20]
Janina Lüscher, Tobias Kowatsch, George Boateng, Prabhakaran Santhanam, Guy Bodenmann, and Urte Scholz. 2019. Social Support and Common Dyadic Coping in Couples' Dyadic Management of Type II Diabetes: Protocol for an Ambulatory Assessment Application. JMIR research protocols 8, 10 (2019), e13685.
[21]
Matthias R Mehl, Megan L Robbins, and Fenne große Deters. 2012. Naturalistic observation of health-relevant social processes: The Electronically Activated Recorder (EAR) methodology in psychosomatics. Psychosomatic Medicine 74, 4 (2012), 410.
[22]
Daisy Miller and J Lynne Brown. 2005. Marital interactions in the process of dietary change for type 2 diabetes. Journal of Nutrition Education and Behavior 37, 5 (2005), 226--234.
[23]
Soujanya Poria, Erik Cambria, Rajiv Bajpai, and Amir Hussain. 2017. A review of affective computing: From unimodal analysis to multimodal fusion. Information Fusion 37 (2017), 98--125.
[24]
Maija Reblin, Richard E Heyman, Lee Ellington, Brian RW Baucom, Panayiotis G Georgiou, and Susan T Vadaparampil. 2018. Everyday couples' communication research: Overcoming methodological barriers with technology. Patient education and counseling 101, 3 (2018), 551--556.
[25]
Tuula-Maria Rintala, Pia Jaatinen, Eija Paavilainen, and Päivi Åstedt-Kurki. 2013. Interrelation between adult persons with diabetes and their family: a systematic review of the literature. Journal of family nursing 19, 1 (2013), 3--28.
[26]
Megan L Robbins, Elizabeth S Focella, Shelley Kasle, Ana María López, Karen L Weihs, and Matthias R Mehl. 2011. Naturalistically observed swearing, emotional support, and depressive symptoms in women coping with illness. Health Psychology 30, 6 (2011), 789.
[27]
Megan L Robbins, Ana María López, Karen L Weihs, and Matthias R Mehl. 2014. Cancer conversations in context: naturalistic observation of couples coping with breast cancer. Journal of Family Psychology 28, 3 (2014), 380.
[28]
Theodore F Robles, Richard B Slatcher, Joseph M Trombello, and Meghan M McGinn. 2014. Marital quality and health: A meta-analytic review. Psychological bulletin 140, 1 (2014), 140.
[29]
Michael J Rohrbaugh, Matthias R Mehl, Varda Shoham, Elizabeth S Reilly, and Gordon A Ewy. 2008. Prognostic significance of spouse we talk in couples coping with heart failure. Journal of consulting and clinical psychology 76, 5 (2008), 781.
[30]
Amber J Seidel, Melissa M Franks, Mary Ann Parris Stephens, and Karen S Rook. 2012. Spouse control and type 2 diabetes management: moderating effects of dyadic expectations for spouse involvement. Family relations 61, 4 (2012), 698--709.
[31]
Adela C Timmons, Theodora Chaspari, Sohyun C Han, Laura Perrone, Shrikanth S Narayanan, and Gayla Margolin. 2017. Using multimodal wearable technology to detect conflict among couples. Computer 50, 3 (2017), 50--59.
[32]
David Watson, Lee Anna Clark, and Auke Tellegen. 1988. Development and validation of brief measures of positive and negative affect: the PANAS scales. Journal of personality and social psychology 54, 6 (1988), 1063.
Index Terms
- Towards a wearable system for assessing couples' dyadic interactions in daily life
Recommendations
Poster: DyMand -- An Open-Source Mobile and Wearable System for Assessing Couples' Dyadic Management of Chronic Diseases
MobiCom '19: The 25th Annual International Conference on Mobile Computing and NetworkingMarried adults share illness management with spouses and it involves social support and common dyadic coping (CDC). Social support and CDC have an impact on health behavior and well-being or emotions in couples' dyadic management of diabetes in daily ...
Towards Real-Time Multimodal Emotion Recognition among Couples
ICMI '20: Proceedings of the 2020 International Conference on Multimodal InteractionResearchers are interested in understanding the emotions of couples as it relates to relationship quality and dyadic management of chronic diseases. Currently, the process of assessing emotions is manual, time-intensive, and costly. Despite the ...
An Integrated Mobile System for Long-Term Aerobic Activity Monitoring and Support in Daily Life
TRUSTCOM '12: Proceedings of the 2012 IEEE 11th International Conference on Trust, Security and Privacy in Computing and CommunicationsThis paper presents a mobile and unobtrusive platform that enables the accurate monitoring of physical activities in daily life, and is integrated into a healthcare system supporting out-of-hospital services. The main focus of the paper is to describe ...
Comments
Information & Contributors
Information
Published In
September 2020
732 pages
ISBN:9781450380768
DOI:10.1145/3410530
- General Chairs:
- Monica Tentori,
- Nadir Weibel,
- Kristof Van Laerhoven,
- Program Chairs:
- Gregory Abowd,
- Flora Salim
Copyright © 2020 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 12 September 2020
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
- Swiss National Science Foundation
Conference
UbiComp/ISWC '20: 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and 2020 ACM International Symposium on Wearable Computers
September 12 - 17, 2020
Virtual Event, Mexico
Acceptance Rates
Overall Acceptance Rate 764 of 2,912 submissions, 26%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 188Total Downloads
- Downloads (Last 12 months)24
- Downloads (Last 6 weeks)0
Reflects downloads up to 16 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in