Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article
Open access

Changing Your Tune: Lessons for Using Music to Encourage Physical Activity

Published: 15 May 2024 Publication History

Abstract

Our research investigated whether music can communicate physical activity levels in daily life. Past studies have shown that simple musical tunes can provide wellness information, but no study has examined whether musical feedback can affect daily behavior or lead to healthier habits. We conducted a within-subject study with 62 participants over a period of 76 days, providing either musical or text-based feedback on their daily physical activity. The music was built and personalized based on participants' step counts and baseline wellness perceptions. Results showed that participants were marginally more active during the music feedback compared to their baseline period, and significantly more active compared to the text-based feedback (p = 0.000). We also find that the participant's average activity may influence the musical features they find most inspiration within a song. Finally, context influenced how musical feedback was interpreted, and specific musical features correlated with higher activity levels regardless of baseline perceptions. We discuss lessons learned for designing music-based feedback systems for health communication.

References

[1]
2020. Higher Daily Step Count Linked with Lower All-cause Mortality | CDC Online Newsroom |. https://www.cdc.gov/media/releases/2020/p0324-daily-step-count.html
[2]
Tim Althoff, Ryen W. White, and Eric Horvitz. 2016. Influence of Pokémon Go on Physical Activity: Study and Implications. Journal of Medical Internet Research 18, 12 (Dec 2016), e6759. https://doi.org/10.2196/jmir.6759
[3]
Paul Barratt. 2017. Healthy competition: A qualitative study investigating persuasive technologies and the gamification of cycling. Health Place 46 (July 2017), 328--336. https://doi.org/10.1016/j.healthplace.2016.09.009
[4]
Paolo Riccardo Brustio, Paolo Moisè, Danilo Marasso, Franco Miglio, Alberto Rainoldi, and Gennaro Boccia. 2018. Feasibility of implementing an outdoor walking break in Italian middle schools. PLOS ONE 13, 8 (08 2018), 1--13. https://doi.org/10.1371/journal.pone.0202091
[5]
Sophie E. Carter, Richard Draijer, Sophie M. Holder, Louise Brown, Dick H. J. Thijssen, and Nicola D. Hopkins. 2018. Regular walking breaks prevent the decline in cerebral blood flow associated with prolonged sitting. Journal of Applied Physiology 125, 3 (Sep 2018), 790--798. https://doi.org/10.1152/japplphysiol.00310.2018
[6]
Sixian Chen, John Bowers, and Abigail Durrant. 2015. "Ambient walk": a mobile application for mindful walking with sonification of biophysical data. In Proceedings of the 2015 British HCI Conference. ACM, Lincoln Lincolnshire United Kingdom, 315--315. https://doi.org/10.1145/2783446.2783630
[7]
Jae-Hyoung Cho, Hye-Chung Lee, Dong-Jun Lim, Hyuk-Sang Kwon, and Kun-Ho Yoon. 2009. Mobile communication using a mobile phone with a glucometer for glucose control in Type 2 patients with diabetes: as effective as an Internet-based glucose monitoring system. Journal of Telemedicine and Telecare 15, 2 (Mar 2009), 77--82. https://doi.org/10.1258/jtt.2008.080412
[8]
Kyung Yun Choi, Valentina Sumini, and Hiroshi Ishii. 2019. reSpire: Self-awareness and Interpersonal Connectedness through Shape-changing Fabric Display. In Proceedings of the 2019 on Creativity and Cognition. ACM, San Diego CA USA, 449--454. https://doi.org/10.1145/3325480.3329176
[9]
Matthew Clark and Afsaneh Doryab. 2022. Sounds of Health: Using Personalized Sonification Models to Communicate Health Information. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 4 (December 2022), 206:1-206:31. https://doi.org/10.1145/3570346
[10]
Mihail Cocosila, Norm Archer, R. Brian Haynes, and Yufei Yuan. 2009. Can wireless text messaging improve adherence to preventive activities? Results of a randomised controlled trial. International Journal of Medical Informatics 78, 4 (Apr 2009), 230--238. https://doi.org/10.1016/j.ijmedinf.2008.07.011
[11]
H. Cole-Lewis and T. Kershaw. 2010. Text Messaging as a Tool for Behavior Change in Disease Prevention and Management. Epidemiologic Reviews 32, 1 (Apr 2010), 56--69. https://doi.org/10.1093/epirev/mxq004
[12]
Sunny Consolvo, Predrag Klasnja, David W. McDonald, Daniel Avrahami, Jon Froehlich, Louis LeGrand, Ryan Libby, Keith Mosher, and James A. Landay. 2008. Flowers or a robot army?: encouraging awareness activity with personal, mobile displays. In Proceedings of the 10th international conference on Ubiquitous computing - UbiComp '08. ACM Press, Seoul, Korea, 54. https://doi.org/10.1145/1409635.1409644
[13]
Sunny Consolvo, Ryan Libby, Ian Smith, James A. Landay, David W. McDonald, Tammy Toscos, Mike Y. Chen, Jon Froehlich, Beverly Harrison, Predrag Klasnja, Anthony LaMarca, and Louis LeGrand. 2008. Activity sensing in the wild: a field trial of ubifit garden. In Proceeding of the twenty-sixth annual CHI conference on Human factors in computing systems - CHI '08. ACM Press, Florence, Italy, 1797. https://doi.org/10.1145/1357054.1357335
[14]
Michelle Dugas, Guodong Gao, and Ritu Agarwal. 2020. Unpacking mHealth interventions: a systematic review of behavior change techniques used in randomized controlled trials assessing mHealth effectiveness. Digital health 6 (2020), 2055207620905411.
[15]
Bruce Ferwerda, Marko Tkalcic, and Markus Schedl. 2017. Personality Traits and Music Genre Preferences: How Music Taste Varies Over Age Groups. 11th ACM Conference on Recommender Systems (2017).
[16]
Fitbit. 2023. Advanced Health Smartwatch | Fitbit Sense. https://www.fitbit.com/global/us/products/smartwatches/sense
[17]
Fitbit. 2023. What are the reminders I see on my Fitbit device? https://help.fitbit.com/articles/en_US/Help_article/1878.htm
[18]
Thomas Fritz, Sebastian Jentschke, Nathalie Gosselin, Daniela Sammler, Isabelle Peretz, Robert Turner, Angela D. Friederici, and Stefan Koelsch. 2009. Universal Recognition of Three Basic Emotions in Music. Current Biology 19, 7 (Apr 2009), 573--576. https://doi.org/10.1016/j.cub.2009.02.058
[19]
Mads Frost, Afsaneh Doryab, Maria Faurholt-Jepsen, Lars Vedel Kessing, and Jakob E. Bardram. 2013. Supporting disease insight through data analysis: refinements of the monarca self-assessment system. In Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing. ACM, Zurich Switzerland, 133--142. https://doi.org/10.1145/2493432.2493507
[20]
Kyosuke Futami, Tsutomu Terada, and Masahiko Tsukamoto. 2021. A Method for Behavior Change Support by Controlling Psychological Effects on Walking Motivation Caused by Step Count Log Competition System. Sensors 21, 2323 (Jan 2021), 8016. https://doi.org/10.3390/s21238016
[21]
Christian Gold, Tony Wigram, and Cochavit Elefant. 2006. Music therapy for autistic spectrum disorder. Cochrane Database of Systematic Reviews 2 (2006). https://doi.org/10.1002/14651858.CD004381.pub2
[22]
J. Guerra, L. Smith, D. Vicinanza, B. Stubbs, N. Veronese, and G. Williams. 2020. The use of sonification for physiotherapy in human movement tasks: A scoping review. Science Sports 35, 3 (Jun 2020), 119--129. https://doi.org/10.1016/j.scispo.2019.12.004
[23]
Jenny Hansdotter. 2017. Audio feedback in music - a study of experience of audio feedback in mu- sic for rehabilitation treatment for fear avoidance. (2017), 38.
[24]
Emmi Harjuniemi, Ashley Colley, Piia Rytilahti, Hong Li, Jesse Forest, and Jonna Häkkilä. 2018. Idle stripes shirt: ambient wearable display for activity tracking. In Proceedings of the 2018 ACM International Symposium on Wearable Computers. ACM, Singapore Singapore, 254--259. https://doi.org/10.1145/3267242.3267303
[25]
Wai Kai Hou, Francisco TT Lai, Menachem Ben-Ezra, and Robin Goodwin. 2020. Regularizing daily routines for mental health during and after the COVID-19 pandemic. Journal of Global Health 10, 2 (Dec 2020), 020315. https://doi.org/10.7189/jogh.10.020315
[26]
Vilelmini Kalampratsidou and Elizabeth B. Torres. 2019. Bodily Signals Entrainment in the Presence of Music. In Proceedings of the 6th International Conference on Movement and Computing. ACM, Tempe AZ USA, 1--8. https://doi.org/10.1145/3347122.3347125
[27]
Dennis L. Kappen and Rita Orji. 2017. Gamified and persuasive systems as behavior change agents for health and wellness. XRDS: Crossroads, The ACM Magazine for Students 24, 1 (Sep 2017), 52--55. https://doi.org/10.1145/3123750
[28]
Loic Kessous, Christian Jacquemin, and Jean-Julien Filatriau. 2008. REAL-TIME SONIFICATION OF PHYSIOLOGICAL DATA IN AN ARTISTIC PERFORMANCE CONTEXT. (2008).
[29]
Madina Khamzina, Kaustubh V. Parab, Ruopeng An, Tiffany Bullard, and Diana S. Grigsby-Toussaint. 2020. Impact of Pokémon Go on Physical Activity: A Systematic Review and Meta-Analysis | Elsevier Enhanced Reader. American Journal of Preventative Medicine (2020), 13. https://doi.org/10.1016/j.amepre.2019.09.005
[30]
Rohit Ashok Khot, Larissa Hjorth, and Florian "Floyd" Mueller. 2014. Understanding physical activity through 3D printed material artifacts. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Toronto Ontario Canada, 3835--3844. https://doi.org/10.1145/2556288.2557144
[31]
Predrag Klasnja, Sunny Consolvo, and Wanda Pratt. 2011. How to evaluate technologies for health behavior change in HCI research. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Vancouver BC Canada, 3063--3072. https://doi.org/10.1145/1978942.1979396
[32]
Rafal Kocielnik, Lillian Xiao, Daniel Avrahami, and Gary Hsieh. 2018. Reflection Companion: A Conversational System for Engaging Users in Reflection on Physical Activity. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 2 (July 2018), 70:1-70:26. https://doi.org/10.1145/3214273
[33]
Stefan Koelsch. 2009. A Neuroscientific Perspective on Music Therapy. Annals of the New York Academy of Sciences 1169, 1 (Jul 2009), 374--384. https://doi.org/10.1111/j.1749-6632.2009.04592.x
[34]
Francisco Tsz Tsun Lai, Vivien Kin Yi Chan, Tsz Wai Li, Xue Li, Stevan E Hobfoll, Tatia Mei-Chun Lee, and Wai Kai Hou. 2021. Disrupted daily routines mediate the socioeconomic gradient of depression amid public health crises: A repeated cross-sectional study. Australian New Zealand Journal of Psychiatry (Oct 2021), 000486742110512. https://doi.org/10.1177/00048674211051271
[35]
Nicholas Lane, Mashfiqui Mohammod, Mu Lin, Xiaochao Yang, Hong Lu, Shahid Ali, Afsaneh Doryab, Ethan Berke, Tanzeem Choudhury, and Andrew Campbell. 2011. BeWell: A Smartphone Application to Monitor, Model and Promote Wellbeing. In Proceedings of the 5th International ICST Conference on Pervasive Computing Technologies for Healthcare. IEEE, Dublin, Republic of Ireland. https://doi.org/10.4108/icst.pervasivehealth.2011.246161
[36]
Judith Ley-Flores, Laia Turmo Vidal, Nadia Berthouze, Aneesha Singh, Frédéric Bevilacqua, and Ana Tajadura-Jiménez. 2021. SoniBand: Understanding the Effects of Metaphorical Movement Sonifications on Body Perception and Physical Activity. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, Yokohama Japan, 1--16. https://doi.org/10.1145/3411764.3445558
[37]
James J. Lin, Lena Mamykina, Silvia Lindtner, Gregory Delajoux, and Henry B. Strub. 2006. Fish'n'Steps: Encouraging Physical Activity with an Interactive Computer Game. Lecture Notes in Computer Science, Vol. 4206. Springer Berlin Heidelberg, Berlin, Heidelberg, 261--278. https://doi.org/10.1007/11853565_16
[38]
Ryan Louie, Andy Coenen, Cheng Zhi Huang, Michael Terry, and Carrie J. Cai. 2020. Novice-AI Music Co-Creation via AI-Steering Tools for Deep Generative Models. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, 1--13. https://doi.org/10.1145/3313831.3376739
[39]
Álvaro Lozano Murciego, Diego M. Jiménez-Bravo, Adrián Valera Román, Juan F. De Paz Santana, and María N. Moreno-García. 2021. Context-Aware Recommender Systems in the Music Domain: A Systematic Literature Review. Electronics 10, 13 (2021). https://doi.org/10.3390/electronics10131555
[40]
Anna Maratos, Christian Gold, Xu Wang, and Mike Crawford. 2008. Music therapy for depression. Cochrane Database of Systematic Reviews 1 (2008). https://doi.org/10.1002/14651858.CD004517.pub2
[41]
Victor Mateevitsi, Khairi Reda, Jason Leigh, and Andrew Johnson. 2014. The health bar: a persuasive ambient display to improve the office worker's well being. In Proceedings of the 5th Augmented Human International Conference. ACM, 1--2. https://doi.org/10.1145/2582051.2582072
[42]
Elizabeth L. Murnane, Yekaterina S. Glazko, Jean Costa, Raymond Yao, Grace Zhao, Paula M. L. Moya, and James A. Landay. 2022. Narrative-Based Visual Feedback to Encourage Sustained Physical Activity: A Field Trial of the WhoIsZuki Mobile Health Platform. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 7, 1 (March 2022), 1--36. https://doi.org/10.1145/3580786
[43]
Elizabeth L. Murnane, Xin Jiang, Anna Kong, Michelle Park, Weili Shi, Connor Soohoo, Luke Vink, Iris Xia, Xin Yu, John Yang-Sammataro, Grace Young, Jenny Zhi, Paula Moya, and James A. Landay. 2020. Designing Ambient Narrative-Based Interfaces to Reflect and Motivate Physical Activity. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. ACM, Honolulu HI USA, 1--14. https://doi.org/10.1145/3313831.3376478
[44]
Greg Murray, John Gottlieb, and Holly A Swartz. 2021. Maintaining Daily Routines to Stabilize Mood: Theory, Data, and Potential Intervention for Circadian Consequences of COVTD-19. The Canadian Journal of Psychiatry 66, 1 (Jan 2021), 9--13. https://doi.org/10.1177/0706743720957825
[45]
Adity U. Mutsuddi and Kay Connelly. 2012. Text messages for encouraging physical activity Are they effective after the novelty effect wears off?. In 2012 6th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops. 33--40. https://doi.org/10.4108/icst.pervasivehealth.2012.248715
[46]
NCCIH. 2022. Music and Health: What You Need To Know. https://www.nccih.nih.gov/health/music-and-health-what-you-need-to-know
[47]
Joseph W. Newbold, Nadia Bianchi-Berthouze, and Nicolas E. Gold. 2017. Musical Expectancy in Squat Sonification for People Who Struggle with Physical Activity. In Proceedings of the 23rd International Conference on Auditory Display - ICAD 2017. The International Community for Auditory Display, University Park Campus, 65--72. https://doi.org/10.21785/icad2017.008
[48]
Thomas H. Nown, Priti Upadhyay, Andrew Kerr, Ivan Andonovic, Christos Tachtatzis, and Madeleine A. Grealy. 2022. A Mapping Review of Real-Time Movement Sonification Systems for Movement Rehabilitation. IEEE Reviews in Biomedical Engineering (2022), 1--16. https://doi.org/10.1109/RBME.2022.3187840
[49]
Vedran Ostojic, Branimir Cvoriscec, Sanja Barsic Ostojic, Dimitry Reznikoff, Asja Stipic-Markovic, and Zdenko Tudjman. 2005. Improving Asthma Control Through Telemedicine: A Study of Short-Message Service. Telemedicine and e-Health 11, 1 (Feb 2005), 28--35. https://doi.org/10.1089/tmj.2005.11.28
[50]
Kevin Patrick, Fred Raab, Marc Adams, Lindsay Dillon, Marion Zabinski, Cheryl Rock, William Griswold, and Gregory Norman. 2009. A Text Message-Based Intervention for Weight Loss: Randomized Controlled Trial. Journal of Medical Internet Research 11, 1 (Jan 2009), e1100. https://doi.org/10.2196/jmir.1100
[51]
Pedro Pereira, Emília Duarte, Francisco Rebelo, and Paulo Noriega. 2014. A Review of Gamification for Health-Related Contexts. Lecture Notes in Computer Science, Vol. 8518. Springer International Publishing, Cham, 742--753. https://doi.org/10.1007/978-3-319-07626-3_70
[52]
Daniël Ploeger. 2011. Sounds Like Superman? On the Representation of Bodies in Biosignal Performance. (2011), 13.
[53]
Mashfiqui Rabbi, Min Hane Aung, Mi Zhang, and Tanzeem Choudhury. 2015. MyBehavior: automatic personalized health feedback from user behaviors and preferences using smartphones. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, Osaka Japan, 707--718. https://doi.org/10.1145/2750858.2805840
[54]
A Rodgers. 2005. Do u smoke after txt? Results of a randomised trial of smoking cessation using mobile phone text messaging. Tobacco Control 14, 4 (Aug 2005), 255--261. https://doi.org/10.1136/tc.2005.011577
[55]
Herman Saksono, Carmen Castaneda-Sceppa, Jessica A. Hoffman, Magy Seif El-Nasr, and Andrea Parker. 2021. StoryMap: Using Social Modeling and Self-Modeling to Support Physical Activity Among Families of Low-SES Backgrounds. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. ACM, Yokohama Japan, 1--14. https://doi.org/10.1145/3411764.3445087
[56]
Kavous Salehzadeh Niksirat, Chaklam Silpasuwanchai, Mahmoud Mohamed Hussien Ahmed, Peng Cheng, and Xiangshi Ren. 2017. A Framework for Interactive Mindfulness Meditation Using Attention-Regulation Process. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, Denver Colorado USA, 2672--2684. https://doi.org/10.1145/3025453.3025914
[57]
Hanna Schäfer, Joachim Bachner, Sebastian Pretscher, Georg Groh, and Yolanda Demetriou. 2018. Study on Motivating Physical Activity in Children with Personalized Gamified Feedback. In Adjunct Publication of the 26th Conference on User Modeling, Adaptation and Personalization. ACM, Singapore Singapore, 221--226. https://doi.org/10.1145/3213586.3225227
[58]
Skipper Seabold and Josef Perktold. 2010. statsmodels: Econometric and statistical modeling with python. In 9th Python in Science Conference.
[59]
Aneesha Singh, Stefano Piana, Davide Pollarolo, Gualtiero Volpe, Giovanna Varni, Ana Tajadura-Jiménez, Amanda CdeC Williams, Antonio Camurri, and Nadia Bianchi-Berthouze. 2016. Go-with-the-Flow: Tracking, Analysis and Sonification of Movement and Breathing to Build Confidence in Activity Despite Chronic Pain. Human-Computer Interaction 31, 3-4 (Jul 2016), 335--383. https://doi.org/10.1080/07370024.2015.1085310
[60]
Judith H. Wakim, Stephanie Smith, and Cherry Guinn. 2010. The Efficacy of Music Therapy. Journal of PeriAnesthesia Nursing 25, 4 (Aug 2010), 226--232. https://doi.org/10.1016/j.jopan.2010.05.009
[61]
Marcus Watson and Penelope Sanderson. 2004. Sonification Supports Eyes-Free Respiratory Monitoring and Task Time-Sharing. Human Factors (2004).
[62]
Johann Weber, Mojdeh Azad, William Riggs, and Christopher R. Cherry. 2018. The convergence of smartphone apps, gamification and competition to increase cycling | Elsevier Enhanced Reader. Transportation Research (2018), 11. https://doi.org/10.1016/j.trf.2018.04.025

Cited By

View all
  • (2024)Creating Emotion-Evoking Music to Communicate Wellness for Users with Diverse Musical BackgroundsCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678495(418-424)Online publication date: 5-Oct-2024

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 8, Issue 2
May 2024
1330 pages
EISSN:2474-9567
DOI:10.1145/3665317
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 May 2024
Published in IMWUT Volume 8, Issue 2

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Ambient Display
  2. Health & Wellness
  3. Music
  4. Physical Activity
  5. Sonification

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)250
  • Downloads (Last 6 weeks)97
Reflects downloads up to 16 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Creating Emotion-Evoking Music to Communicate Wellness for Users with Diverse Musical BackgroundsCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678495(418-424)Online publication date: 5-Oct-2024

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media