research-article

GymSoles++: Combining Google Glass with Smart Insoles to Improve Body Posture when Performing Squats

Authors:

Don Samitha Elvitigala,

Denys J.C. Matthies,

Chamod Weerasinghe,

Suranga NanayakkaraAuthors Info & Claims

PETRA '21: Proceedings of the 14th PErvasive Technologies Related to Assistive Environments Conference

Pages 48 - 54

https://doi.org/10.1145/3453892.3453898

Published: 29 June 2021 Publication History

Editorial Notes

Production issues prevented this paper's layout from appearing correctly. To address this problem in accordance with ACM policies, a Corrected Version of Record (CVoR) was published on January 25, 2022. Only the layout was amended; content is unaltered. For reference purposes, the VoR may still be accessed via the Supplemental Material section on this citation page.

Abstract

In pandemic times, public facilities, such as gymnasiums and other sports facilities are closed. Hence, keeping oneself physically fit becomes particularly difficult as well as getting help from a fitness trainer or instructor is almost impossible. We propose an alternative solution, GymSoles++, a virtual trainer supporting the user with their exercise. This allows users to maintain the correct body posture to avoid injuries when performing exercises such as squats. We combine Google Glass with an unobtrusive sensing approach, an insole-based wearable system that provides feedback on the user’s centre of pressure (CoP) via vibrotactile and visual aids. Previous research has shown that solely visualizing the CoP can significantly improve body posture and thus effectively assist users when performing squats and dead-lifts. In this research, we explored different feedback modalities and conclude that a vibrotactile insole is a practical and effective solution.

Supplementary Material

3453898-vor (3453898-vor.pdf)

Version of Record for "GymSoles++: Combining Google Glass with Smart Insoles to Improve Body Posture when Performing Squats" by Elvitigala et al., The 14th PErvasive Technologies Related to Assistive Environments Conference (PETRA '21).

Download
4.87 MB

References

[1]

K. Alger. 2018. Nike+ Run Club: How to use Nike’s app to become a better runner. Retrieved 25/12/2019 from: https://www.wareable.com/running/nike-plus-run-club-guide-how-to-use-running-430.

[2]

Swamy Ananthanarayan, Miranda Sheh, Alice Chien, Halley Profita, and Katie Siek. 2013. Pt Viz: Towards a Wearable Device for Visualizing Knee Rehabilitation Exercises. In CHI ’13(Paris, France). ACM, New York, NY, USA, 1247–1250. https://doi.org/10.1145/2470654.2466161

Digital Library

[3]

PJ Aranzulla, DS Muckle, and JL Cunningham. 1998. A portable monitoring system for measuring weight-bearing during tibial fracture healing. Medical engineering & physics 20, 7 (1998), 543–548.

[4]

Richard Baker. 2006. Gait analysis methods in rehabilitation. Journal of neuroengineering and rehabilitation 3, 1(2006), 4.

[5]

Aaron Bangor, Philip Kortum, and James Miller. 2009. Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of usability studies 4, 3 (2009), 114–123.

Digital Library

[6]

[6] Biomechanics and Force Plate.2018. Retrieved August 28, 2018 from https://www.kistler.com/en/applications/sensor-technology/biomechanics-and-force-plate/.

[7]

[7] Biomechanics and Sports.2018. Retrieved August 28, 2018 from https://www.vicon.com/motion-capture/biomechanics-and-spor.

[8]

John Brooke 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4–7.

[9]

A. Chatzitofis, D. Zarpalas, and P. Daras. 2018. A computerized system for real-time exercise performance monitoring and e-coaching using motion capture data. In Precision Medicine Powered by pHealth and Connected Health. Springer, 243–247.

[10]

R. Chee. 2018. The Essential 8: Exercises That Will Get You Ripped. Retrieved 25/12/2019 from: https://www.bodybuilding.com/content/essential-8-exercises-to-get-ripped.html.

[11]

Ross A Clark, Adam L Bryant, Yonghao Pua, Paul McCrory, Kim Bennell, and Michael Hunt. 2010. Validity and reliability of the Nintendo Wii Balance Board for assessment of standing balance. Gait & posture 31, 3 (2010), 307–310.

[12]

Caleb Conner and Gene Michael Poor. 2016. Correcting exercise form using body tracking. In CHI ’16 Extended Abstracts. ACM, 3028–3034.

[13]

Glen Cooper, Ian Sheret, Louise McMillian, Konstantinos Siliverdis, Ning Sha, Diana Hodgins, Laurence Kenney, and David Howard. 2009. Inertial sensor-based knee flexion/extension angle estimation. Journal of biomechanics 42, 16 (2009), 2678–2685.

[14]

[14] Hawkin Dyanmics.2018. Retrieved August 28, 2018 from https://www.hawkindynamics.com/.

[15]

DS Elvitigala, DJC Matthies, L David, C Weerasinghe, and S Nanayakkara. 2019. GymSoles: Improving Squats and Dead-Lifts by Visualizing the User’s Center of Pressure. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–12.

Digital Library

[16]

Bjoern M Eskofier, Sunghoon Ivan Lee, Manuela Baron, André Simon, Christine F Martindale, Heiko Gaßner, and Jochen Klucken. 2017. An overview of smart shoes in the internet of health things: gait and mobility assessment in health promotion and disease monitoring. Applied Sciences 7, 10 (2017), 986.

[17]

[17] Coach’s Eyes.[n.d.]. Retrieved August 28, 2018 from https://www.coachseye.com/.

[18]

Daniel Tik-Pui Fong and Yue-Yan Chan. 2010. The Use of Wearable Inertial Motion Sensors in Human Lower Limb Biomechanics Studies: A Systematic Review. Sensors 10, 12 (2010), 11556–11565. https://doi.org/10.3390/s101211556

[19]

Marina Garriga, Isabel Agasi, Ester Fedida, Justo Pinzón-Espinosa, Mireia Vazquez, Isabella Pacchiarotti, and Eduard Vieta. 2020. The role of mental health home hospitalization care during the COVID-19 Pandemic. Acta Psychiatrica Scandinavica(2020).

[20]

Asimenia Gioftsidou, Paraskevi Malliou, G Pafis, Anastasia Beneka, George Godolias, and Constantinos N Maganaris. 2006. The effects of soccer training and timing of balance training on balance ability. European journal of applied physiology 96, 6 (2006), 659–664.

[21]

Michael Greenstone and Vishan Nigam. 2020. Does social distancing matter?University of Chicago, Becker Friedman Institute for Economics Working Paper2020-26(2020).

[22]

Burke Gurney. 2002. Leg length discrepancy. Gait & posture 15, 2 (2002), 195–206.

[23]

Marian Haescher, John Trimpop, Denys JC Matthies, Gerald Bieber, Bodo Urban, and Thomas Kirste. 2015. aHead: considering the head position in a multi-sensory setup of wearables to recognize everyday activities with intelligent sensor fusions. In International Conference on Human-Computer Interaction. Springer, 741–752.

[24]

Marc Ashley Harris. 2018. The relationship between physical inactivity and mental wellbeing: Findings from a gamification-based community-wide physical activity intervention. Health psychology open 5, 1 (2018), 2055102917753853.

[25]

MJ Hessert, M Vyas, J Leach, K Hu, LA Lipsitz, and V Novak. 2005. Foot pressure distribution during walking in young and old adults. BMC geriatrics 5, 1 (2005), 8.

[26]

Oberlander K. 2015. Inertial Measurement Unit (IMU) Technology. Inverse Kinematics: Joint Considerations and the Maths for Deriving Anatomical Angles (2015).

[27]

M Kljajic and Janez Krajnik. 1987. The use of ground reaction measuring shoes in gait evaluation. Clinical Physics and Physiological Measurement 8, 2(1987), 133.

[28]

David A Krause, Michael S Boyd, Allison N Hager, Eric C Smoyer, Anthony T Thompson, and John H Hollman. 2015. Reliability and accuracy of a goniometer mobile device application for video measurement of the functional movement screen deep squat test. International journal of sports physical therapy 10, 1 (2015), 37.

[29]

P. Lamkin. 2015. Adidas miCoach Fit Smart review. Retrieved 25/12/2019 from: https://www.wareable.com/fitness-trackers/adidas-micoach-fit-smart-review.

[30]

S. Majumder, T. Mondal, and M. Deen. 2017. Wearable sensors for remote health monitoring. Sensors 17, 1 (2017), 130.

[31]

[31] Sensing Mat.[n.d.]. Retrieved August 28, 2018 from http://www.sensingtex.com/.

[32]

Denys JC Matthies, Marian Haescher, Rebekka Alm, and Bodo Urban. 2015. Properties of a peripheral head-mounted display (phmd). In International Conference on Human-Computer Interaction. Springer, 208–213.

[33]

D. J.C. Matthies, T. Roumam, Arjan Kuijper, and Bodo Urban. 2017. CapSoles: who is walking on what kind of floor?. In Proceedings of the MobileHCI ’17. ACM.

Digital Library

[34]

Alessandro Mengarelli, Federica Verdini, Stefano Cardarelli, Francesco Di Nardo, Laura Burattini, and Sandro Fioretti. 2018. Balance assessment during squatting exercise: A comparison between laboratory grade force plate and a commercial, low-cost device. Journal of biomechanics 71 (2018), 264–270.

[35]

Dan Morris, T Scott Saponas, Andrew Guillory, and Ilya Kelner. 2014. RecoFit: using a wearable sensor to find, recognize, and count repetitive exercises. In CHI ’14. ACM, 3225–3234.

[36]

Hawkar Oagaz, Anurag Sable, Min-Hyung Choi, Wenyao Xu, and Feng Lin. 2018. VRInsole: An unobtrusive and immersive mobility training system for stroke rehabilitation. In International Conference on Wearable and Implantable Body Sensor Networks. IEEE, 5–8.

[37]

Kim Oakes, Katie A Siek, and Haley MacLeod. 2015. MuscleMemory: identifying the scope of wearable technology in high intensity exercise communities. In Conf PervasiveHealth, 2015. IEEE, 193–200.

Digital Library

[38]

Ayumi Ohnishi, Tsutomu Terada, and Masahiko Tsukamoto. 2018. A Motion Recognition Method Using Foot Pressure Sensors. In Proceedings of the 9th Augmented Human International Conference. ACM, 10.

Digital Library

[39]

[39] Biomechanics Overview.[n.d.]. Retrieved August 28, 2018 from http://www.amti.biz/fps-overview.aspx.

[40]

Joseph Paradiso, Eric Hu, and K Yuh Hsiao. 1998. Instrumented footwear for interactive dance. In Proc. of the XII Colloquium on Musical Informatics. 24–26.

[41]

A Paraschiv-Ionescu, S Mellone, M Colpo, A Bourke, EAF Ihlen, C Moufawad el Achkar, L Chiari, C Becker, and K Aminian. 2016. Patterns of Human Activity Behavior: From Data to Information and Clinical Knowledge. In UbiComp ’16 Adjunct (Heidelberg, Germany). ACM, New York, NY, USA, 841–845. https://doi.org/10.1145/2968219.2968283

Digital Library

[42]

Luca Prosperini, Deborah Fortuna, Costanza Giannì, Laura Leonardi, Maria Rita Marchetti, and Carlo Pozzilli. 2013. Home-based balance training using the Wii balance board: a randomized, crossover pilot study in multiple sclerosis. Neurorehabilitation and neural repair 27, 6 (2013), 516–525.

[43]

Tom Rath, James K Harter, and Jim Harter. 2010. Wellbeing: The five essential elements. Simon and Schuster.

[44]

Anne Schmitz, Mao Ye, Grant Boggess, Robert Shapiro, Ruigang Yang, and Brian Noehren. 2015. The measurement of in vivo joint angles during a squat using a single camera markerless motion capture system as compared to a marker based system. Gait & posture 41, 2 (2015), 694–698.

[45]

Thomas Seel, Jörg Raisch, and Thomas Schauer. 2014. IMU-based joint angle measurement for gait analysis. Sensors 14, 4 (2014), 6891–6909.

[46]

Goran Šeketa, Dominik Džaja, Sara Žulj, Luka Celić, Igor Lacković, and Ratko Magjarević. 2015. Real-Time Evaluation of Repetitive Physical Exercise Using Orientation Estimation from Inertial and Magnetic Sensors. In First European Biomedical Engineering Conference for Young Investigators. Springer, 11–15.

[47]

Priya Kamlesh Sridhar, Benjamin Petry, Pavithren VS Pakianathan, Ardy Samsir Kartolo, and Suranga Nanayakkara. 2016. Towards one-pixel-displays for sound information visualization. In Proceedings of the 28th Australian Conference on Computer-Human Interaction. 91–95.

Digital Library

[48]

D Whelan, M O’Reilly, B Huang, O Giggins, T Kechadi, and B Caulfield. 2016. Leveraging IMU data for accurate exercise performance classification and musculoskeletal injury risk screening. In Engineering in Medicine and Biology Society (EMBC), 2016 IEEE 38th Annual International Conference of the. IEEE, 659–662.

[49]

R. Wood. 2008. The 7 Best Exercises for a Full-Body Workout. Active. Retrieved 25/12/2019 from: https://www.active.com/fitness/articles/the-7-best-exercises-for-a-full-body-workout/slide-8.

[50]

M Zecca, K Saito, S Sessa, L Bartolomeo, Z Lin, S Cosentino, H Ishii, T Ikai, and A Takanishi. 2013. Use of an ultra-miniaturized IMU-based motion capture system for objective evaluation and assessment of walking skills. In Engineering in Medicine and Biology Society (EMBC), 2013 35th Annual International Conference of the IEEE. IEEE, 4883–4886.

Cited By

Das DChaturvedi MArora MDikshit SPadole V(2024)A Reliability Study of the Load Distribution Percentage While Walking Using Curalgia Feet Sx Smart InsolesCureus10.7759/cureus.68232Online publication date: 30-Aug-2024
https://doi.org/10.7759/cureus.68232
Ono SNinomiya NKanai H(2024)Haptic Feedback to Reduce Individual Differences in Corrective Actions for Skill LearningCompanion Proceedings of the 26th International Conference on Multimodal Interaction10.1145/3686215.3690158(16-20)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3686215.3690158
van Rheden VMontoya MElvitigala DMeschtscherjakov AMueller FKostakos VKay JHoang T(2024)Multimodal Sports Interaction: Wearables and HCI in MotionCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3677560(952-955)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3677560
Show More Cited By

Recommendations

GymSoles: Improving Squats and Dead-Lifts by Visualizing the User's Center of Pressure
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

The correct execution of exercises, such as squats and dead-lifts, is essential to prevent various bodily injuries. Existing solutions either rely on expensive motion tracking or multiple Inertial Measurement Units (IMU) systems require an extensive set-...
GymSoles++: Using Smart Wearbales to Improve Body Posture when Performing Squats and Dead-Lifts
AHs '20: Proceedings of the Augmented Humans International Conference

Squats and dead-lifts are considered two important full-body exercises for beginners, which can be performed at home or the gymnasium. During the execution of these exercises, it is essential to maintain the correct body posture to avoid injuries. In ...
Where center of pressure should be controlled in biped upright posture

The stability of the upright posture of the biped system on horizontal ground has been evaluated in terms of the vertical projection of the center of gravity on the ground. Since the point of projection coincides with the center of pressure of the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

PETRA '21: Proceedings of the 14th PErvasive Technologies Related to Assistive Environments Conference

June 2021

593 pages

ISBN:9781450387927

DOI:10.1145/3453892

Conference Chair:
Fillia Makedon

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 June 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

New Zealand Government

Conference

PETRA '21

PETRA '21: The 14th PErvasive Technologies Related to Assistive Environments Conference

June 29 - July 2, 2021

Corfu, Greece

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
269
Total Downloads

Downloads (Last 12 months)84
Downloads (Last 6 weeks)12

Reflects downloads up to 02 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Das DChaturvedi MArora MDikshit SPadole V(2024)A Reliability Study of the Load Distribution Percentage While Walking Using Curalgia Feet Sx Smart InsolesCureus10.7759/cureus.68232Online publication date: 30-Aug-2024
https://doi.org/10.7759/cureus.68232
Ono SNinomiya NKanai H(2024)Haptic Feedback to Reduce Individual Differences in Corrective Actions for Skill LearningCompanion Proceedings of the 26th International Conference on Multimodal Interaction10.1145/3686215.3690158(16-20)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3686215.3690158
van Rheden VMontoya MElvitigala DMeschtscherjakov AMueller FKostakos VKay JHoang T(2024)Multimodal Sports Interaction: Wearables and HCI in MotionCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3677560(952-955)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3677560
Spahiu TAlmeida HKyratsis PJimeno-Morenilla ABogdan S(2023)Smart Shoes – Current Developments and the Future TrendsProgress in Digital and Physical Manufacturing10.1007/978-3-031-33890-8_32(346-355)Online publication date: 15-Jun-2023
https://doi.org/10.1007/978-3-031-33890-8_32

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten