Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3410531.3414312acmconferencesArticle/Chapter ViewAbstractPublication PagesubicompConference Proceedingsconference-collections
short-paper

Towards deep clustering of human activities from wearables

Published: 04 September 2020 Publication History

Abstract

Our ability to exploit low-cost wearable sensing modalities for critical human behaviour and activity monitoring applications in health and wellness is reliant on supervised learning regimes; here, deep learning paradigms have proven extremely successful in learning activity representations from annotated data. However, the costly work of gathering and annotating sensory activity datasets is labor intensive, time consuming and not scalable to large volumes of data. While existing unsupervised remedies of deep clustering leverage network architectures and optimization objectives that are tailored for static image datasets, deep architectures to uncover cluster structures from raw sequence data captured by on-body sensors remains largely unexplored. In this paper, we develop an unsupervised end-to-end learning strategy for the fundamental problem of human activity recognition (HAR) from wearables. Through extensive experiments, including comparisons with existing methods, we show the effectiveness of our approach to jointly learn unsupervised representations for sensory data and generate cluster assignments with strong semantic correspondence to distinct human activities.

References

[1]
Alireza Abedin, Mahsa Ehsanpour, Qinfeng Shi, Hamid Rezatofighi, and Damith C Ranasinghe. 2020. Attend And Discriminate: Beyond the State-of-the-Art for Human Activity Recognition using Wearable Sensors. arXiv preprint arXiv:2007.07172 (2020).
[2]
Alireza Abedin, S. Hamid Rezatofighi, Qinfeng Shi, and Damith C. Ranasinghe. 2019. SparseSense: Human Activity Recognition from Highly Sparse Sensor Data-streams Using Set-based Neural Networks. In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI-19. 5780--5786.
[3]
Mohammad Abu Alsheikh, Ahmed Selim, Dusit Niyato, Linda Doyle, Shaowei Lin, and Hwee-Pink Tan. 2016. Deep activity recognition models with triaxial accelerometers. In Workshops at the 30th AAAI Conference on Artificial Intelligence.
[4]
Davide Anguita, Alessandro Ghio, Luca Oneto, Xavier Parra, and Jorge Luis Reyes-Ortiz. 2013. A public domain dataset for human activity recognition using smartphones. In Esann.
[5]
David Arthur and Sergei Vassilvitskii. 2007. K-means++: The Advantages of Careful Seeding. In the 18th Annual ACM-SIAM Symposium on Discrete Algorithms. 1027--1035.
[6]
Lu Bai, Chris Yeung, Christos Efstratiou, and Moyra Chikomo. 2019. Motion2Vector: Unsupervised Learning in Human Activity Recognition Using WristSensing Data. In Proceedings of the ACM International Symposium on Wearable Computers. 537--542.
[7]
Oresti Banos, Rafael Garcia, Juan A Holgado-Terriza, Miguel Damas, Hector Pomares, Ignacio Rojas, Alejandro Saez, and Claudia Villalonga. 2014. mHealth-Droid: a novel framework for agile development of mobile health applications. In International workshop on ambient assisted living. 91--98.
[8]
Sourav Bhattacharya and Nicholas D Lane. 2016. Sparsification and separation of deep learning layers for constrained resource inference on wearables. In Proceedings of the 14th ACM Conference on Embedded Network Sensor Systems CD-ROM. 176--189.
[9]
Dongdong Chen, Jiancheng Lv, and Yi Zhang. 2017. Unsupervised multi-manifold clustering by learning deep representation. In Workshops at the 31st AAAI Conference on Artificial Intelligence.
[10]
Michael Chesser, Asangi Jayatilaka, Renuka Visvanathan, Christophe Fumeaux, Alanson Sample, and Damith C. Ranasinghe. 2019. Super Low Resolution RF Powered Accelerometers for Alerting on Hospitalized Patient Bed Exits. In IEEE International Conference on Pervasive Computing and Communications (PerCom). 1--10.
[11]
Jordana Dahmen, Alyssa La Fleur, Gina Sprint, Diane Cook, and Douglas L Weeks. 2017. Using wrist-worn sensors to measure and compare physical activity changes for patients undergoing rehabilitation. In 2017 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops). 667--672.
[12]
Jordan Frank, Shie Mannor, and Doina Precup. 2010. Activity and gait recognition with time-delay embeddings. In AAAI Conference on Artificial Intelligence.
[13]
N. Gao, W. Shao, and F. D. Salim. 2019. Predicting Personality Traits From Physical Activity Intensity. Computer 52, 7 (2019), 47--56.
[14]
Kamran Ghasedi Dizaji, Amirhossein Herandi, Cheng Deng, Weidong Cai, and Heng Huang. 2017. Deep Clustering via Joint Convolutional Autoencoder Embedding and Relative Entropy Minimization. In The IEEE International Conference on Computer Vision.
[15]
Yu Guan and Thomas Plötz. 2017. Ensembles of deep lstm learners for activity recognition using wearables. ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 2 (2017), 11.
[16]
Xifeng Guo, Long Gao, Xinwang Liu, and Jianping Yin. 2017. Improved deep embedded clustering with local structure preservation. In the 26th International Joint Conference on Artificial Intelligence. 1753--1759.
[17]
Nils Yannick Hammerla, James Fisher, Peter Andras, Lynn Rochester, Richard Walker, and Thomas Plötz. 2015. PD disease state assessment in naturalistic environments using deep learning. In AAAI conference on artificial intelligence.
[18]
Nils Y. Hammerla, Shane Halloran, and Thomas Plötz. 2016. Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables. In the 25th International Joint Conference on Artificial Intelligence. 1533--1540.
[19]
Harish Haresamudram, David Anderson, and Thomas Plötz. 2019. On the Role of Features in Human Activity Recognition. In Proceedings of International Symposium on Wearable Computers. 78--88.
[20]
HM Sajjad Hossain, MD Abdullah Al Haiz Khan, and Nirmalya Roy. 2018. DeActive: scaling activity recognition with active deep learning. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 2 (2018), 1--23.
[21]
Anil K Jain, M Narasimha Murty, and Patrick J Flynn. 1999. Data clustering: a review. ACM computing surveys 31, 3 (1999), 264--323.
[22]
Zhuxi Jiang, Yin Zheng, Huachun Tan, Bangsheng Tang, and Hanning Zhou. 2017. Variational Deep Embedding: An Unsupervised and Generative Approach to Clustering. In Proceedings of the 26th International Joint Conference on Artificial Intelligence. 1965--1972.
[23]
Md Abdullah Al Hafiz Khan, Nirmalya Roy, and Archan Misra. 2018. Scaling human activity recognition via deep learning-based domain adaptation. In 2018 IEEE International Conference on Pervasive Computing and Communications (PerCom). 1--9.
[24]
Matthias Kranz, Andreas MöLler, Nils Hammerla, Stefan Diewald, Thomas PlöTz, Patrick Olivier, and Luis Roalter. 2013. The mobile fitness coach: Towards individualized skill assessment using personalized mobile devices. Pervasive and Mobile Computing 9, 2 (2013), 203--215.
[25]
Fengfu Li, Hong Qiao, and Bo Zhang. 2018. Discriminatively boosted image clustering with fully convolutional auto-encoders. Pattern Recognition 83 (2018), 161--173.
[26]
Laurens van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of machine learning research 9 (2008), 2579--2605.
[27]
Andrea Mannini, Mary Rosenberger, William L Haskell, Angelo M Sabatini, and Stephen S Intille. 2017. Activity recognition in youth using single accelerometer placed at wrist or ankle. Medicine and science in sports and exercise 49, 4 (2017), 801.
[28]
E. Min, X. Guo, Q. Liu, G. Zhang, J. Cui, and J. Long. 2018. A Survey of Clustering With Deep Learning: From the Perspective of Network Architecture. IEEE Access 6 (2018), 39501--39514.
[29]
Vishvak S. Murahari and Thomas Plötz. 2018. On Attention Models for Human Activity Recognition. In ACM International Symposium on Wearable Computers. 100--103.
[30]
Dzung Tri Nguyen, Eli Cohen, Mohammad Pourhomayoun, and Nabil Alshurafa. 2017. SwallowNet: Recurrent neural network detects and characterizes eating patterns. In 2017 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops). IEEE, 401--406.
[31]
Francisco Ordóñez and Daniel Roggen. 2016. Deep convolutional and lstm recurrent neural networks for multimodal wearable activity recognition. Sensors 16, 1 (2016), 115.
[32]
Thomas Plötz, Nils Y Hammerla, Agata Rozga, Andrea Reavis, Nathan Call, and Gregory D Abowd. 2012. Automatic assessment of problem behavior in individuals with developmental disabilities. In Proceedings of the 2012 ACM conference on ubiquitous computing. 391--400.
[33]
Charissa Ann Ronao and Sung-Bae Cho. 2015. Deep convolutional neural networks for human activity recognition with smartphone sensors. In International Conference on Neural Information Processing. 46--53.
[34]
Nitish Srivastava, Elman Mansimov, and Ruslan Salakhudinov. 2015. Unsupervised learning of video representations using lstms. In International conference on machine learning. 843--852.
[35]
Thomas Stiefmeier, Daniel Roggen, Georg Ogris, Paul Lukowicz, and Gerhard Tröster. 2008. Wearable activity tracking in car manufacturing. IEEE Pervasive Computing 2 (2008), 42--50.
[36]
Alireza Abedin Varamin, Ehsan Abbasnejad, Qinfeng Shi, Damith C Ranasinghe, and Hamid Rezatofighi. 2018. Deep Auto-Set: A Deep Auto-Encoder-Set Network for Activity Recognition Using Wearables. In the 15th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services. 246--253.
[37]
Junyuan Xie, Ross Girshick, and Ali Farhadi. 2016. Unsupervised deep embedding for clustering analysis. In International conference on machine learning. 478--487.
[38]
Jianwei Yang, Devi Parikh, and Dhruv Batra. 2016. Joint unsupervised learning of deep representations and image clusters. In the IEEE Conference on Computer Vision and Pattern Recognition. 5147--5156.
[39]
Jian Bo Yang, Minh Nhut Nguyen, Phyo Phyo San, Xiao Li Li, and Shonali Krishnaswamy. 2015. Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition. In Proceedings of the 24th International Conference on Artificial Intelligence (Buenos Aires, Argentina). 3995--4001. http://dl.acm.org/citation.cfm?id=2832747.2832806
[40]
Rui Yao, Guosheng Lin, Qinfeng Shi, and Damith C. Ranasinghe. 2018. Efficient dense labelling of human activity sequences from wearables using fully convolutional networks. Pattern Recognition 78 (2018), 252 -- 266.
[41]
Ming Zeng, Le T Nguyen, Bo Yu, Ole J Mengshoel, Jiang Zhu, Pang Wu, and Joy Zhang. 2014. Convolutional neural networks for human activity recognition using mobile sensors. In 6th International Conference on Mobile Computing, Applications and Services. 197--205.

Cited By

View all
  • (2024)Advancements in HealthcareDeep Learning Approaches for Early Diagnosis of Neurodegenerative Diseases10.4018/979-8-3693-1281-0.ch010(201-233)Online publication date: 8-Mar-2024
  • (2024)Weak-Annotation of HAR Datasets using Vision Foundation ModelsProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676613(55-62)Online publication date: 5-Oct-2024
  • (2024)1DCAE-TSSAMC: Two-Stage Multi-Dimensional Spatial Features Based Multi-View Deep Clustering for Time Series DataInternational Journal of Uncertainty, Fuzziness and Knowledge-Based Systems10.1142/S021848852440010532:04(593-623)Online publication date: 25-Jun-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
ISWC '20: Proceedings of the 2020 ACM International Symposium on Wearable Computers
September 2020
107 pages
ISBN:9781450380775
DOI:10.1145/3410531
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 September 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. activity recognition
  2. clustering
  3. deep learning
  4. wearable sensors

Qualifiers

  • Short-paper

Conference

UbiComp/ISWC '20

Acceptance Rates

Overall Acceptance Rate 38 of 196 submissions, 19%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)60
  • Downloads (Last 6 weeks)3
Reflects downloads up to 24 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Advancements in HealthcareDeep Learning Approaches for Early Diagnosis of Neurodegenerative Diseases10.4018/979-8-3693-1281-0.ch010(201-233)Online publication date: 8-Mar-2024
  • (2024)Weak-Annotation of HAR Datasets using Vision Foundation ModelsProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676613(55-62)Online publication date: 5-Oct-2024
  • (2024)1DCAE-TSSAMC: Two-Stage Multi-Dimensional Spatial Features Based Multi-View Deep Clustering for Time Series DataInternational Journal of Uncertainty, Fuzziness and Knowledge-Based Systems10.1142/S021848852440010532:04(593-623)Online publication date: 25-Jun-2024
  • (2024)SelfAct: Personalized Activity Recognition Based on Self-Supervised and Active LearningMobile and Ubiquitous Systems: Computing, Networking and Services10.1007/978-3-031-63989-0_19(375-391)Online publication date: 19-Jul-2024
  • (2023)More Reliable Neighborhood Contrastive Learning for Novel Class Discovery in Sensor-Based Human Activity RecognitionSensors10.3390/s2323952923:23(9529)Online publication date: 30-Nov-2023
  • (2023)Visualizing Wearable Medical Device Research Trends: A Co-occurrence Network-Based Bibliometric AnalysisGalician Medical Journal10.21802/gmj.2023.3.230:3(E202332)Online publication date: 1-Sep-2023
  • (2023)Multimodal Assessment of Interest Levels in Reading: Integrating Eye-Tracking and Physiological SensingIEEE Access10.1109/ACCESS.2023.331126811(93994-94008)Online publication date: 2023
  • (2022)Machine Learning for Healthcare Wearable Devices: The Big PictureJournal of Healthcare Engineering10.1155/2022/46539232022(1-25)Online publication date: 18-Apr-2022
  • (2022)Clustering of Human Activities from Wearables by Adopting Nearest NeighborsProceedings of the 2022 ACM International Symposium on Wearable Computers10.1145/3544794.3558477(1-5)Online publication date: 11-Sep-2022
  • (2022)A Deep Clustering via Automatic Feature Embedded Learning for Human Activity RecognitionIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2021.305746932:1(210-223)Online publication date: 1-Jan-2022
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media