research-article

Let the objects tell what you are doing

Authors:

Gabriele Civitarese,

Stefano Belfiore,

Claudio BettiniAuthors Info & Claims

UbiComp '16: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct

Pages 773 - 782

https://doi.org/10.1145/2968219.2968285

Published: 12 September 2016 Publication History

Get Access

Abstract

Recognition of activities of daily living (ADLs) performed in smart homes proved to be very effective when the interaction of the inhabitant with household items is considered. Analyzing how objects are manipulated can be particularly useful, in combination with other sensor data, to detect anomalies in performing ADLs, and hence to support early diagnosis of cognitive impairments for elderly people. Recent improvements in sensing technologies can overcome several limitations of the existing techniques to detect object manipulations, often based on RFID, wearable sensors and/or computer vision methods. In this work we propose an unobtrusive solution which shifts all the monitoring burden at the objects side. In particular, we investigate the effectiveness of using tiny BLE beacons equipped with accelerometer and temperature sensors attached to everyday objects. We adopt statistical methods to analyze in realtime the accelerometer data coming from the objects, with the purpose of detecting specific manipulations performed by seniors in their homes. We describe our technique and we present the preliminary results obtained by evaluating the method on a real dataset. The results indicate the potential utility of the method in enriching ADLs and abnormal behaviors recognition systems, by providing detailed information about object manipulations.

References

[1]

Oliver Amft and Gerhard Tröster. 2008. Recognition of dietary activity events using on-body sensors. Artificial intelligence in medicine 42, 2 (mar 2008), 121--36.

Digital Library

Google Scholar

[2]

Michael Beigl, Hans-w Gellersen, and Albrecht Schmidt. 2001. MediaCups : Experience with Design and Use of Computer- Augmented Everyday Artefacts. Computer Networks (2001).

Digital Library

Google Scholar

[3]

Leo Breiman. 2001. Random Forests. Machine Learning (2001), 5--32.

Digital Library

Google Scholar

[4]

Liming Chen, Chris D. Nugent, and Hui Wang. 2012. A Knowledge-Driven Approach to Activity Recognition in Smart Homes. IEEE Trans. Knowl. Data Eng. (2012).

Digital Library

Google Scholar

[5]

James Clawson, Jessica A. Pater, Andrew D. Miller, Elizabeth D. Mynatt, and Lena Mamykina. 2015. No Longer Wearing: Investigating the Abandonment of Personal Health-tracking Technologies on Craigslist. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '15).

Digital Library

Google Scholar

[6]

Barnan Das, Diane Cook, Narayanan Krishnan, and Maureen Schmitter-Edgecombe. 2016. One-Class Classification-Based Real-Time Activity Error Detection in Smart Homes. IEEE Journal of Selected Topics in Signal Processing (2016).

Crossref

Google Scholar

[7]

Ifat Afrin Emi and John A Stankovic. 2015. SARRIMA : Smart ADL Recognizer and Resident Identifier in Multi-resident Accommodations. In Wireless Health '15.

Digital Library

Google Scholar

[8]

Yoav Freund and Robert E Schapire. 1997. A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting. J. Comput. System Sci. 55, 1 (1997), 119 -- 139.

Digital Library

Google Scholar

[9]

Enamul Hoque, Robert F. Dickerson, Sarah M. Preum, Mark Hanson, Adam Barth, and John A. Stankovic. Holmes: A Comprehensive Anomaly Detection System for Daily In-home Activities. In 2015 International Conference on Distributed Computing in Sensor Systems. IEEE, 40--51.

Digital Library

Google Scholar

[10]

Aftab Khan, Sebastian Mellor, Eugen Berlin, Robin Thompson, Roisin McNaney, Patrick Olivier, and Thomas Plötz. 2015. Beyond Activity Recognition: Skill Assessment from Accelerometer Data. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '15). ACM.

Digital Library

Google Scholar

[11]

Donald J. Patterson, Dieter Fox, Henry Kautz, and Matthai Philipose. 2005. Fine-Grained Activity Recognition by Aggregating Abstract Object Usage. In ISWC '05: Proceedings of the Ninth IEEE International Symposium on Wearable Computers. IEEE Computer Society.

Digital Library

Google Scholar

[12]

Daniele Riboni, Claudio Bettini, Gabriele Civitarese, Zaffar Haider Janjua, and Rim Helaoui. 2016. SmartFABER: Recognizing fine-grained abnormal behaviors for early detection of mild cognitive impairment. Artificial Intelligence in Medicine (2016).

Digital Library

Google Scholar

[13]

Jianxin Wu, Adebola Osuntogun, Tanzeem Choudhury, Matthai Philipose, and James M. Rehg. 2007. A Scalable Approach to Activity Recognition based on Object Use. In Proc. IEEE International Conference on Computer Vision (ICCV 07). IEEE Press, 1--8.

Google Scholar

Cited By

View all

He WZhao VMorkved OSiddiqui SFernandes EHester JUr B(2021)SoK: Context Sensing for Access Control in the Adversarial Home IoT2021 IEEE European Symposium on Security and Privacy (EuroS&P)10.1109/EuroSP51992.2021.00014(37-53)Online publication date: Sep-2021
https://doi.org/10.1109/EuroSP51992.2021.00014
O’Sullivan DBasaru RStumpf SMaiden N(2021)Monitoring Quality of Life Indicators at Home from Sparse, and Low-Cost Sensor DataArtificial Intelligence in Medicine10.1007/978-3-030-77211-6_17(157-162)Online publication date: 8-Jun-2021
https://doi.org/10.1007/978-3-030-77211-6_17
Li ZZhang JLi MHuang JWang X(2020)A Review of Smart Design Based on Interactive Experience in Building SystemsSustainability10.3390/su1217676012:17(6760)Online publication date: 20-Aug-2020
https://doi.org/10.3390/su12176760
Show More Cited By

Let the objects tell what you are doing
1. Computing methodologies

Recommendations

Annotating smart environment sensor data for activity learning
Smart Environments: Technology to Support Healthcare

The pervasive sensing technologies found in smart homes offer unprecedented opportunities for providing health monitoring and assistance to individuals experiencing difficulties living independently at home. In order to monitor the functional health of ...
Recognizing water-based activities in the home through infrastructure-mediated sensing
UbiComp '12: Proceedings of the 2012 ACM Conference on Ubiquitous Computing

Activity recognition in the home has been long recognized as the foundation for many desirable applications in fields such as home automation, sustainability, and healthcare. However, building a practical home activity monitoring system remains a ...
Composite Activity Recognition in Smart Homes Using Markov Logic Network
UIC-ATC-SCALCOM '14: Proceedings of the 2014 IEEE 11th Intl Conf on Ubiquitous Intelligence and Computing and 2014 IEEE 11th Intl Conf on Autonomic and Trusted Computing and 2014 IEEE 14th Intl Conf on Scalable Computing and Communications and Its Associated Workshops (UIC-ATC-ScalCom)

Smart environments have progressed and evolved into a significant research area with development of sensor technology, wireless communication and machine learning strategies. Ambient Intelligence incorporated into smart environment assists in resolving ...

Comments

Information & Contributors

Information

Published In

UbiComp '16: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct

September 2016

1807 pages

ISBN:9781450344623

DOI:10.1145/2968219

General Chairs:
Paul Lukowicz
DFKI and University of Kaiserslautern
,
Antonio Krüger
DFKI and Saarland University
,
Program Chairs:
Andreas Bulling
Max Planck Institute for Informatics
,
Youn-Kyung Lim
KAIST
,
Shwetak N. Patel
University of Washington

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 September 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UbiComp '16

Sponsor:

UbiComp '16: The 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing

September 12 - 16, 2016

Germany, Heidelberg

Acceptance Rates

Overall Acceptance Rate 764 of 2,912 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
501
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)0

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

He WZhao VMorkved OSiddiqui SFernandes EHester JUr B(2021)SoK: Context Sensing for Access Control in the Adversarial Home IoT2021 IEEE European Symposium on Security and Privacy (EuroS&P)10.1109/EuroSP51992.2021.00014(37-53)Online publication date: Sep-2021
https://doi.org/10.1109/EuroSP51992.2021.00014
O’Sullivan DBasaru RStumpf SMaiden N(2021)Monitoring Quality of Life Indicators at Home from Sparse, and Low-Cost Sensor DataArtificial Intelligence in Medicine10.1007/978-3-030-77211-6_17(157-162)Online publication date: 8-Jun-2021
https://doi.org/10.1007/978-3-030-77211-6_17
Li ZZhang JLi MHuang JWang X(2020)A Review of Smart Design Based on Interactive Experience in Building SystemsSustainability10.3390/su1217676012:17(6760)Online publication date: 20-Aug-2020
https://doi.org/10.3390/su12176760
Thakur NHan C(2020)Towards a Language for Defining Human Behavior for Complex ActivitiesHuman Interaction, Emerging Technologies and Future Applications III10.1007/978-3-030-55307-4_47(309-315)Online publication date: 6-Aug-2020
https://doi.org/10.1007/978-3-030-55307-4_47
Thakur NHan C(2020)Towards a Knowledge Base for Activity Recognition of Diverse UsersHuman Interaction, Emerging Technologies and Future Applications III10.1007/978-3-030-55307-4_46(303-308)Online publication date: 6-Aug-2020
https://doi.org/10.1007/978-3-030-55307-4_46
Thakur NHan C(2020)An Intelligent Ubiquitous Activity Aware Framework for Smart HomeHuman Interaction, Emerging Technologies and Future Applications III10.1007/978-3-030-55307-4_45(296-302)Online publication date: 6-Aug-2020
https://doi.org/10.1007/978-3-030-55307-4_45
Thakur NHan C(2020)A Multilayered Contextually Intelligent Activity Recognition Framework for Smart HomeHuman Interaction, Emerging Technologies and Future Applications III10.1007/978-3-030-55307-4_42(278-283)Online publication date: 6-Aug-2020
https://doi.org/10.1007/978-3-030-55307-4_42
Wolf CRingland KHayes G(2019)Home Worlds: Situating Domestic Computing in Everyday Life Through a Study of DIY Home RepairProceedings of the ACM on Human-Computer Interaction10.1145/33592633:CSCW(1-22)Online publication date: 7-Nov-2019
https://dl.acm.org/doi/10.1145/3359263
Cheng YFunk MTsai WChen LHarrison SBardzell SNeustaedter CTatar D(2019)Peekaboo CamProceedings of the 2019 on Designing Interactive Systems Conference10.1145/3322276.3323699(823-836)Online publication date: 18-Jun-2019
https://dl.acm.org/doi/10.1145/3322276.3323699
Tewell JO'sullivan DMaiden NLockerbie JStumpf S(2019)Monitoring meaningful activities using small low-cost devices in a smart homePersonal and Ubiquitous Computing10.1007/s00779-019-01223-223:2(339-357)Online publication date: 1-Apr-2019
https://dl.acm.org/doi/10.1007/s00779-019-01223-2
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

Annotating smart environment sensor data for activity learning

Recognizing water-based activities in the home through infrastructure-mediated sensing

Composite Activity Recognition in Smart Homes Using Markov Logic Network