research-article

Recognizing water-based activities in the home through infrastructure-mediated sensing

Authors:

Vinay Bettadapura,

Grant Schindler,

Gregory D. Abowd,

Irfan EssaAuthors Info & Claims

UbiComp '12: Proceedings of the 2012 ACM Conference on Ubiquitous Computing

Pages 85 - 94

https://doi.org/10.1145/2370216.2370230

Published: 05 September 2012 Publication History

Abstract

Activity recognition in the home has been long recognized as the foundation for many desirable applications in fields such as home automation, sustainability, and healthcare. However, building a practical home activity monitoring system remains a challenge. Striking a balance between cost, privacy, ease of installation and scalability continues to be an elusive goal. In this paper, we explore infrastructure-mediated sensing combined with a vector space model learning approach as the basis of an activity recognition system for the home. We examine the performance of our single-sensor water-based system in recognizing eleven high-level activities in the kitchen and bathroom, such as cooking and shaving. Results from two studies show that our system can estimate activities with overall accuracy of 82.69% for one individual and 70.11% for a group of 23 participants. As far as we know, our work is the first to employ infrastructure-mediated sensing for inferring high-level human activities in a home setting.

References

[1]

L. Atallah and G. Yang. The use of pervasive sensing for behaviour profiling --- a survey. Pervasive and Mobile Computing, (5):447--464, 2009.

Digital Library

[2]

G. Cohn, S. Gupta, J. Froehlich, E. Larson, and S. Patel. GasSense: Appliance-level, single-point sensing of gas activity in the home. Pervasive Computing, pages 265--282, 2010.

Digital Library

[3]

J. Fogarty, C. Au, and S. E. Hudson. Sensing from the basement: a feasibility study of unobtrusive and low-cost home activity recognition. In UIST '06: Proceedings of the 19th annual ACM symposium on User interface software and technology. ACM Request Permissions, Oct. 2006.

Digital Library

[4]

J. Froehlich, E. Larson, T. Campbell, C. Haggerty, J. Fogarty, and S. Patel. HydroSense: infrastructure-mediated single-point sensing of whole-home water activity. Proceedings of the 11th international conference on Ubiquitous computing, pages 235--244, 2009.

Digital Library

[5]

J. Froehlich, E. Larson, E. Saba, T. Campbell, L. Atlas, J. Fogarty, and S. Patel. A Longitudinal Study of Pressure Sensing to Infer Real-World Water Usage Events in the Home. Pervasive Computing, pages 50--69, 2011.

Digital Library

[6]

S. Gupta, M. Reynolds, and S. Patel. ElectriSense: single-point sensing using EMI for electrical event detection and classification in the home. Ubicomp '10: Proceedings of the 12th ACM international conference on Ubiquitous computing, Sept. 2010.

Digital Library

[7]

R. Hamid, S. Maddi, A. Johnson, A. Bobick, I. Essa, and C. Isbell. A novel sequence representation for unsupervised analysis of human activities. Artificial Intell., 173:1221--44, 2009.

Digital Library

[8]

T. Hirsch, J. Forlizzi, E. Hyder, J. Goetz, C. Kurtz, and J. Stroback. The ELDer project: social, emotional, and environmental factors in the design of eldercare technologies. Proceedings on the 2000 conference on Universal Usability, pages 72--79, 2000.

Digital Library

[9]

S. S. Intille, K. Larson, E. M. Mungia-Tapia, J. S. Beaudin, P. Kaushik, J. Nawyn, and R. Rockinson. Using a live-in laboratory for ubiquitous computing research. In Proc. Int. Conf. on Pervasive Computing, pages 349--365, 2006.

Digital Library

[10]

Y. A. Ivanov and A. F. Bobick. Recognition of visual activities and interactions by stochastic parsing. PAMI, 22(2):852--872, August 2000.

Digital Library

[11]

S. Katz, A. B. Ford, R. W. Moskowitz, B. A. Jackson, and M. W. Jaffe. Studies of illness in the aged. Jama The Journal Of The American Medical Association, 185(12):914--919, 1963.

[12]

J. Kientz, S. Patel, B. Jones, E. Price, E. D. Mynatt, and G. D. Abowd. The Georgia Tech aware home. In Proc. CHI, 2008.

Digital Library

[13]

M. Kranz, A. Schmidt, A. Maldonado, and R. B. Rusu. Context-aware kitchen utilities. In Proc. Int. Conf. Tangible and Embedded Interaction, 2007.

Digital Library

[14]

R. Larson and M. Csikszentmihalyi. Experience sampling method (esm). In H T Reis Ed Naturalistic Approaches to Studying Social Interaction New Directions for Methodology of Social and Behavioral Science, 15:41--56, 1983.

[15]

M. P. Lawton and E. M. Brody. Assessment of older people: self-maintaining and instrumental activities of daily living. Gerontologist, 9(3):179--186, 1969.

[16]

C. Manning, P. Raghavan, and H. Schütze. Introduction to Information Retrieval. Cambridge Univ. Press, 2008.

[17]

D. Moore and I. Essa. Recognizing multitasked activities from video using stochastic context-free grammar. In AAAI, 2002.

Digital Library

[18]

E. Munguia-Tapia, S. Intille, and K. Larson. Activity recognition in the home using simple and ubiquitous sensors. Proceedings of PERVASIVE, pages 158--186, 2004.

[19]

S. Patel, M. Reynolds, and G. Abowd. Detecting Human Movement by Differential Air Pressure Sensing in HVAC System Ductwork: An Exploration in Infrastructure Mediated Sensing. Pervasive '08: Proceedings of the 6th International Conference on Pervasive Computing, Mar. 2009.

Digital Library

[20]

C. Pham and P. Olivier. Slice & Dice: Recognizing Food Preparation Activities Using Embedded Accelerometers. In Proc. Europ. Conf. Ambient Intelligence, 2009.

Digital Library

[21]

M. Philipose, K. Fishkin, M. Perkowitz, D. Patterson, D. Fox, H. Kautz, and D. Hahnel. Inferring activities from interactions with objects. IEEE pervasive computing, 3(4):50--57, 2004.

Digital Library

[22]

G. Salton. The SMART retrieval system: Experiments in automatic document processing. Prentice-Hall, Upper Saddle River, NJ, 1971.

Digital Library

[23]

P. Turaga, R. Chellappa, V. S. Subrahmanian, and O. Udrea. Machine recognition of human activities: A survey. IEEE Trans. Circuits Systems for Video Tech., 2008.

Digital Library

[24]

H. Wang, M. M. Ullah, A. Kläser, I. Laptev, and C. Schmid. Evaluation of local spatio-temporal features for action recognition. In BMVC, 2009.

Cited By

Zolfaghari SStoev TYordanova K(2024)Enhancing Kitchen Activity Recognition: A Benchmark Study of the Rostock KTA DatasetIEEE Access10.1109/ACCESS.2024.335635212(14364-14384)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3356352
Wilhelm SKasbauer JJakob DElser BAhrens D(2023)Exploiting Smart Meter Water Consumption Measurements for Human Activity Event RecognitionJournal of Sensor and Actuator Networks10.3390/jsan1203004612:3(46)Online publication date: 6-Jun-2023
https://doi.org/10.3390/jsan12030046
Li YTong XRen QLi QYang LChen YXue GJi XYu J(2023)AUDIOSENSE: Leveraging Current to Acoustic Channel to Detect Appliances at Single-Point2023 20th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON)10.1109/SECON58729.2023.10287491(240-248)Online publication date: 11-Sep-2023
https://doi.org/10.1109/SECON58729.2023.10287491
Show More Cited By

Index Terms

Recognizing water-based activities in the home through infrastructure-mediated sensing
1. Applied computing
  1. Law, social and behavioral sciences
  2. Life and medical sciences
2. Computing methodologies
  1. Machine learning

Recommendations

Annotating smart environment sensor data for activity learning
Smart Environments: Technology to Support Healthcare

The pervasive sensing technologies found in smart homes offer unprecedented opportunities for providing health monitoring and assistance to individuals experiencing difficulties living independently at home. In order to monitor the functional health of ...
Fusion of Multiple Sensors Sources in a Smart Home to Detect Scenarios of Activities in Ambient Assisted Living

This work takes place within the framework of Smart Homes, with the goal to monitor the activities of elderly people, living independently at home, in order to continuously assess their level of activity and therefore their autonomy. A method is ...
Space-time flexible kernel for recognizing activities from wearable cameras
Abstract
Recognizing activities of daily living is useful for ambient assisted living. In this regard, the use of wearable cameras is a promising technology. In this paper, we propose a novel approach for recognizing activities of daily living using ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UbiComp '12: Proceedings of the 2012 ACM Conference on Ubiquitous Computing

September 2012

1268 pages

ISBN:9781450312240

DOI:10.1145/2370216

General Chair:
Anind K. Dey
Carnegie Mellon University
,
Program Chairs:
Hao-Hua Chu
National Taiwan University, Taiwan
,
Gillian Hayes
University of California, Irvine

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

In-Cooperation

SIGSPATIAL: ACM Special Interest Group on Spatial Information

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 September 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

Ubicomp '12

Sponsor:

Ubicomp '12: The 2012 ACM Conference on Ubiquitous Computing

September 5 - 8, 2012

Pennsylvania, Pittsburgh

Acceptance Rates

UbiComp '12 Paper Acceptance Rate 58 of 301 submissions, 19%;

Overall Acceptance Rate 764 of 2,912 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
458
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)1

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zolfaghari SStoev TYordanova K(2024)Enhancing Kitchen Activity Recognition: A Benchmark Study of the Rostock KTA DatasetIEEE Access10.1109/ACCESS.2024.335635212(14364-14384)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3356352
Wilhelm SKasbauer JJakob DElser BAhrens D(2023)Exploiting Smart Meter Water Consumption Measurements for Human Activity Event RecognitionJournal of Sensor and Actuator Networks10.3390/jsan1203004612:3(46)Online publication date: 6-Jun-2023
https://doi.org/10.3390/jsan12030046
Li YTong XRen QLi QYang LChen YXue GJi XYu J(2023)AUDIOSENSE: Leveraging Current to Acoustic Channel to Detect Appliances at Single-Point2023 20th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON)10.1109/SECON58729.2023.10287491(240-248)Online publication date: 11-Sep-2023
https://doi.org/10.1109/SECON58729.2023.10287491
He WZhao VMorkved OSiddiqui SFernandes EHester JUr B(2021)SoK: Context Sensing for Access Control in the Adversarial Home IoT2021 IEEE European Symposium on Security and Privacy (EuroS&P)10.1109/EuroSP51992.2021.00014(37-53)Online publication date: Sep-2021
https://doi.org/10.1109/EuroSP51992.2021.00014
Matsui TOnishi KMisaki SFujimoto MSuwa HYasumoto K(2020)SALON: Simplified Sensing System for Activity of Daily Living in Ordinary HomeSensors10.3390/s2017489520:17(4895)Online publication date: 29-Aug-2020
https://doi.org/10.3390/s20174895
Adochiei FStefan RAdochiei IEnache BConstantinescu LLarco M(2019)Remote Control for Smart Home Applications2019 11th International Conference on Electronics, Computers and Artificial Intelligence (ECAI)10.1109/ECAI46879.2019.9042067(1-4)Online publication date: Jun-2019
https://doi.org/10.1109/ECAI46879.2019.9042067
Chen Y(2019)Pervasive SensingSmart Assisted Living10.1007/978-3-030-25590-9_1(3-22)Online publication date: 21-Aug-2019
https://doi.org/10.1007/978-3-030-25590-9_1
Nabil SPlötz TKirk DInakage MIshii HDo ESteimle JShaer OKunze KPeiris R(2017)Interactive ArchitectureProceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3024969.3024981(89-100)Online publication date: 20-Mar-2017
https://dl.acm.org/doi/10.1145/3024969.3024981
Guyot PHouix OMisdariis NSusini PPinquier JAndré-Obrecht R(2017)Identification of categories of liquid soundsThe Journal of the Acoustical Society of America10.1121/1.4996124142:2(878-889)Online publication date: 14-Aug-2017
https://doi.org/10.1121/1.4996124
Sawamto JShumuta YOda YKoi Y(2017)Development of a Sensor System for Monitoring the Behavior of the Elderly ResidentsProcedia Computer Science10.1016/j.procs.2017.08.087112:C(1023-1031)Online publication date: 1-Sep-2017
https://dl.acm.org/doi/10.1016/j.procs.2017.08.087
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents