research-article

PSINES: Activity and Availability Prediction for Adaptive Ambient Intelligence

Authors:

Grégoire Lefebvre,

Fano Ramparany,

James L. CrowleyAuthors Info & Claims

ACM Transactions on Autonomous and Adaptive Systems (TAAS), Volume 15, Issue 1

Article No.: 1, Pages 1 - 12

https://doi.org/10.1145/3424344

Published: 31 December 2020 Publication History

Abstract

Autonomy and adaptability are essential components of ambient intelligence. For example, in smart homes, proactive acting and occupants advising, adapted to current and future contexts of living, are essential to go beyond limitations of previous domotic services. To reach such autonomy and adaptability, ambient systems need to automatically grasp their users’ ambient context. In particular, users’ activities and availabilities for communication are valuable pieces of contextual information that can help such systems to adapt to user needs and behaviours. While significant research work exists on activity recognition in homes, less attention has been given to prediction of future activities, as well as to availability recognition and prediction in general. In this article, we investigate several Dynamic Bayesian Network (DBN) architectures for activity and availability prediction of occupants in homes, including our novel model, called Past SItuations to predict the NExt Situation (PSINES). This predictive architecture utilizes context information, sensor event aggregations, and latent user cognitive states to accurately predict future home situations based on previous situations. We experimentally evaluate PSINES, as well as intermediate DBN architectures, on multiple state-of-the-art datasets, with prediction accuracies of up to 89.52% for activity and 82.08% for availability on the Orange4Home dataset.

References

[1]

James L. Crowley and Joelle Coutaz. 2015. An ecological view of smart home technologies. In Proceedings of the European Conference on Ambient Intelligence. Springer, 1–16.

[2]

Shaoen Wu, Jacob B. Rendall, Matthew J. Smith, Shangyu Zhu, Junhong Xu, Honggang Wang, Qing Yang, and Pinle Qin. 2017. Survey on prediction algorithms in smart homes. IEEE IoT J. 4, 3 (2017), 636–644.

[3]

Claude Elwood Shannon. 1948. A mathematical theory of communication. Bell Syst. Tech. J. 27 (1948), 623–656.

[4]

Rakesh Agrawal and Ramakrishnan Srikant. 1994. Fast algorithms for mining association rules in large databases. In Proceedings of the 20th International Conference on Very Large Data Bases. Morgan Kaufmann, 487–499.

Digital Library

[5]

Heikki Mannila, Hannu Toivonen, and A. Inkeri Verkamo. 1997. Discovery of frequent episodes in event sequences. Data Min. Knowl. Discov. 1, 3 (1997), 259–289.

Digital Library

[6]

Jiawei Han, Jian Pei, and Yiwen Yin. 2000. Mining frequent patterns without candidate generation. In ACM Sigmod Record, Vol. 29. ACM, 1–12.

Digital Library

[7]

M. J. Zaki, S. Parthasarathy, M. Ogihara, and W. Li. 1997. New algorithms for fast discovery of association rules. In Proceedings of the 3rd International Conference on Knowledge Discovery and Data Mining. AAAI Press, 283–286.

[8]

Karthik Gopalratnam and Diane J. Cook. 2007. Online sequential prediction via incremental parsing: The active leZi algorithm. IEEE Intell. Syst. 22, 1 (2007), 52–58.

Digital Library

[9]

Amiya Bhattacharya and Sajal K. Das. 2002. Lezi-update: An information-theoretic framework for personal mobility tracking in pcs networks. Wireless Netw. 8, 2--3 (2002), 121–135.

Digital Library

[10]

Muhammad Raisul Alam, Mamun Bin Ibne Reaz, and M. A. Mohd Ali. 2012. SPEED: An inhabitant activity prediction algorithm for smart homes. IEEE Trans. Syst. Man Cybernet. A: Syst. Hum. 42, 4 (2012), 985–990.

Digital Library

[11]

Piotr Augustyniak and Grażyna Ślusarczyk. 2018. Graph-based representation of behavior in detection and prediction of daily living activities. Comput. Biol. Med. 95 (2018), 261–270.

Digital Library

[12]

Sawsan Mahmoud, Ahmad Lotfi, and Caroline Langensiepen. 2013. Behavioural pattern identification and prediction in intelligent environments. Appl. Soft Comput. 13, 4 (2013), 1813–1822.

Digital Library

[13]

Henry Kautz, Oren Etzioni, Dieter Fox, and Dan Weld. 2003. Foundations of Assisted Cognition Systems. Technical Report. Computer Science Department, University of Washington.

[14]

Dorothy N. Monekosso and Paolo Remagnino. 2009. Anomalous behavior detection: Supporting independent living. In Intelligent Environments. Methods, Algorithms and Applications. Springer-Verlag, London, 33--48.

[15]

Han Saem Park and Sung Bae Cho. 2010. Predicting user activities in the sequence of mobile context for ambient intelligence environment using dynamic Bayesian network. In Proceedings of the 2nd International Conference on Agents and Artificial Intelligence (ICAART’10).

[16]

Jihang Ye, Zhe Zhu, and Hong Cheng. 2013. What’s your next move: User activity prediction in location-based social networks. In Proceedings of the 2013 SIAM International Conference on Data Mining. SIAM, 171–179.

[17]

Ashesh Jain, Avi Singh, Hema S. Koppula, Shane Soh, and Ashutosh Saxena. 2016. Recurrent neural networks for driver activity anticipation via sensory-fusion architecture. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA’16). IEEE, 3118–3125.

Digital Library

[18]

Sungjoon Choi, Eunwoo Kim, and Songhwai Oh. 2013. Human behavior prediction for smart homes using deep learning. In Proceedings of the IEEE International Conference on Robot 8 Human Interactive Communication (RO-MAN’13), Vol. 2013. 173.

[19]

Younggi Kim, Jihoon An, Minseok Lee, and Younghee Lee. 2017. An activity-embedding approach for next-activity prediction in a multi-user smart space. In Proceedings of the IEEE International Conference on Smart Computing (SMARTCOMP’17). IEEE, 1–6.

[20]

Iram Fatima, Muhammad Fahim, Young-Koo Lee, and Sungyoung Lee. 2013. A unified framework for activity recognition-based behavior analysis and action prediction in smart homes. Sensors 13, 2 (2013), 2682–2699.

[21]

Abdulsalam Yassine, Shailendra Singh, and Atif Alamri. 2017. Mining human activity patterns from smart home big data for health care applications. IEEE Access 5 (2017), 13131–13141.

[22]

Shailendra Singh, Abdulsalam Yassine, and Shervin Shirmohammadi. 2016. Incremental mining of frequent power consumption patterns from smart meters big data. In Proceedings of the Electrical Power and Energy Conference (EPEC’16). IEEE, 1–6.

[23]

Ehsan Nazerfard and Diane J. Cook. 2015. CRAFFT: An activity prediction model based on Bayesian networks. J. Ambient Intell. Human. Comput. 6, 2 (2015), 193–205.

[24]

Yoshinao Takemae, Takehiko Ohno, Ikuo Yoda, and Shinji Ozawa. 2006. Estimating human interruptibility in the home for remote communication. In CHI’06 Extended Abstracts on Human Factors in Computing Systems. ACM, 1397–1402.

[25]

Kristine S. Nagel, James M. Hudson, and Gregory D. Abowd. 2004. Predictors of availability in home life context-mediated communication. In Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work. ACM, 497–506.

[26]

Chien-Ming Huang and Bilge Mutlu. 2014. Learning-based modeling of multimodal behaviors for humanlike robots. In Proceedings of the 2014 ACM/IEEE International Conference on Human-robot Interaction. ACM, 57–64.

Digital Library

[27]

Jina Lee, Stacy Marsella, David Traum, Jonathan Gratch, and Brent Lance. 2007. The rickel gaze model: A window on the mind of a virtual human. In Proceedings of the International Workshop on Intelligent Virtual Agents. Springer, 296–303.

Digital Library

[28]

Alaeddine Mihoub and Grégoire Lefebvre. 2019. Wearables and social signal processing for smarter public presentations. ACM Trans. Interact. Intell. Syst. 9, 2--3 (2019), 1--24.

Digital Library

[29]

Diane J. Cook, Aaron S. Crandall, Brian L. Thomas, and Narayanan C. Krishnan. 2013. CASAS: A smart home in a box. Computer 46, 7 (2013), 62–69.

Digital Library

[30]

Julien Cumin, Grégoire Lefebvre, Fano Ramparany, and James L. Crowley. 2017. A dataset of routine daily activities in an instrumented home. In Proceedings of the International Conference on Ubiquitous Computing and Ambient Intelligence. Springer, 413–425.

[31]

Klaus Greff, Rupesh K. Srivastava, Jan Koutník, Bas R. Steunebrink, and Jürgen Schmidhuber. 2016. LSTM: A search space odyssey. IEEE Trans. Neur. Netw. Learn. Syst. 28, 10 (2016), 2222–2232.

[32]

Julien Cumin, Grégoire Lefebvre, Fano Ramparany, and James L. Crowley. 2017. Human activity recognition using place-based decision fusion in smart homes. In Proceedings of the International and Interdisciplinary Conference on Modeling and Using Context. Springer, 137–150.

Cited By

Song XWang DQuek CTan AWang Y(2023)Spatial-temporal episodic memory modeling for ADLs: encoding, retrieval, and predictionComplex & Intelligent Systems10.1007/s40747-023-01298-810:2(2733-2750)Online publication date: 14-Dec-2023
https://doi.org/10.1007/s40747-023-01298-8
Mohamed MEl-Kilany AEl-Tazi N(2022)Future Activities Prediction Framework in Smart Homes EnvironmentIEEE Access10.1109/ACCESS.2022.319761810(85154-85169)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3197618

Index Terms

PSINES: Activity and Availability Prediction for Adaptive Ambient Intelligence
1. Human-centered computing
  1. Ubiquitous and mobile computing
    1. Ubiquitous and mobile computing theory, concepts and paradigms
      1. Ambient intelligence
2. Mathematics of computing
  1. Probability and statistics
    1. Probabilistic representations
      1. Bayesian networks

Recommendations

A Centralized Approach to an Ambient Assisted Living Application: An Intelligent Home
IWANN '09: Proceedings of the 10th International Work-Conference on Artificial Neural Networks: Part II: Distributed Computing, Artificial Intelligence, Bioinformatics, Soft Computing, and Ambient Assisted Living

<em>Ambient Assisted Living </em> (AAL) includes assistance to carry out daily activities, health and activity monitoring, enhancing safety and security, getting access to, medical and emergency systems. But home environments are challengeable as they'...
Ambient Assisted Living and Care in The Netherlands: The Voice of the User

Technology can assist older adults to remain living in the community. Within the realm of information and communication technologies, smart homes are drifting toward the concept of ambient assisted living (AAL). AAL-systems are more responsive to user ...
Bayesian Networks Structure Learning for Activity Prediction in Smart Homes
IE '12: Proceedings of the 2012 Eighth International Conference on Intelligent Environments

This paper presents a sequence-based activity prediction approach which uses Bayesian networks in a novel two-step process to predict both activities and their corresponding features. In addition to the proposed model, we also present the results of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Autonomous and Adaptive Systems

ACM Transactions on Autonomous and Adaptive Systems Volume 15, Issue 1

March 2020

79 pages

ISSN:1556-4665

EISSN:1556-4703

DOI:10.1145/3446624

Editor:
Bashar Nuseibeh
The Open University, UK, 8 Lero, Ireland

Issue’s Table of Contents

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 31 December 2020

Accepted: 01 September 2020

Revised: 01 June 2020

Received: 01 September 2019

Published in TAAS Volume 15, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
174
Total Downloads

Downloads (Last 12 months)22
Downloads (Last 6 weeks)2

Reflects downloads up to 11 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Song XWang DQuek CTan AWang Y(2023)Spatial-temporal episodic memory modeling for ADLs: encoding, retrieval, and predictionComplex & Intelligent Systems10.1007/s40747-023-01298-810:2(2733-2750)Online publication date: 14-Dec-2023
https://doi.org/10.1007/s40747-023-01298-8
Mohamed MEl-Kilany AEl-Tazi N(2022)Future Activities Prediction Framework in Smart Homes EnvironmentIEEE Access10.1109/ACCESS.2022.319761810(85154-85169)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3197618

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Issue’s Table of Contents