Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Incremental Learning of Daily Routines as Workflows in a Smart Home Environment

Published: 28 January 2015 Publication History
  • Get Citation Alerts
  • Abstract

    Smart home environments should proactively support users in their activities, anticipating their needs according to their preferences. Understanding what the user is doing in the environment is important for adapting the environment's behavior, as well as for identifying situations that could be problematic for the user. Enabling the environment to exploit models of the user's most common behaviors is an important step toward this objective. In particular, models of the daily routines of a user can be exploited not only for predicting his/her needs, but also for comparing the actual situation at a given moment with the expected one, in order to detect anomalies in his/her behavior. While manually setting up process models in business and factory environments may be cost-effective, building models of the processes involved in people's everyday life is infeasible. This fact fully justifies the interest of the Ambient Intelligence community in automatically learning such models from examples of actual behavior. Incremental adaptation of the models and the ability to express/learn complex conditions on the involved tasks are also desirable. This article describes how process mining can be used for learning users’ daily routines from a dataset of annotated sensor data. The solution that we propose relies on a First-Order Logic learning approach. Indeed, First-Order Logic provides a single, comprehensive and powerful framework for supporting all the previously mentioned features. Our experiments, performed both on a proprietary toy dataset and on publicly available real-world ones, indicate that this approach is efficient and effective for learning and modeling daily routines in Smart Home Environments.

    References

    [1]
    G. Abowd and E. Mynatt. 2004. Designing for the human experience in smart environments. In Smart Environments: Technology, Protocols, and Applications. Wiley, 153--174.
    [2]
    R. Agrawal, D. Gunopulos, and F. Leymann. 1998. Mining process models from workflow logs. In Proceedings of the 6th International Conference on Extending Database Technology: Advances in Database Technology (EDBT’98). Springer, 469--483.
    [3]
    A. Aztiria, J. C. Augusto, R. Basagoiti, A. Izaguirre, and D. J. Cook. 2013. Learning frequent behaviors of the users in intelligent environments. IEEE Trans. Syst. Man, Cybern.: Syst. 43, 6 (May 2013), 1265--1278.
    [4]
    E. Bellodi, F. Riguzzi, and E. Lamma. 2010. Probabilistic declarative process mining. In Proceedings of the 4th International Conference on Knowledge Science, Engineering and Management (KSEM’10). Springer, 292--303.
    [5]
    I. Bierhoff and A. van Berlo. 2008. More intelligent smart houses for better care and health. Global Telemedicine and eHealth Updates: Knowledge Resources, Vol. 1, Luxexpo, Luxembourg, 322--325.
    [6]
    S. Bocionek and T. Mitchell. 1993. Office automation systems that are “programmed” by their users. In Proceedings of the 23rd Annual Conference of the German Association for Computer Science. 214--219.
    [7]
    B. Bouchard, S. Giroux, and A. Bouzouane. 2006. A smart home agent for plan recognition. In Proceedings of the 19th International Conference on Advances in Artificial Intelligence: Canadian Society for Computational Studies of Intelligence (AI’06). Springer, 25--36.
    [8]
    M. Cattafi, E. Lamma, F. Riguzzi, and S. Storari. 2010. Incremental declarative process mining. Smart Information and Knowledge Management, Studies in Computational Intelligence, Vol. 260. Springer, 103--127.
    [9]
    D. Cavone, B. De Carolis, S. Ferilli, and N. Novielli. 2012. A multiagent system supporting situation aware interaction with a smart environment. In Proceedings of the 2nd International Conference on Pervasive Embedded Computing and Communication Systems (PECCS’12). SciTePress, 67--72.
    [10]
    A. Cesta, G. Cortellessa, F. Pecora, and R. Rasconi. 2007. Supporting interaction in the robocare intelligent assistive environment. In Proceedings of the Association for the Advancement of Artificial Intelligence (AAAI) 2007 Spring Symposium. AAAI, 18--25.
    [11]
    M. Chan, D. Estève, C. Escriba, and E. Campo. 2008. A review of smart homes—Present state and future challenges. Comput. Meth. Programs Biomed. 91, 1 (July 2008), 55--81.
    [12]
    L. Chen, C. Nugent, M. Mulvenna, D. Finlay, and X. Hong. 2008. A logical framework for behaviour reasoning and assistance in a smart home. Int. J. Assist. Roboti. Mech. 9, 4, 20--34.
    [13]
    S. Consolvo, P. Roessler, and B. E. Shelton. 2004. The carenet display: Lessons learned from an in home evaluation of an ambient display. In Proceedings of the 6th International Conference on Ubiquitous Computing (UbiComp’04), Lecture Notes in Computer Science, Vol. 3205, Springer, New York, 1--17.
    [14]
    D. Cook and S. Das. 2004. Smart Environments: Technology, Protocols and Applications, Wiley Series on Parallel and Distributed Computing. Wiley-Interscience.
    [15]
    J. Cook and A. Wolf. 1996. Discovering Models of Software Processes from Event-Based Data. Technical Report CU-CS-819-96. Department of Computer Science, University of Colorado.
    [16]
    B. De Carolis, G. Cozzolongo, S. Pizzutilo, and V. L. Plantamura. 2005. Agent-based home simulation and control. In Proceedings of the International Symposium on Methodologies for Intelligent Systems (ISMIS 2005), Lecture Notes in Computer Science, Vol. 3488, Springer, 404--412.
    [17]
    A. de Medeiros, B. van Dongen, W. van der Aalst, and A. Weijters. 2004. Process mining: Extending the α-algorithm to mine short loops, WP 113, BETA Working Paper Series, Eindhoven University of Technology.
    [18]
    A. de Medeiros, A. K. Medeiros, A. J. Weijters, and W. M. Aalst. 2007. Genetic process mining: An experimental evaluation. Data Mining and Knowledge Discovery 14, 2 (April 2007), 245--304.
    [19]
    F. Doctor, H. Hagras, and V. Callaghan. 2005. A fuzzy embedded agent-based approach for realizing ambient intelligence in intelligent inhabited environments. IEEE Trans. Syst., Man, Cybern., Part A 35, 1 (2005), 55--65.
    [20]
    F. Esposito, G. Semeraro, N. Fanizzi, and S. Ferilli. 2000. Multistrategy theory revision: Induction and abduction in Inthelex. Mach. Learn. 38, 1/2 (2000), 133--156.
    [21]
    C. Ellis, K. Keddara, and G. Rozenberg. 1995. Dynamic change within workflow systems. In Proceedings of the Conference on Organizational Computing Systems (COCS’95). ACM, 10--21.
    [22]
    S. Ferilli, T. M. A. Basile, M. Biba, N. Di Mauro, and F. Esposito. 2009. A general similarity framework for horn clause logic. Fund. Inf. 90, 1--2 (2009), 43--66.
    [23]
    S. Ferilli and F. Esposito. 2013. A logic framework for incremental learning of process models. Fund. Inf. 128, 4 (2013), 413--443.
    [24]
    S. Ferilli. 2014. WoMan: Logic-based workflow learning and management. IEEE Trans. Syst., Man Cybern.: Syst. 44, 6 (2014), 744--756.
    [25]
    K. Gopalratnam and D. J. Cook. 2007. Online sequential prediction via incremental parsing: The active LeZi algorithm. IEEE Intell. Syst. 22, 1 (2007), 52--58.
    [26]
    T. Gu, L. Wang, Z. Wu, X. Tao, and J. Lu. 2011. A pattern mining approach to sensor-based human activity recognition. IEEE Trans. Knowl. Data Eng. 23, 9 (Sept. 2011), 1359--1372.
    [27]
    S. Helal, W. Mann, H. El-Zabadani, J. King, Y. Kaddoura, and E. Jansen. 2005. The gator tech smart house: A programmable pervasive space. Computer 38, 3 (March 2005), 50--60.
    [28]
    R. Helaoui, D. Riboni, and H. Stuckenschmidt. 2013. A probabilistic ontological framework for the recognition of multilevel human activities. In Proceedings of the International Conference on Ubiquitous Computing (UbiComp’13). ACM, 345--354.
    [29]
    J. Herbst. 2000a. Dealing with concurrency in workflow induction. European Concurrent Engineering Conference, SCS Europe.
    [30]
    J. Herbst. 2000b. A Machine Learning Approach to Workflow Management. Machine Learning: ECML 2000. Lecture Notes in Computer Science, Vol. 1810, Springer, 183--194.
    [31]
    J. Herbst and D. Karagiannis. 1998. Integrating machine learning and workflow management to support acquisition and adaptation of workflow models. In Proceedings of the 9th International Workshop on Database and Expert Systems Applications, IEEE.
    [32]
    J. Herbst and D. Karagiannis. 1999. An inductive approach to the acquisition and adaptation of workflow models. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI’99) Work-shop on Intelligent Workflow and Process Management: The New Frontier for AI in Business. 52--57.
    [33]
    D. H. Hu and Q. Yang. 2008. Cigar: Concurrent and interleaving goal and activity recognition. In Proceedings of the 23rd Association for the Advancement of Artificial Intelligence (AAAI) Conference on Artificial Intelligence (AAAI’08). AAAI, 1363--1368.
    [34]
    E. Kim, S. Helal, and D. Cook. 2010. Human activity recognition and pattern discovery. IEEE Pervasive Comput. 9, 1 (Jan.-March 2010), 48--53.
    [35]
    N. C. Krishnan, D. J. Cook, and Z. Wemlinger. 2013. Learning a taxonomy of predefined and discovered activity patterns. J. Ambient Intell. Smart Environ. 5, 6 (2013), 621--637.
    [36]
    E. Lamma, P. Mello, F. Riguzzi, and S. Storari. 2007. Applying inductive logic programming to process mining. In Proceedings of the 17th International Conference on Inductive Logic Programming (ILP’07), Lecture Notes in Computer Science, Vol. 4894, Springer, 132--146.
    [37]
    T. McFadden and J. Indulska. 2004. Context-aware environments for independent living. In Proceedings of the 3rd National Conference of Emerging Researchers in Ageing (ERA’04).
    [38]
    J. Nehmer, M. Becker, A. Karshmer, and R. Lamm. 2006. Living assistance systems: An ambient intelligence approach. In Proceedings of the 28th International Conference on Software Engineering. ACM, 43--50.
    [39]
    M. Novak, M. Binas, and F. Jakab. 2012. Unobtrusive anomaly detection in presence of elderly in a smart-home environment. In Proceedings of the 9th International Conference ELEKTRO. IEEE, 341--344.
    [40]
    M. Pesic and W. M. P. van der Aalst. 2006. A declarative approach for flexible business processes management. In Proceedings of the 2006 International Conference on Business Process Management Workshops (BPM’06), Lecture Notes in Computer Science, Vol. 4103, Springer, 169--180.
    [41]
    J. L. Peterson. 1977. Petri Nets, ACM Comput. Surveys 9, 3 (Sept. 1977), 223--252.
    [42]
    P. Rashidi and D. J. Cook. 2008. Adapting to resident preferences in smart environments. In Proceedings of the Association for the Advancement of Artificial Intelligence (AAAI) Workshop on Preference Handling. AAAI, 78--84.
    [43]
    P. Rashidi and D. J. Cook. 2009. Keeping the resident in the loop: Adapting the smart home to the user. IEEE Trans. Syst., Man, Cybern., Part A 39, 5 (2009), 949--959.
    [44]
    D. Riboni and C. Bettini. 2011. OWL 2 modeling and reasoning with complex human activities. Pervasive Mobile Comput. 7, 3 (June 2011), 379--395.
    [45]
    A. Rozinat and W. van der Aalst. 2006. Decision Mining in Business Processes. WP 164, BETA Working Paper Series, Eindhoven University of Technology.
    [46]
    E. Serral, P. Valderas, and V. Pelechano. 2010. Supporting runtime system evolution to adapt to user behaviour. In Proceedings of the 22nd International Conference on Advanced Information Systems Engineering (CAiSE’10). Lecture Notes in Computer Science, Vol. 6051, Springer, 378--392.
    [47]
    T. Stavropoulos, D. Vrakas, and I. Vlahavas. 2011. A survey of service composition in ambient intelligence environments. J. Artif. Intell. Rev. 40, 247--270.
    [48]
    H. Steg, H. Strese, C. Loroff, J. Hull, and S. Schmidt. 2006. Europe is Facing a Demographic Challenge. Ambient Assisted Living Offers Solutions. VDI/VDE/IT, Berlin.
    [49]
    S. Stenudd. 2011. A model for using machine learning in smart environments. In Proceedings of the 6th International Conference on Grid and Pervasive Computing (GPC’11), Lecture Notes in Computer Science, Vol. 7096, Springer, 24--33.
    [50]
    L. A. Suchman. 1987. Plans and Situated Actions: The Problem of Human-Machine Communication. Cambridge University Press, Cambridge.
    [51]
    W. van der Aalst. 1998. The application of petri nets to workflow management, J. Circ., Syst. Comput. 8, 1 (1998), 21--66.
    [52]
    W. van der Aalst, H. A. Reijers, A. J. M. M. Weijters, B. F. van Dongen, A. K. Alves de Medeiros, M. Song, and H. M. W. Verbeek. 2007. Business process mining: An industrial application. Inf. Syst. 32, 5 (July 2007), 713--732.
    [53]
    W. van der Aalst, T. Weijters, and L. Maruster. 2004. Workflow mining: Discovering process models from event logs. IEEE Trans. Knowl. Data Eng. 16, 9 (2004), 1128--1142.
    [54]
    T. van Kasteren and B. Kröse. 2007. Bayesian activity recognition in residence for elders. In Proceedings of the 3rd IET International Conference on Intelligent Environments (IE’07). 209--212.
    [55]
    T. L. M. van Kasteren, A. K. Noulas, G. Englebienne, and B. J. A. Kröse. 2008. Accurate activity recognition in a home setting. In Proceedings of the 10th International Conference on Ubiquitous Computing (Ubicomp’08). ACM, 1--9.
    [56]
    T. L. M. van Kasteren, G. Englebienne, and B. Kröse. 2010. Human activity recognition from wireless sensor network data: Benchmark and software. Activity Recognition in Pervasive Intelligent Environments, Atlantis Ambient and Pervasive Intelligence series, Atlantis Press.
    [57]
    A. J. M. M. Weijters and W. M. P. van der Aalst. 2003. Rediscovering workflow models from event-based data using little thumb. Integr. Comput. Aided Eng. 10, 2, 151--162.
    [58]
    L. Wen, J. Wang, and J. Sun. 2006. Detecting implicit dependencies between tasks from event logs. In Proceedings of the 8th Asia-Pacific Web conference on Frontiers of World Wide Web (WWW) Research and Development (APWeb’06), Lecture Notes in Computer Science, vol. 3841, Springer, 591--603.

    Cited By

    View all
    • (2023)A User-Centric Evaluation of Smart Home Resolution Approaches for Conflicts Between RoutinesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35819977:1(1-35)Online publication date: 28-Mar-2023
    • (2023)Using semi-Markov models to identify long holding times of activities of daily living in smart homes2023 IEEE Smart World Congress (SWC)10.1109/SWC57546.2023.10449129(748-753)Online publication date: 28-Aug-2023
    • (2023)A survey on the application of process discovery techniques to smart spaces dataEngineering Applications of Artificial Intelligence10.1016/j.engappai.2023.106748126(106748)Online publication date: Nov-2023
    • Show More Cited By

    Index Terms

    1. Incremental Learning of Daily Routines as Workflows in a Smart Home Environment

          Recommendations

          Comments

          Information & Contributors

          Information

          Published In

          cover image ACM Transactions on Interactive Intelligent Systems
          ACM Transactions on Interactive Intelligent Systems  Volume 4, Issue 4
          Special Issue on Activity Recognition for Interaction and Regular Article
          January 2015
          190 pages
          ISSN:2160-6455
          EISSN:2160-6463
          DOI:10.1145/2688469
          Issue’s Table of Contents
          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          Published: 28 January 2015
          Accepted: 01 September 2014
          Received: 01 September 2013
          Revised: 01 August 2004
          Published in TIIS Volume 4, Issue 4

          Permissions

          Request permissions for this article.

          Check for updates

          Author Tags

          1. Model of user daily routines
          2. incremental learning
          3. process mining
          4. smart home environment

          Qualifiers

          • Research-article
          • Research
          • Refereed

          Funding Sources

          • Italian Ministry of University and Research (MIUR)

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • Downloads (Last 12 months)23
          • Downloads (Last 6 weeks)1

          Other Metrics

          Citations

          Cited By

          View all
          • (2023)A User-Centric Evaluation of Smart Home Resolution Approaches for Conflicts Between RoutinesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35819977:1(1-35)Online publication date: 28-Mar-2023
          • (2023)Using semi-Markov models to identify long holding times of activities of daily living in smart homes2023 IEEE Smart World Congress (SWC)10.1109/SWC57546.2023.10449129(748-753)Online publication date: 28-Aug-2023
          • (2023)A survey on the application of process discovery techniques to smart spaces dataEngineering Applications of Artificial Intelligence10.1016/j.engappai.2023.106748126(106748)Online publication date: Nov-2023
          • (2023)A Survey on the Application of Process Mining to Smart Spaces DataProcess Mining Workshops10.1007/978-3-031-27815-0_5(57-70)Online publication date: 26-Mar-2023
          • (2022)Understanding Coding Behavior: An Incremental Process Mining ApproachElectronics10.3390/electronics1103038911:3(389)Online publication date: 27-Jan-2022
          • (2022)Ambient Assisted Living and Social Robots: Towards Learning Relations between User’s Daily Routines and MoodAdjunct Proceedings of the 30th ACM Conference on User Modeling, Adaptation and Personalization10.1145/3511047.3537691(123-129)Online publication date: 4-Jul-2022
          • (2022)Exploring the Usability of Process Mining in Smart CityIFAC-PapersOnLine10.1016/j.ifacol.2022.08.04655:11(42-47)Online publication date: 2022
          • (2021)IoT Cooking Workflows for End-Users: A Comparison Between Behaviour Trees and the DX-MAN Model2021 ACM/IEEE International Conference on Model Driven Engineering Languages and Systems Companion (MODELS-C)10.1109/MODELS-C53483.2021.00057(341-350)Online publication date: Oct-2021
          • (2020)Radial Basis Function Neural Network with Localized Stochastic-Sensitive Autoencoder for Home-Based Activity RecognitionSensors10.3390/s2005147920:5(1479)Online publication date: 8-Mar-2020
          • (2020)Supervised kernel density estimation K-meansExpert Systems with Applications10.1016/j.eswa.2020.114350(114350)Online publication date: Nov-2020
          • Show More Cited By

          View Options

          Get Access

          Login options

          Full Access

          View options

          PDF

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          Media

          Figures

          Other

          Tables

          Share

          Share

          Share this Publication link

          Share on social media