research-article

Public Access

Adaptive Modelling of Attentiveness to Messaging: A Hybrid Approach

Authors:

Adam J. LeeAuthors Info & Claims

UMAP '19: Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization

Pages 261 - 270

https://doi.org/10.1145/3320435.3320461

Published: 07 June 2019 Publication History

Abstract

Identifying instances when a user will not able to attend to an incoming message and constructing an auto-response with relevant contextual information may help reduce social pressures to immediately respond that many users face. Mobile messaging behavior often varies from one person to another. As a result, compared to a generic model considering profiles of several users, a personalized model can capture a user's messaging behavior more accurately to predict their inattentive states. However, creating accurate personalized models requires a non-trivial amount of individual data, which is often not available for new users. In this work, we investigate a weighted hybrid approach to model users' attention to messaging. Through dynamic performance-based weighting, we combine the predictions of three types of models, a general model, a group model and a personalized model to create an approach which can work through the lack of initial data while adapting to the user's behavior. We present the details of our modeling approach and the evaluation of the model with over three weeks of data from 274 users. Our results highlight the value of hybrid weighted modeling to predict when a user cannot attend to their messages.

References

[1]

Ionut Andone, Konrad Błaszkiewicz, Mark Eibes, Boris Trendafilov, Christian Montag, and Alexander Markowetz. 2016. How age and gender affect smartphone usage. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct. ACM, 9--12.

Digital Library

[2]

Hagai Attias. 2000. A variational baysian framework for graphical models. In Advances in neural information processing systems. 209--215.

Digital Library

[3]

Daniel Avrahami and Scott E Hudson. 2006. Responsiveness in instant messaging: predictive models supporting inter-personal communication. In Proceedings of the SIGCHI conference on Human Factors in computing systems. ACM, 731--740.

Digital Library

[4]

David M Blei, Michael I Jordan, et almbox. 2006. Variational inference for Dirichlet process mixtures. Bayesian analysis, Vol. 1, 1 (2006), 121--143.

[5]

Dariusz Brzezi'nski and Jerzy Stefanowski. 2011. Accuracy updated ensemble for data streams with concept drift. In International conference on hybrid artificial intelligence systems. Springer, 155--163.

Digital Library

[6]

Nikolay Burlutskiy, Miltos Petridis, Andrew Fish, Alexey Chernov, and Nour Ali. 2016. An Investigation on Online Versus Batch Learning in Predicting User Behaviour. In International Conference on Innovative Techniques and Applications of Artificial Intelligence. Springer, 135--149.

[7]

Nitesh V Chawla and Jared Sylvester. 2007. Exploiting diversity in ensembles: Improving the performance on unbalanced datasets. In International Workshop on Multiple Classifier Systems. Springer, 397--406.

Digital Library

[8]

Tianqi Chen and Carlos Guestrin. 2016. Xgboost: A scalable tree boosting system. In Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining. ACM, 785--794.

Digital Library

[9]

Sungjoon Choi, Eunwoo Kim, and Songhwai Oh. 2013. Human behavior prediction for smart homes using deep learning. In RO-MAN, Vol. 2013. 173.

[10]

Karen Church and Rodrigo De Oliveira. 2013. What's up with whatsapp?: comparing mobile instant messaging behaviors with traditional SMS. In Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services. ACM, 352--361.

Digital Library

[11]

Edward S De Guzman, Moushumi Sharmin, and Brian P Bailey. 2007. Should I call now? Understanding what context is considered when deciding whether to initiate remote communication via mobile devices. In Proceedings of Graphics interface 2007. ACM, 143--150.

Digital Library

[12]

Thomas G Dietterich. 2002. Machine learning for sequential data: A review. In Joint IAPR International Workshops on Statistical Techniques in Pattern Recognition (SPR) and Structural and Syntactic Pattern Recognition (SSPR). Springer, 15--30.

Digital Library

[13]

Tilman Dingler and Martin Pielot. 2015. I'll be there for you: Quantifying Attentiveness towards Mobile Messaging. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, 1--5.

Digital Library

[14]

Ryan Elwell and Robi Polikar. 2011. Incremental learning of concept drift in nonstationary environments. IEEE Transactions on Neural Networks, Vol. 22, 10 (2011), 1517--1531.

Digital Library

[15]

Robert Fisher and Reid Simmons. 2011. Smartphone interruptibility using density-weighted uncertainty sampling with reinforcement learning. In Machine Learning and Applications and Workshops (ICMLA), 2011 10th International Conference on, Vol. 1. IEEE, 436--441.

Digital Library

[16]

Nadav Golbandi, Yehuda Koren, and Ronny Lempel. 2011. Adaptive bootstrapping of recommender systems using decision trees. In Proceedings of the fourth ACM international conference on Web search and data mining. ACM, 595--604.

Digital Library

[17]

Songjie Gong. 2010. A collaborative filtering recommendation algorithm based on user clustering and item clustering. JSW, Vol. 5, 7 (2010), 745--752.

[18]

Roberto Hoyle, Srijita Das, Apu Kapadia, Adam J Lee, and Kami Vaniea. 2017. Was my message read?: Privacy and Signaling on Facebook Messenger. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 3838--3842.

Digital Library

[19]

Scott Hudson, James Fogarty, Christopher Atkeson, Daniel Avrahami, Jodi Forlizzi, Sara Kiesler, Johnny Lee, and Jie Yang. 2003. Predicting human interruptibility with sensors: a Wizard of Oz feasibility study. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 257--264.

Digital Library

[20]

Ian Jolliffe. 2011. Principal component analysis. In International encyclopedia of statistical science. Springer, 1094--1096.

[21]

Sang Chon Kim, Doyle Yoon, and Eun Kyoung Han. 2016. Antecedents of mobile app usage among smartphone users. Journal of marketing communications, Vol. 22, 6 (2016), 653--670.

[22]

Johannes Knittel, Alireza Sahami Shirazi, Niels Henze, and Albrecht Schmidt. 2013. Utilizing contextual information for mobile communication. In CHI'13 Extended Abstracts on Human Factors in Computing Systems. ACM, 1371--1376.

Digital Library

[23]

Min-Joong Lee and Chin-Wan Chung. 2011. A user similarity calculation based on the location for social network services. In International Conference on Database Systems for Advanced Applications. Springer, 38--52.

[24]

Qing Li and Byeong Man Kim. 2003. Clustering approach for hybrid recommender system. In null. IEEE, 33.

Digital Library

[25]

Lisa M Mai, Rainer Freudenthaler, Frank M Schneider, and Peter Vorderer. 2015. "I know you've seen it!" Individual and social factors for users' chatting behavior on Facebook. Computers in Human Behavior, Vol. 49 (2015), 296--302.

Digital Library

[26]

Judith Masthoff. 2011. Group recommender systems: Combining individual models. In Recommender systems handbook . Springer, 677--702.

[27]

Abhinav Mehrotra, Mirco Musolesi, Robert Hendley, and Veljko Pejovic. 2015. Designing content-driven intelligent notification mechanisms for mobile applications. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 813--824.

Digital Library

[28]

Abhinav Mehrotra, Veljko Pejovic, Jo Vermeulen, Robert Hendley, and Mirco Musolesi. 2016. My phone and me: understanding people's receptivity to mobile notifications. In Proceedings of the 2016 CHI conference on human factors in computing systems. ACM, 1021--1032.

Digital Library

[29]

Christian Montag, Konrad Błaszkiewicz, Rayna Sariyska, Bernd Lachmann, Ionut Andone, Boris Trendafilov, Mark Eibes, and Alexander Markowetz. 2015. Smartphone usage in the 21st century: who is active on WhatsApp? BMC research notes, Vol. 8, 1 (2015), 331.

[30]

Veljko Pejovic and Mirco Musolesi. 2014. InterruptMe: designing intelligent prompting mechanisms for pervasive applications. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 897--908.

Digital Library

[31]

Andre Luiz Vizine Pereira and Eduardo Raul Hruschka. 2015. Simultaneous co-clustering and learning to address the cold start problem in recommender systems. Knowledge-Based Systems, Vol. 82 (2015), 11--19.

Digital Library

[32]

Martin Pielot. 2014. Large-scale evaluation of call-availability prediction. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 933--937.

Digital Library

[33]

Martin Pielot, Bruno Cardoso, Kleomenis Katevas, Joan Serrà, Aleksandar Matic, and Nuria Oliver. 2017. Beyond interruptibility: Predicting opportune moments to engage mobile phone users. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Vol. 1, 3 (2017), 91.

Digital Library

[34]

Martin Pielot, Rodrigo de Oliveira, Haewoon Kwak, and Nuria Oliver. 2014. Didn't you see my message?: predicting attentiveness to mobile instant messages. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 3319--3328.

Digital Library

[35]

Martin Pielot, Tilman Dingler, Jose San Pedro, and Nuria Oliver. 2015. When attention is not scarce-detecting boredom from mobile phone usage. In Proceedings of the 2015 ACM international joint conference on pervasive and ubiquitous computing. ACM, 825--836.

Digital Library

[36]

Al Mamunur Rashid, George Karypis, and John Riedl. 2008. Learning preferences of new users in recommender systems: an information theoretic approach. Acm Sigkdd Explorations Newsletter, Vol. 10, 2 (2008), 90--100.

Digital Library

[37]

Yasmeen Rashidi, Kami Vaniea, and L Jean Camp. 2016. Understanding Saudis' privacy concerns when using WhatsApp. In Proceedings of the Workshop on Usable Security (USEC'16) .

[38]

Francesco Ricci, Lior Rokach, and Bracha Shapira. 2015. Recommender systems: introduction and challenges. In Recommender systems handbook . Springer, 1--34.

[39]

David R Roberts, Volker Bahn, Simone Ciuti, Mark S Boyce, Jane Elith, Gurutzeta Guillera-Arroita, Severin Hauenstein, José J Lahoz-Monfort, Boris Schröder, Wilfried Thuiller, et almbox. 2017. Cross-validation strategies for data with temporal, spatial, hierarchical, or phylogenetic structure. Ecography, Vol. 40, 8 (2017), 913--929.

[40]

Stephanie Rosenthal, Anind K Dey, and Manuela Veloso. 2011. Using decision-theoretic experience sampling to build personalized mobile phone interruption models. In International Conference on Pervasive Computing . Springer, 170--187.

Digital Library

[41]

Iqbal H Sarker. 2018. Silentphone: Inferring user unavailability based opportune moments to minimize call interruptions. arXiv preprint arXiv:1810.10958 (2018).

[42]

Hinrich Schütze, Christopher D Manning, and Prabhakar Raghavan. 2008. Introduction to information retrieval . Vol. 39. Cambridge University Press.

[43]

Jeremiah Smith, Anna Lavygina, Jiefei Ma, Alessandra Russo, and Naranker Dulay. 2014. Learning to recognise disruptive smartphone notifications. In Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services. ACM, 121--124.

Digital Library

[44]

Barry Smyth, Jill Freyne, Maurice Coyle, Peter Briggs, and Evelyn Balfe. 2003. I-SPY-Anonymous, community-based personalization by collaborative meta-search. In International Conference on Innovative Techniques and Applications of Artificial Intelligence. Springer, 367--380.

[45]

Amy Voida, Wendy C Newstetter, and Elizabeth D Mynatt. 2002. When conventions collide: the tensions of instant messaging attributed. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 187--194.

Digital Library

[46]

Daniel T Wagner, Andrew Rice, and Alastair R Beresford. 2013. Device analyzer: Understanding smartphone usage. In International Conference on Mobile and Ubiquitous Systems: Computing, Networking, and Services. Springer, 195--208.

[47]

Tanja Walsh, Piia Nurkka, and Rod Walsh. 2010. Cultural differences in smartphone user experience evaluation. In Proceedings of the 9th International Conference on Mobile and Ubiquitous Multimedia. ACM, 24.

Digital Library

[48]

Haixun Wang, Wei Fan, Philip S Yu, and Jiawei Han. 2003. Mining concept-drifting data streams using ensemble classifiers. In Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining . AcM, 226--235.

Digital Library

[49]

Qiang Xu, Jeffrey Erman, Alexandre Gerber, Zhuoqing Mao, Jeffrey Pang, and Shobha Venkataraman. 2011. Identifying diverse usage behaviors of smartphone apps. In Proceedings of the 2011 ACM SIGCOMM conference on Internet measurement conference. ACM, 329--344.

Digital Library

[50]

Carl Yang, Xiaolin Shi, Luo Jie, and Jiawei Han. 2018. I Know You'll Be Back: Interpretable New User Clustering and Churn Prediction on a Mobile Social Application. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. ACM, 914--922.

Digital Library

[51]

Fengpeng Yuan, Xianyi Gao, and Janne Lindqvist. 2017. How busy are you?: Predicting the interruptibility intensity of mobile users. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 5346--5360.

Digital Library

[52]

Sha Zhao, Julian Ramos, Jianrong Tao, Ziwen Jiang, Shijian Li, Zhaohui Wu, Gang Pan, and Anind K Dey. 2016. Discovering different kinds of smartphone users through their application usage behaviors. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 498--509.

Digital Library

Cited By

Jain PFarzan RLee A(2023)Co-Designing with Users the Explanations for a Proactive Auto-Response Messaging AgentProceedings of the ACM on Human-Computer Interaction10.1145/36042487:MHCI(1-23)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604248
Jain P(2023)Design and Evaluation of a Virtual Assistant for improving Awareness in Mobile MessagingCompanion Proceedings of the 2023 ACM International Conference on Supporting Group Work10.1145/3565967.3571758(63-65)Online publication date: 8-Jan-2023
https://dl.acm.org/doi/10.1145/3565967.3571758
Jain PFarzan RLee A(2022)Laila is in a Meeting: Design and Evaluation of a Contextual Auto-Response Messaging AgentProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533493(1457-1471)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3533493
Show More Cited By

Index Terms

Adaptive Modelling of Attentiveness to Messaging: A Hybrid Approach
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. User models
    2. HCI theory, concepts and models

Recommendations

Didn't you see my message?: predicting attentiveness to mobile instant messages
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Mobile instant messaging (e.g., via SMS or WhatsApp) often goes along with an expectation of high attentiveness, i.e., that the receiver will notice and read the message within a few minutes. Hence, existing instant messaging services for mobile phones ...
Adaptive user modelling in car racing games using behavioural and physiological data

Personalised content adaptation has great potential to increase user engagement in video games. Procedural generation of user-tailored content increases the self-motivation of players as they immerse themselves in the virtual world. An adaptive user ...
The impact of unified messaging on the user
CHI EA '99: CHI '99 Extended Abstracts on Human Factors in Computing Systems

In the last few years the topic Unified Messaging (UM) has become important. UM means that users can deal with messages of all kinds regardless of their location, the communication device and medium used, or the connection used. Until now much of the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UMAP '19: Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization

June 2019

377 pages

ISBN:9781450360210

DOI:10.1145/3320435

General Chairs:
George Angelos Papadopoulos
University of Cyprus, Cyprus
,
George Samaras
University of Cyprus, Cyprus
,
Stephan Weibelzahl
PFH Private University of Applied Sciences Göttingen, Germany
,
Program Chairs:
Dietmar Jannach
Alpen-Adria-Universität Klagenfurt, Austria
,
Olga C. Santos
aDeNu Research Group - UNED, Spain

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Conference

UMAP '19

Sponsor:

UMAP '19: 27th Conference on User Modeling, Adaptation and Personalization

June 9 - 12, 2019

Larnaca, Cyprus

Acceptance Rates

UMAP '19 Paper Acceptance Rate 30 of 122 submissions, 25%;

Overall Acceptance Rate 162 of 633 submissions, 26%

Upcoming Conference

UMAP '25

Sponsor:
sigchi
sigchi

33rd ACM Conference on User Modeling, Adaptation and Personalization

June 16 - 19, 2025

New York City , NY , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
432
Total Downloads

Downloads (Last 12 months)106
Downloads (Last 6 weeks)25

Reflects downloads up to 16 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Jain PFarzan RLee A(2023)Co-Designing with Users the Explanations for a Proactive Auto-Response Messaging AgentProceedings of the ACM on Human-Computer Interaction10.1145/36042487:MHCI(1-23)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604248
Jain P(2023)Design and Evaluation of a Virtual Assistant for improving Awareness in Mobile MessagingCompanion Proceedings of the 2023 ACM International Conference on Supporting Group Work10.1145/3565967.3571758(63-65)Online publication date: 8-Jan-2023
https://dl.acm.org/doi/10.1145/3565967.3571758
Jain PFarzan RLee A(2022)Laila is in a Meeting: Design and Evaluation of a Contextual Auto-Response Messaging AgentProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533493(1457-1471)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3533493
Jain PFarzan RLee A(2021)Context-based Automated Responses of Unavailability in Mobile MessagingComputer Supported Cooperative Work (CSCW)10.1007/s10606-021-09399-z30:3(307-349)Online publication date: 25-May-2021
https://doi.org/10.1007/s10606-021-09399-z
Mosse DPotter HLee S(2020)Maintaining Privacy and Utility in IoT System Analytics2020 Second IEEE International Conference on Trust, Privacy and Security in Intelligent Systems and Applications (TPS-ISA)10.1109/TPS-ISA50397.2020.00030(157-164)Online publication date: Oct-2020
https://doi.org/10.1109/TPS-ISA50397.2020.00030

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents