research-article

Understanding the Challenges of Mobile Phone Usage Data

Authors:

Denzil Ferreira,

Nikola Banovic,

Kent LyonsAuthors Info & Claims

MobileHCI '15: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services

Pages 504 - 514

https://doi.org/10.1145/2785830.2785891

Published: 24 August 2015 Publication History

Abstract

Driven by curiosity and our own three diverse smartphone application usage datasets, we sought to unpack the nuances of mobile device use by revisiting two recent Mobile HCI studies [1, 17]. Our goal was to add to our broader understanding of smartphone usage by investigating if differences in mobile device usage occurred not only across our three datasets, but also in relation to prior work. We found differences in the top-10 apps in each dataset, in the durations and types of interactions as well as in micro-usage patterns. However, it proved very challenging to attribute such differences to a specific factor or set of factors: was it the time frame in which the studies were executed? The recruitment procedure? The experimental method? Using our somewhat troubled analysis, we discuss the challenges and issues of conducting mobile research of this nature and reflect on caveats related to the replicability and generalizability of such work.

References

[1]

Banovic, N., Brant, C., Mankoff, J., and Dey, A. Proactivetasks: The short of mobile device use sessions. In Proceedings of MobileHCI '14, ACM (2014), 243--252.

Digital Library

[2]

Bentley, F. R., and Metcalf, C. J. Location and activity sharing in everyday mobile communication. In CHI '08 Extended Abstracts, ACM (2008), 2453--2462.

Digital Library

[3]

Böhmer, M., Hecht, B., Schöning, J., Krüger, A., and Bauer, G. Falling asleep with angry birds, facebook and kindle: a large scale study on mobile application usage. In Proceedings of Mobile HCI'11, ACM (2011), 47--56.

Digital Library

[4]

Brandt, J., Weiss, N., and Klemmer, S. R. Txt 4 l8r: Lowering the burden for diary studies under mobile conditions. In CHI '07 Extended Abstracts, ACM (2007), 2303--2308.

Digital Library

[5]

Brown, B., McGregor, M., and McMillan, D. 100 days of iphone use: Understanding the details of mobile device use. In Proceedings of the MobileHCI '14, ACM (2014), 223--232.

Digital Library

[6]

Carrascal, J. P., and Church, K. An in-situ study of mobile app & mobile search interactions. In Proceedings of CHI '15, ACM (2015), 2739--2748.

Digital Library

[7]

Carter, S., Mankoff, J., and Heer, J. Momento: support for situated ubicomp experimentation. In Proceedings of CHI '07, ACM (2007), 125--134.

Digital Library

[8]

Cherubini, M., and Oliver, N. A refined experience sampling method to capture mobile user experience. In International Workshop on Mobile User Experience Research held at CHI '09 (2009).

[9]

Church, K., Cherubini, M., and Oliver, N. A large-scale study of daily information needs captured in situ. In Transactions on Human-Computer Interaction (TOCHI) 21, 2 (2014), 10.

Digital Library

[10]

Consolvo, S., and Walker, M. Using the experience sampling method to evaluate ubicomp applications. IEEE Pervasive Computing 2, 2 (4 2003), 24--31.

Digital Library

[11]

Dearman, D., and Truong, K. Evaluating the implicit acquisition of second language vocabulary using a live wallpaper. In Proceedings of CHI '12, ACM (2012), 1391--1400.

Digital Library

[12]

Do, T. M. T., Blom, J., and Gatica-Perez, D. Smartphone usage in the wild: A large-scale analysis of applications and context. In Proceedings of the ICMI'11, ACM (2011), 353--360.

Digital Library

[13]

Drummond, C. Replicability is not reproducibility: nor is it good science. In Proceedings of the Evaluation Methods for Machine Learning Workshop at ICML (2009).

[14]

Falaki, H., Mahajan, R., Kandula, S., Lymberopoulos, D., Govindan, R., and Estrin, D. Diversity in smartphone usage. In Proceedings of MobiSys '10, ACM (2010), 179--194.

Digital Library

[15]

Ferreira, D., Dey, A. K., and Kostakos, V. Understanding human-smartphone concerns: a study of battery life. In Pervasive Computing, Springer-Verlag (Berlin, Heidelberg, 2011), 19--33.

Digital Library

[16]

Ferreira, D., Ferreira, E., Goncalves, J., Kostakos, V., and Dey, A. K. Revisiting human-battery interaction with an interactive battery interface. In Proceedings of Ubicomp '13, ACM (2013), 563--572.

Digital Library

[17]

Ferreira, D., Goncalves, J., Kostakos, V., Barkhuus, L., and Dey, A. K. Contextual experience sampling of mobile application micro-usage. In Proceedings of MobileHCI '14, ACM (2014), 91--100.

Digital Library

[18]

Ferreira, D., Kostakos, V., Beresford, A. R., Janne, L., and Dey, A. K. Securacy: An empirical investigation of android applications? network usage, privacy and security. In Proceedings of the 8th ACM Conference on Security and Privacy in Wireless and Mobile Networks (WiSec) (2015).

Digital Library

[19]

Ferreira, D., Kostakos, V., and Dey, A. K. Lessons learned from large-scale user studies: Using android market as a source of data. International Journal of Mobile Human Computer Interaction 4, 3 (1 2012), 28--43.

Digital Library

[20]

Ferreira, D., Kostakos, V., and Dey, A. K. Aware: mobile context instrumentation framework. Frontiers in ICT 2, 6 (2015).

[21]

Fischer, J. E. Experience-sampling tools: a critical review. Mobile Living Labs 9 (2009), 1--3.

[22]

Froehlich, J., Chen, M. Y., Consolvo, S., Harrison, B., and Landay, J. A. MyExperience: a system for in situ tracing and capturing of user feedback on mobile phones. In Proceedings of the 5th international conference on Mobile systems, applications and services, ACM (2007), 57--70.

Digital Library

[23]

Henze, N., Pielot, M., Poppinga, B., Schinke, T., and Boll, S. My app is an experiment: Experience from user studies. Developments in Technologies for Human-Centric Mobile Computing and Applications (2012), 294.

[24]

Intille, S. S., Rondoni, J., Kukla, C., Ancona, I., and Bao, L. A context-aware experience sampling tool. In CHI '03 Extended Abstracts, ACM (2003), 972--973.

Digital Library

[25]

Kamisaka, D., Muramatsu, S., Yokoyama, H., and Iwamoto, T. Operation prediction for context-aware user interfaces of mobile phones. SAINT'09. Ninth Annual International Symposium on Applications and the Internet (2009), 16--22.

Digital Library

[26]

Lee, U., Lee, J., Ko, M., Lee, C., Kim, Y., Yang, S., Yatani, K., Gweon, G., Chung, K.-M. . M., and Song, J. Hooked on smartphones: An exploratory study on smartphone overuse among college students. In Proceedings of CHI '14, ACM (2014), 2327--2336.

Digital Library

[27]

McMillan, D., Morrison, A., Brown, O., Hall, M., and Chalmers, M. Further into the Wild: Running Worldwide Trials of Mobile Systems. Springer Berlin Heidelberg, 2010, 210--227.

Digital Library

[28]

Oulasvirta, A., Rattenbury, T., Ma, L., and Raita, E. Habits make smartphone use more pervasive. Personal and Ubiquitous Computing 16, 1 (1 2012), 105--114.

Digital Library

[29]

Palen, L., and Salzman, M. Voice-mail diary studies for naturalistic data capture under mobile conditions. In Proceedings of CSCW '02, ACM (2002), 87--95.

Digital Library

[30]

Pejovic, V., and Musolesi, M. Interruptme: Designing intelligent prompting mechanisms for pervasive applications. In Proceedings of the UbiComp '14, ACM (2014), 897--908.

Digital Library

[31]

Pielot, M. Large-scale evaluation of call-availability prediction. In Proceedings of UbiComp '14, ACM (2014), 933--937.

Digital Library

[32]

Pielot, M., Church, K., and de Oliveira, R. An in-situ study of mobile phone notifications. In Proceedings of MobileHCI '14, ACM (2014), 233--242.

Digital Library

[33]

Rachuri, K. K., Musolesi, M., Mascolo, C., Rentfrow, P. J., Longworth, C., and Aucinas, A. Emotionsense: a mobile phones based adaptive platform for experimental social psychology research. In Proceedings of UbiComp '10, ACM (2010), 281--290.

Digital Library

[34]

Raento, M., Oulasvirta, A., Petit, R., and Toivonen, H. Contextphone: A prototyping platform for context-aware mobile applications. IEEE Pervasive Computing 4, 2 (4 2005), 51--59.

Digital Library

[35]

Rahmati, A., and Zhong, L. Studying smartphone usage: Lessons from a four-month field study.

[36]

Ramanathan, N., Alquaddoomi, F., Falaki, H., George, D., Hsieh, C., Jenkins, J., Ketcham, C., Longstaff, B., Ooms, J., Selsky, J., Tangmunarunkit, H., and Estrin, D. ohmage: An open mobile system for activity and experience sampling. In PervasiveHealth, IEEE (2012), 203--204.

[37]

Shepard, C., Rahmati, A., Tossell, C., Zhong, L., and Kortum, P. Livelab: Measuring wireless networks and smartphone users in the field. ACM SIGMETRICS Performance Evaluation Review 38, 3 (2011).

Digital Library

[38]

Shin, C., Hong, J.-H. . H., and Dey, A. K. Understanding and prediction of mobile application usage for smart phones. In Proceedings of UbiComp '12, ACM (2012), 173--182.

Digital Library

[39]

Srinivasan, V., Moghaddam, S., Mukherji, A., Rachuri, K. K., Xu, C., and Tapia, E. M. Mobileminer: Mining your frequent patterns on your phone. In Proceedings of UbiComp '14, ACM (2014), 389--400.

Digital Library

[40]

Truong, K. N., Shihipar, T., and Wigdor, D. J. Slide to x: unlocking the potential of smartphone unlocking. In Proceedings of CHI '14, ACM (2014), 3635--3644.

Digital Library

[41]

Vaish, R., Wyngarden, K., Chen, J., Cheung, B., and Bernstein, M. S. Twitch crowdsourcing: crowd contributions in short bursts of time. In Proceedings of CHI '14, ACM (2014), 3645--3654.

Digital Library

[42]

Vastenburg, M. H., and Herrera, N. R. Adaptive experience sampling: addressing the dynamic nature of in-situ user studies. In Ambient Intelligence and Future Trends-International Symposium on Ambient Intelligence (ISAmI 2010), Springer (2010), 197--200.

[43]

Vetek, A., Flanagan, J. A., Colley, A., and Keränen, T. Smartactions: Context-aware mobile phone shortcuts. In Proceedings of INTERACT '09, Springer-Verlag (2009), 796--799.

Digital Library

[44]

Wagner, D. T., Rice, A., and Beresford, A. R. Device analyzer: Large-scale mobile data collection. SIGMETRICS Performance Evaluation Review 41, 4 (4 2014), 53--56.

Digital Library

[45]

Yan, T., Chu, D., Ganesan, D., Kansal, A., and Liu, J. Fast app launching for mobile devices using predictive user context. In Proceedings of MobiSys '12 (6 2012), 113--126.

Digital Library

[46]

Zhang, C., Ding, X., Chen, G., Huang, K., Ma, X., and Yan, B. Nihao: A Predictive Smartphone Application Launcher. Springer Berlin Heidelberg, 2013, 294--313.

Cited By

große Deters FSchoedel R(2024)Keep on scrolling? Using intensive longitudinal smartphone sensing data to assess how everyday smartphone usage behaviors are related to well-beingComputers in Human Behavior10.1016/j.chb.2023.107977150:COnline publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1016/j.chb.2023.107977
Buda TKhwaja MGarriga RMatic A(2023)Two edges of the screen: Unpacking positive and negative associations between phone use in everyday contexts and subjective well-beingPLOS ONE10.1371/journal.pone.028410418:4(e0284104)Online publication date: 26-Apr-2023
https://doi.org/10.1371/journal.pone.0284104
Lin CWu CHuang PLai YHo YChung CChang Y(2023)Scanning or Simply Unengaged in Reading? Opportune Moments for Pushed News Notifications and Their Relationship with Smartphone Users' Choice of News-reading ModesProceedings of the ACM on Human-Computer Interaction10.1145/36042687:MHCI(1-26)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604268
Show More Cited By

Index Terms

Understanding the Challenges of Mobile Phone Usage Data
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

A Large-Scale Study of iPhone App Launch Behaviour
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

There have been many large-scale investigations of users' mobile app launch behaviour, but all have been conducted on Android, even though recent reports suggest iPhones account for a third of all smartphones in use. We report on the first large-scale ...
Mobile Phone Usage Patterns, Security Concerns, and Security Practices of Digital Generation

As the digital generations have grown up with high-tech gadgets and become avid users of mobile phones and apps, they are also exposed to increasing mobile security threats and vulnerability. In this paper the authors discuss the impact of recent mobile ...
Emerging research methods for understanding mobile technology use
OZCHI '05: Proceedings of the 17th Australia conference on Computer-Human Interaction: Citizens Online: Considerations for Today and the Future

Mobile devices, applications and services have become integrated into people's daily lives on a personal and professional level. Although traditional research methods are being used to understand the use of mobile devices and applications, methodological ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MobileHCI '15: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services

August 2015

611 pages

ISBN:9781450336529

DOI:10.1145/2785830

General Chairs:
Sebastian Boring
University of Copenhagen, Denmark
,
Enrico Rukzio
University of Ulm, Germany
,
Program Chairs:
Hans Gellersen
Lancaster University, UK
,
Ken Hinckley
Microsoft Research Redmond, USA

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 August 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

European Commission
Academy of Finland

Conference

MobileHCI '15

Sponsor:

SIGCHI

MobileHCI '15: 17th International Conference on Human-Computer Interaction with Mobile Devices and Services

August 24 - 27, 2015

Copenhagen, Denmark

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

54
Total Citations
View Citations
1,068
Total Downloads

Downloads (Last 12 months)81
Downloads (Last 6 weeks)6

Reflects downloads up to 26 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

große Deters FSchoedel R(2024)Keep on scrolling? Using intensive longitudinal smartphone sensing data to assess how everyday smartphone usage behaviors are related to well-beingComputers in Human Behavior10.1016/j.chb.2023.107977150:COnline publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1016/j.chb.2023.107977
Buda TKhwaja MGarriga RMatic A(2023)Two edges of the screen: Unpacking positive and negative associations between phone use in everyday contexts and subjective well-beingPLOS ONE10.1371/journal.pone.028410418:4(e0284104)Online publication date: 26-Apr-2023
https://doi.org/10.1371/journal.pone.0284104
Lin CWu CHuang PLai YHo YChung CChang Y(2023)Scanning or Simply Unengaged in Reading? Opportune Moments for Pushed News Notifications and Their Relationship with Smartphone Users' Choice of News-reading ModesProceedings of the ACM on Human-Computer Interaction10.1145/36042687:MHCI(1-26)Online publication date: 13-Sep-2023
https://dl.acm.org/doi/10.1145/3604268
Komninos A(2023)RoboType: Realistic Mobile Text Entry Evaluations with Synthetic UsersProceedings of the 25th International Conference on Mobile Human-Computer Interaction10.1145/3565066.3608693(1-7)Online publication date: 26-Sep-2023
https://dl.acm.org/doi/10.1145/3565066.3608693
Chen CTso GHe K(2023)Quantum Optimized Cost Based Feature Selection and Credit Scoring for Mobile Micro-financingComputational Economics10.1007/s10614-023-10365-863:2(919-950)Online publication date: 13-Mar-2023
https://doi.org/10.1007/s10614-023-10365-8
Lee HPark JLee U(2022)A Systematic Survey on Android API Usage for Data-driven Analytics with SmartphonesACM Computing Surveys10.1145/353081455:5(1-38)Online publication date: 3-Dec-2022
https://dl.acm.org/doi/10.1145/3530814
Xiao JLi HWu MJin HDeen MCao J(2022)A Survey on Wireless Device-free Human Sensing: Application Scenarios, Current Solutions, and Open IssuesACM Computing Surveys10.1145/353068255:5(1-35)Online publication date: 3-Dec-2022
https://dl.acm.org/doi/10.1145/3530682
Lakhdari ABouguettaya AMistry SNeiat A(2022)Composing Energy Services in a Crowdsourced IoT EnvironmentIEEE Transactions on Services Computing10.1109/TSC.2020.298025815:3(1280-1294)Online publication date: 1-May-2022
https://doi.org/10.1109/TSC.2020.2980258
Li TLi YHoque MXia TTarkoma SHui P(2022)To What Extent We Repeat Ourselves? Discovering Daily Activity Patterns Across Mobile App UsageIEEE Transactions on Mobile Computing10.1109/TMC.2020.302198721:4(1492-1507)Online publication date: 1-Apr-2022
https://doi.org/10.1109/TMC.2020.3021987
Li TXia TWang HTu ZTarkoma SHan ZHui P(2022)Smartphone App Usage Analysis: Datasets, Methods, and ApplicationsIEEE Communications Surveys & Tutorials10.1109/COMST.2022.316317624:2(937-966)Online publication date: Oct-2023
https://doi.org/10.1109/COMST.2022.3163176
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents