research-article

Investigating How Smartphone Movement is Affected by Body Posture

Authors:

Rachel Eardley,

Stephen J. ThompsonAuthors Info & Claims

CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Paper No.: 202, Pages 1 - 8

https://doi.org/10.1145/3173574.3173776

Published: 21 April 2018 Publication History

Abstract

We present an investigation into how hand usage is affected by different body postures (Sitting at a table, Lying down and Standing) when interacting with smartphones. We theorize a list of factors (smartphone support, body support and muscle usage) and explore their influence the tilt and rotation of the smartphone. From this we draw a list of hypotheses that we investigate in a quantitative study. We varied the body postures and grips (Symmetric bimanual, Asymmetric bimanual finger, Asymmetric bimanual thumb and Single-handed) studying the effects through a dual pointing task. Our results showed that the body posture Lying down had the most movement, followed by Sitting at a table and finally Standing. We additionally generate reports of motions performed using different grips. Our work extends previous research conducted with multiple grips in a sitting position by including other body postures, it is anticipated that UI designers will use our results to inform the development of mobile user interfaces.

Supplementary Material

MP4 File (pn2249.mp4)

Download
255.97 MB

References

[1]

Azenkot S., Zhai, S. 2012. Touch behavior with different postures on soft smartphone keyboards. MobileHCI '12. ACM, New York, NY, USA, 251260.

Digital Library

[2]

Bachynskyi, M., Palmas, G., Oulasvirta, A., Steimle, J. Weinkauf, T. 2015. Performance and Ergonomics of Touch Surfaces: A Comparative Study using Biomechanical Simulation. CHI '15. ACM, New York, NY, USA, 1817--1826.

Digital Library

[3]

Bergstrom-Lehtovirta, J., Oulasvirta, A. 2014. Modeling the functional area of the thumb on mobile touchscreen surfaces. CHI '14. ACM, New York,USA, 1991--2000.

Digital Library

[4]

Chang, Y., L'Yi, S., Koh, K, Seo, J. 2015. Understanding Users' Touch Behavior on Large Mobile Touch-Screens and Assisted Targeting by Tilting Gesture. CHI '15. ACM, New York, NY, USA, 1499--1508.

Digital Library

[5]

Cheng, L.P, Hsiao, F., Liu Y., Chen, M.Y. 2012. iRotate: automatic screen rotation based on face orientation. CHI '12. ACM, New York, NY, USA, 2203--2210.

Digital Library

[6]

Corsten C., Daehlmann B., Voelker S., Borchers, J. 2017. BackXPress: Using Back-of-Device Finger Pressure to Augment Touchscreen Input on Smartphones. CHI17, ACM, New York, NY, USA, 4654--4666.

Digital Library

[7]

Dreyfuss, H. The Measure of Man: Human Factors in Design, Whitney Library of Design, 1967

[8]

Eardley, R., Gill, S., Roudaut, A., Thompson, S., Hare, J. 2016. Investigating how the hand interacts with different mobile phones. MobileHCI '16. ACM,

Digital Library

[9]

Eardley, R., Roudaut, A., Gill, S., Thompson, S.J. 2017. Understanding Grip Shifts: How Form Factors Impact Hand Movements on Mobile Phones. CHI17 ACM, New York, NY, USA, 4680--4691.

Digital Library

[10]

Endo, Y., Kanai, S., Kishinami, T., Miyata, N., Kouchi, M. and Mochimaru, M., 2007. Virtual grasping assessment using 3D digital hand model. In Annual Applied Ergonomics Conference: Celebrating the Past-Shaping the Future.

[11]

Frameless web browser Retrieved May 3, 2016 from http://stakes.github.io/Frameless/

[12]

Goel, M., Findlater, L., and Wobbrock, J. WalkType: using accelerometer data to accomodate situational impairments in mobile touch screen text entry. CHI'12, ACM (2012), 2687--2696.

Digital Library

[13]

Heads-Up webcam viewer Retrieved May 3, 2016 from https://itunes.apple.com/gb/app/headsupwebcam-viewer/id583912513?mt=12

[14]

Hinckley, K., Heo, S., Pahud, M., Holz, C., Benko, H., Sellen, A., Banks, R., O'Hara, K., Smyth, G., Buxton, W. 2016. Pre-Touch Sensing for Mobile Interaction. CHI '16. ACM, New York, NY, USA, 2869--2881.

Digital Library

[15]

Holz, C., Baudisch, P. 2010. The generalized perceived input point model and how to double touch accuracy by extracting fingerprints. CHI '10. ACM, New York, NY, USA, 581--590.

Digital Library

[16]

Kim, D.-S., and Chae, W.-S. Biomechanical analysis of a smartphone task with different postures. Korean Journal of Sport Biomechanics 22, 2 (2012), 253--259.

[17]

Kim, K., Chang, W., Cho, S., Shim, J., Lee, H., Park, J., Lee, Y., Kim, S. Hand Grip Pattern Recognition for Mobile User Interfaces. In Proceedings of the National Conference on Artificial Intelligence, vol 21, page 1789. Menlo Park, CA; Cambridge, MA; London; AAAI Press; MIT Press; 1999, 2006.

Digital Library

[18]

Le. H.V., Mayer, S., Wolf, K. Henze, N. 2016. Finger Placement and Hand Grasp during Smartphone Interaction. CHI16 ACM, New York, NY, USA, 2576--2584.

Digital Library

[19]

Mohd Noor, M.F., Ramsay, A., Hughes, S., Rogers, S., Williamson, J., and Murray-Smith, R. 28 Frames Later: Predicting Screen Touches from Back-of-device Grip Changes. CHI'14, ACM (2014), 2005--2008.

Digital Library

[20]

Negulescu, M., McGrenere, J. Grip Change as an Information Side Channel for Mobile Touch Interaction, CHI15, April 18--23, 2015, Seoul, Republic of Korea.

Digital Library

[21]

Ng, A., Brewster S.A, Williamson, J.H. 2014. Investigating the effects of encumbrance on oneand two- handed interactions with mobile devices. CHI '14. ACM, New York, NY, USA, 1981--1990.

Digital Library

[22]

Perry K., Hourcade, J.P. 2008. Evaluating one handed thumb tapping on mobile touchscreen devices. GI '08. Canadian Information Processing Society, Toronto, Ont., Canada, Canada, 57--64.

Digital Library

[23]

Postures, typing strategies, and gender differences in mobile device usage: An observational study, J.E. Gold* J.E, J.B. Driban 1, N. Thomas, T. Chakravarty, V. Channell, E. Komaroff, Postures, typing strategies, and gender differences in mobile device usage: An observational study, 22 June 2011, Applied Ergonomics 43 (2012) 408e412

[24]

Seipp K, Devlin, K. 2014. Backpat: improving one-handed touchscreen operation by patting the back of the device. CHI EA '14. ACM, New York, NY, USA, 555--558.

Digital Library

[25]

Shirazi, A. S., Henze, N., Dingler, T., Kunze, K.Schmidt, A. 2013. Upright or sideways?: analysis of smartphone postures in the wild MobileHCI '13. ACM, New York, NY, USA, 362371.

Digital Library

[26]

Silverback 2 Retrieved May 3, 2016 from https://silverbackapp.com/

[27]

Wimmer, R., Boring, S., HandSense: discriminating different ways of grasping and holding a tangible user interface, TEI09, February 16--18, 2009, Cambridge, United Kingdom

Digital Library

[28]

Wobbrock, J. Myers, B., Aung, H,. 2008. The performance of hand postures in front- and backof-device interaction for mobile computing. Int. J. Hum.-Comput. Stud. 66, 12 (December 2008), 857--875.

Digital Library

[29]

Yoo H., Yoon, J., Ji, H. 2015. Index Finger Zone: Study on Touchable Area Expandability Using Thumb and Index Finger. MobileHCI '15. ACM, New York, USA, 803--810.

Digital Library

Cited By

Zieher TProbst K(2024)Usability Optimization for Mobile Menu Design: An Empirical Study of Hand Grips and User PreferencesProceedings of the ACM on Human-Computer Interaction10.1145/36765088:MHCI(1-19)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676508
Rekik YGuettaf AJamalzadeh MGrisoni L(2024)Comparing Eyes-free Gestures to Gestures Produced in the Presence or Absence of Visual Feedback on Mobile DeviceProceedings of the 2024 International Conference on Advanced Visual Interfaces10.1145/3656650.3656651(1-5)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3656650.3656651
Lee LYau YHui P(2024)Perceived User Reachability in Mobile UIs Using Data Analytics and Machine LearningInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2327199(1-24)Online publication date: 25-Mar-2024
https://doi.org/10.1080/10447318.2024.2327199
Show More Cited By

Index Terms

Investigating How Smartphone Movement is Affected by Body Posture
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Understanding Grip Shifts: How Form Factors Impact Hand Movements on Mobile Phones
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

In this paper we present an investigation into how hand usage is affected by different mobile phone form factors. Our initial (qualitative) study explored how users interact with various mobile phone types (touchscreen, physical keyboard and stylus). ...
Investigating How Smartphone Movement is Affected by Lying Down Body Posture
ISS

In this paper, we investigated how "lying down'' body postures affected the use of the smartphone user interface (UI) design. Extending previous research that studied body postures, handgrips, and the movement of the smartphone. We have done this in ...
Designing for Multiple Hand Grips and Body Postures within the UX of a moving Smartphone
DIS '18: Proceedings of the 2018 Designing Interactive Systems Conference

In this paper we explore how screen-based smartphone interaction can be enriched when designers focus on the physical interaction issues surrounding the device. These consist of the hand grips used (Symmetric bimanual, Asymmetric bimanual with thumb, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

April 2018

8489 pages

ISBN:9781450356206

DOI:10.1145/3173574

General Chairs:
Regan Mandryk
University of Saskatchewan, Canada
,
Mark Hancock
University of Waterloo, Canada
,
Program Chairs:
Mark Perry
Brunel University London, UK
,
Anna Cox
University College London, UK

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 April 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Leverhulme Trust

Conference

CHI '18

Sponsor:

SIGCHI

CHI '18: CHI Conference on Human Factors in Computing Systems

April 21 - 26, 2018

Montreal QC, Canada

Acceptance Rates

CHI '18 Paper Acceptance Rate 666 of 2,590 submissions, 26%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

21
Total Citations
View Citations
707
Total Downloads

Downloads (Last 12 months)50
Downloads (Last 6 weeks)3

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zieher TProbst K(2024)Usability Optimization for Mobile Menu Design: An Empirical Study of Hand Grips and User PreferencesProceedings of the ACM on Human-Computer Interaction10.1145/36765088:MHCI(1-19)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676508
Rekik YGuettaf AJamalzadeh MGrisoni L(2024)Comparing Eyes-free Gestures to Gestures Produced in the Presence or Absence of Visual Feedback on Mobile DeviceProceedings of the 2024 International Conference on Advanced Visual Interfaces10.1145/3656650.3656651(1-5)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3656650.3656651
Lee LYau YHui P(2024)Perceived User Reachability in Mobile UIs Using Data Analytics and Machine LearningInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2327199(1-24)Online publication date: 25-Mar-2024
https://doi.org/10.1080/10447318.2024.2327199
Catană AVatavu R(2023)Fingerhints: Understanding Users’ Perceptions of and Preferences for On-Finger Kinesthetic NotificationsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581022(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581022
Ning ECladek ARoss MKabir SBarve AKennelly EHussain FDuffecy JLangenecker SNguyen TTulabandhula TZulueta JAjilore ODemos ALeow A(2023)Smartphone-derived Virtual Keyboard Dynamics Coupled with Accelerometer Data as a Window into Understanding Brain HealthProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580906(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580906
Jamalzadeh MRekik YGrisoni LVatavu RVolpe GDancu A(2023)Effects of Moving Speed and Phone Location on Eyes-Free Gesture Input with Mobile DevicesHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42280-5_30(469-478)Online publication date: 25-Aug-2023
https://doi.org/10.1007/978-3-031-42280-5_30
Mongkonkansai JVeerasakul STamrin SMadardam U(2022)Predictors of Musculoskeletal Pain among Primary School Students Using Smartphones in Nakhon Si Thammarat, ThailandInternational Journal of Environmental Research and Public Health10.3390/ijerph19171053019:17(10530)Online publication date: 24-Aug-2022
https://doi.org/10.3390/ijerph191710530
Esteves ABouquet EPfeuffer KAlt F(2022)One-handed Input for Mobile Devices via Motion Matching and Orbits ControlsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35346246:2(1-24)Online publication date: 7-Jul-2022
https://dl.acm.org/doi/10.1145/3534624
Serrano MFinch JIrani PLucero ARoudaut A(2022)Mold-It: Understanding how Physical Shapes affect Interaction with Handheld Freeform DevicesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502022(1-14)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502022
Humayoun SAbbas GAl-Tarawneh R(2022)Touch-behavioral Authentication on Smartphones using Machine LearningCompanion Proceedings of the 27th International Conference on Intelligent User Interfaces10.1145/3490100.3516456(105-108)Online publication date: 22-Mar-2022
https://dl.acm.org/doi/10.1145/3490100.3516456
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents