Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
Springer Nature Link
Log in

The impacts of situational visual impairment on usability of touch screens

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Using a touchscreen mobile device while walking in sunlight glare limits the visual attention. This situational visual impairment could affect the usability of these devices. This work focuses on the user interaction in situational visual impairment regarding touch gestures and no-visual feedbacks. We performed two user studies. In the first study, we modified the user interface of the two most used applications, phone calling and text messaging, using touch gesture and audio feedback while these features were not used before. Then a user study performed to extract the user preferences of modified applications in visual impairment situation. Our findings indicate that participants preferred gestures, but did not clearly indicate a preference for audio feedback. In the second study, we employed the computational evaluation to explore the distinctions between the made gestures by individuals in two different situations: with and without visual impairment. The outcomes show that in situations with visual impairment: (1) the people draw bigger and broader gestures, (2) there is higher error in features related to geometric shape, (3) familiarity of the user with gestures changes the speed and time for drawing them, and (4) there is not a critical distinctive conduct in how to apply strokes. The user interaction in situational visual impairment could be improved using touch gesture without audio feedback. This situation needs a wider area to make the gestures.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Albinsson P-A, Zhai S (2003) High precision touch screen interaction. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: ACM, pp 105–112

  2. Buzzi MC, Buzzi M, Leporini B, Trujillo A (2017) Analyzing visually impaired people’s touch gestures on smartphones. Multimed Tools Appl 76(4):5141–5169

    Article  Google Scholar 

  3. Zhai S, Kristensson PO, Appert C, Anderson TH, Cao X (2012) Foundational issues in touch-surface stroke gesture design—an integrative review. Foundations and Trends® in Human–Computer Interaction 5(2):97–205

    Article  Google Scholar 

  4. Li T, Quinn P, Zhai S (2023) C-PAK: correcting and completing variable-length prefix-based abbreviated keystrokes. ACM Transactions on Computer-Human Interaction 30(1):1–35

    Article  Google Scholar 

  5. Sears A, Lin M, Jacko J, Xiao Y (2003) When computers fade: Pervasive computing and situationally-induced impairments and disabilities. HCI International 2(03):1298–1302

    Google Scholar 

  6. Goncalves J et al (2016) Tapping task performance on smartphones in cold temperature. Interact Comput 29(3):355–367

    Google Scholar 

  7. Sarsenbayeva Z, van Berkel N, Velloso E, Kostakos V, Goncalves J (2018) Effect of distinct ambient noise types on mobile interaction. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2(2):82

    Article  Google Scholar 

  8. Ng A, Brewster SA, Williamson JH (2014) Investigating the effects of encumbrance on one-and two-handed interactions with mobile devices. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: ACM, pp 1981–1990

  9. Goel M, Findlater L, Wobbrock J (2012) WalkType: using accelerometer data to accomodate situational impairments in mobile touch screen text entry. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: ACM, pp 2687–2696

  10. Tigwell GW, Flatla DR, Menzies R (2018) It’s not just the light: understanding the factors causing situational visual impairments during mobile interaction. In: Proceedings of the 10th Nordic Conference on Human-Computer Interaction: ACM, pp 338–351

  11. Sarsenbayeva Z et al (2019) Measuring the effects of stress on mobile interaction. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3(1):24

    Article  Google Scholar 

  12. Barnard L, Yi JS, Jacko JA, Sears A (2005) An empirical comparison of use-in-motion evaluation scenarios for mobile computing devices. Int J Hum Comput Stud 62(4):487–520

    Article  Google Scholar 

  13. Barnard L, Yi JS, Jacko JA, Sears A (2007) Capturing the effects of context on human performance in mobile computing systems. Personal Uniquit Comput 11(2):81–96

    Article  Google Scholar 

  14. Kane SK (2009) Context-enhanced interaction techniques for more accessible mobile phones. ACM SIGACCESS Accessibility Comput 93:39–43

    Article  Google Scholar 

  15. Kane SK, Jayant C, Wobbrock JO, Ladner RE (2009) Freedom to roam: a study of mobile device adoption and accessibility for people with visual and motor disabilities. In: Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility: ACM, pp 115–122

  16. Lee MJ, Wang Y, Duh HB-L (2012) AR UX design: Applying AEIOU to handheld augmented reality browser. In: 2012 IEEE International Symposium on Mixed and Augmented Reality-Arts, Media, and Humanities (ISMAR-AMH): IEEE, pp 99–100

  17. Sarsenbayeva Z et al (2016) Situational impairments to mobile interaction in cold environments. In: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: ACM, pp 85–96

  18. Gong R, Xu H, Wang B, Luo MR (2012) Image quality evaluation for smart-phone displays at lighting levels of indoor and outdoor conditions. Opt Eng 51(8):084001

    Article  Google Scholar 

  19. Paulsson L, Sjöstrand J (1980) Contrast sensitivity in the presence of a glare light. Theoretical concepts and preliminary clinical studies. Investig Ophthalmol Vis Sci 19(4):401–406

    Google Scholar 

  20. Schildbach B, Rukzio E (2010) Investigating selection and reading performance on a mobile phone while walking. In: Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services: ACM, pp 93–102

  21. Mizobuchi S, Chignell M, Newton D (2005) Mobile text entry: relationship between walking speed and text input task difficulty. In: Proceedings of the 7th International Conference on Human Computer Interaction with Mobile Devices & Services: ACM, pp 122–128

  22. Tigwell GW, Menzies R, Flatla DR ( 2018) Designing for situational visual impairments: supporting early-career designers of mobile content. In: Proceedings of the 2018 on Designing Interactive Systems Conference 2018: ACM, pp 387–399

  23. Macpherson K, Tigwell GW, Menzies R, Flatla DR (2018) BrightLights: Gamifying data capture for situational visual impairments. In: Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility: ACM, pp 355–357

  24. Liu P, Zafar F, Badano A (2014) The effect of ambient illumination on handheld display image quality. J Digit Imaging 27(1):12–18

    Article  Google Scholar 

  25. Kim YJ et al (2008) Factors affecting the psychophysical image quality evaluation of mobile phone displays: the case of transmissive liquid-crystal displays. JOSA A 25(9):2215–2222

    Article  Google Scholar 

  26. Kim YJ et al (2007) Image-color‐quality modeling under various surround conditions for a 2‐in. Mobile transmissive LCD. J Soc Inform Display 15(9):691–698

    Article  Google Scholar 

  27. Ng A, Brewster S (2013) The relationship between encumbrance and walking speed on mobile interactions. In: CHI’13 Extended Abstracts on Human Factors in Computing Systems: ACM, pp 1359–1364

  28. Ng A, Brewster SA, Williamson J (2013) The impact of encumbrance on mobile interactions. In: IFIP Conference on Human-Computer Interaction: Springer, pp 92–109

  29. Sarsenbayeva Z et al (2017) Sensing cold-induced situational impairments in mobile interaction using battery temperature. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1(3):98

    Article  Google Scholar 

  30. Schmidt A, Beigl M, Gellersen H-W (1999) There is more to context than location. Computers Graphics 23(6):893–901

    Article  Google Scholar 

  31. Lee M-Y, Son C-H, Kim J-M, Lee C-H, Ha Y-H (2007) Illumination-level adaptive color reproduction method with lightness adaptation and flare compensation for mobile display. J Imaging Sci Technol 51(1):44–52

    Article  Google Scholar 

  32. Yu J, Zhao J, Chen Y, Yang J (2015) Sensing ambient light for user experience-oriented color scheme adaptation on smartphone displays. In: Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems: ACM, pp 309–321

  33. Bragdon A, Nelson E, Li Y, Hinckley K (2011) Experimental analysis of touch-screen gesture designs in mobile environments. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: ACM, pp 403–412

  34. Vadas K, Patel N, Lyons K, Starner T, Jacko J (2006) Reading on-the-go: a comparison of audio and hand-held displays. In: Proceedings of the 8th Conference on Human-computer Interaction with Mobile Devices and Services: ACM, pp 219–226

  35. Anthony L, Vatavu R-D, Wobbrock JO (2013) Understanding the consistency of users’ pen and finger stroke gesture articulation. In: Proceedings of Graphics Interface 2013: Canadian Information Processing Society, pp 87–94

  36. Kane SK, Wobbrock JO, Ladner RE (2011) Usable gestures for blind people: understanding preference and performance. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: ACM, pp 413–422

  37. Shaw A, Anthony L (2016) Analyzing the articulation features of children’s touchscreen gestures. In: Proceedings of the 18th ACM International Conference on Multimodal Interaction: ACM, pp 333–340

  38. Tu H, Ren X, Zhai S (2012) A comparative evaluation of finger and pen stroke gestures. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: ACM, pp 1287–1296

  39. Vatavu R-D, Anthony L, Wobbrock JO (2013) Relative accuracy measures for stroke gestures. In: Proceedings of the 15th ACM on International Conference on Multimodal Interaction: ACM, pp 279–286

  40. Vatavu R-D, Anthony L, Wobbrock JO (2014) Gesture heatmaps: Understanding gesture performance with colorful visualizations. In: Proceedings of the 16th International Conference on Multimodal Interaction: ACM, pp 172–179

  41. Madapana N, Chanci D, Gonzalez G, Zhang L, Wachs J (2023) Touchless interfaces in the operating room: a study in gesture preferences. International Journal of Human-Computer Interaction 39(3):438–448

    Article  Google Scholar 

  42. Mynatt ED, Weber G (1994) Nonvisual presentation of graphical user interfaces: contrasting two approaches. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: ACM, pp 166–172

  43. Anthony L, Brown Q, Nias J, Tate B, Mohan S (2012) Interaction and recognition challenges in interpreting children’s touch and gesture input on mobile devices. In: Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces: ACM, pp 225–234

  44. Anthony L, Wobbrock JO (2010) A lightweight multistroke recognizer for user interface prototypes. In: Proceedings of Graphics Interface: Canadian Information Processing Society 2010, pp 245–252

  45. Hse HH, Newton AR (2005) Recognition and beautification of multi-stroke symbols in digital ink. Computers Graphics 29(4):533–546

    Article  Google Scholar 

  46. Willems D, Niels R, van Gerven M, Vuurpijl L (2009) Iconic and multi-stroke gesture recognition. Pattern Recogn 42(12):3303–3312

    Article  Google Scholar 

  47. Vanderdonckt SV-NJ, Vatavu R-D, Wobbrock JO (2020) A systematic review of gesture elicitation studies: What Can We Learn from 216 Studies? In: Proceedings of the 2020 ACM Designing Interactive Systems Conference (DIS ‘20), Association for Computing Machinery, New York, pp 855–872

  48. Wobbrock JO, Wilson AD, Li Y (2007) Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes. In: Proceedings of the 20th Annual ACM Symposium on user Interface Software and Technology: ACM, pp 159–168

  49. Long AC Jr, Landay JA, Rowe LA, Michiels J (2000) Visual similarity of pen gestures. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: ACM, pp 360–367

  50. Boulabiar MI, Coppin G, Poirier F (2014) The issues of 3D hand gesture and posture recognition using the kinect. In: Kurosu M (eds) Human-computer interaction. Advanced interaction modalities and techniques. HCI 2014. Lecture notes in computer science, vol 8511. Springer, Cham. https://doi.org/10.1007/978-3-319-07230-2_20

  51. Hosseini M, Hamidi HR, Kermanshahani S (2020) The impacts of situational impairment on touch gestures in public spaces: walking in sunlight. Comput Electr Eng 84:106617

    Article  Google Scholar 

  52. Smithies S, Novins K, Arvo J (1999) A handwriting-based equation editor. Graphics Interface 99:84–91

    Google Scholar 

Download references

Funding

This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Imam Khomeini International University, Qazvin, Iran

    Masoumehsadat Hosseini, Hamid Reza Hamidi & Shokooh Kermanshahani

Authors
  1. Masoumehsadat Hosseini
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hamid Reza Hamidi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shokooh Kermanshahani
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shokooh Kermanshahani.

Ethics declarations

Conflict of interest

The authors declare that they have no conflicts of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hosseini, M., Hamidi, H.R. & Kermanshahani, S. The impacts of situational visual impairment on usability of touch screens. Multimed Tools Appl 83, 81685–81709 (2024). https://doi.org/10.1007/s11042-024-18689-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-024-18689-9

Keywords

Search

Navigation