research-article

Text Pin: : Improving text selection with mode-augmented handles on touchscreen mobile devices

Authors:

Fei LyuAuthors Info & Claims

Volume 175, Issue C

https://doi.org/10.1016/j.ijhcs.2023.103028

Published: 01 July 2023 Publication History

Abstract

Text selection is a required step prior to performing many text editing tasks like copy or cut. Text selection relying on adjustment handles is a widely adopted method on touchscreen mobile devices. However, this method has limitations like slow and unconformable interactions when dragging handles and poor performance of selecting non-adjacent text for editing as one. To address these limitations, this study proposes Text Pin, a novel technique that specifies the two ends of intended text by finger tapping rather than finger dragging. We conducted three pilot studies to design Text Pin and an experiment to evaluate its performance. Experimental results show Text Pin (M = 11.49 s) was generally faster than the default handle-based technique on Android (M = 14.95 s) by 23.14% and a gesture-based technique (Fix & Slide) (M = 14.41 s) by 20.26% while having similar selection accuracy (Text Pin vs the default technique vs Fix & Slide: 0.95 vs 0.94 vs 0.95). Our study consequently demonstrates the potential of Text Pin as a suitable alternative to existing handle-based text selection techniques on touchscreen mobile devices.

Highlights

•

This study proposes Text Pin, a novel text selection technique for direct-finger touch interactions.

•

Text Pin specifies the two ends of intended text by finger tapping rather than finger dragging.

•

Text Pin supports efficient selection of non-adjacent text for editing as one.

•

Results show that Text Pin is an effective text selection technique and can be a viable alternative to current handle-based techniques on touchscreen mobile devices.

References

[1]

Aliakseyeu, D., Irani, P., Lucero, A., Subramanian, S., 2008. Multi-flick: an evaluation of flick-based scrolling techniques for pen interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. pp. 1689–1698.

[2]

Ando, T., Isomoto, T., Shizuki, B., Takahashi, S., 2018. Press & tilt: one-handed text selection and command execution on smartphone. In: Proceedings of the 30th Australian Conference on Computer-Human Interaction. pp. 401–405.

[3]

Anon T., Android user comments, 2021, https://www.reddit.com/r/GooglePixel/comments/rirjd3/why_do_i_have_such_a_hard_time_selecting_blocks/ (Accessed: June 2022).

[4]

Anon T., iOS user comments, 2021, https://www.reddit.com/r/ios/comments/meik5v/text_selection_functionality_changes/ (Accessed: June 2022).

[5]

Benko, H., Wilson, A.D., Baudisch, P., 2006. Precise Selection Techniques for Multi-touch Screens. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. CHI ’06, ISBN: 1-59593-372-7, pp. 1263–1272.

[6]

Bi, X., Li, Y., Zhai, S., 2013. FFitts law: modeling finger touch with fitts’ law. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. pp. 1363–1372.

[7]

Brooke J., et al., SUS-A quick and dirty usability scale, Usability Eval. Ind. 189 (194) (1996) 4–7.

[8]

Buxton W., Hill R., Rowley P., Issues and techniques in touch-sensitive tablet input, in: Proceedings of the 12th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’85, 1985, pp. 215–224.

[9]

Chang, J.C., Hahn, N., Kittur, A., 2016. Supporting mobile sensemaking through intentionally uncertain highlighting. In: Proceedings of the 29th Annual Symposium on User Interface Software and Technology. pp. 61–68.

[10]

Chen C., Perrault S.T., Zhao S., Ooi W.T., BezelCopy: An efficient cross-application copy-paste technique for touchscreen smartphones, in: Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces, AVI ’14, 2014, pp. 185–192.

[11]

Cockburn A., Ahlström D., Gutwin C., Understanding performance in touch selections: Tap, drag and radial pointing drag with finger, stylus and mouse, Int. J. Hum.-Comput. Stud. 70 (3) (2012) 218–233.

[12]

Costagliola G., De Rosa M., Fuccella V., A technique for improving text editing on touchscreen devices, J. Vis. Lang. Comput. 47 (2018) 1–8.

[13]

Faul F., Erdfelder E., Lang A.-G., Buchner A., G* Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences, Behav. Res. Methods 39 (2) (2007) 175–191.

[14]

Forlines, C., Wigdor, D., Shen, C., Balakrishnan, R., 2007. Direct-touch vs. Mouse Input for Tabletop Displays. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. CHI ’07, ISBN: 978-1-59593-593-9, pp. 647–656.

[15]

Fuccella V., Isokoski P., Martin B., Gestures and widgets: performance in text editing on multi-touch capable mobile devices, in: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, 2013, pp. 2785–2794.

[16]

Goguey A., Malacria S., Gutwin C., Improving discoverability and expert performance in force-sensitive text selection for touch devices with mode gauges, in: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI ’18, 2018, pp. 477:1–477:12.

[17]

Gordon W., Five shortcuts for faster text selection in iOS, 2020, https://lifehacker.com/five-shortcuts-for-faster-text-selection-in-ios-1641490708 (Accessed: October 2020).

[18]

Gottsegen G., Android P’s new Magnifier tool will take the guessing out of selecting text, 2018, https://www.cnet.com/news/android-p-new-magnifier-tool-will-take-the-guessing-out-of-selecting-text/ (Accessed: October 2020).

[19]

Hager R., Microsoft SwiftKey, 2020, https://www.androidpolice.com/2020/09/14/swiftkey-beta-finally-gets-gboard-style-cursor-control/ (Accessed: October 2020).

[20]

Han J., Lee G., Push-push: A drag-like operation overlapped with a page transition operation on touch interfaces, in: Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, ACM, 2015, pp. 313–322.

[21]

Harkins S., 15 Ways to select text in a Word document, 2020, https://www.techrepublic.com/blog/microsoft-office/15-ways-to-select-text-in-a-word-document/ Accessed: October 2020.

[22]

Hinckley, K., Baudisch, P., Ramos, G., Guimbretiere, F., 2005. Design and Analysis of Delimiters for Selection-action Pen Gesture Phrases in Scriboli. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. CHI ’05, ISBN: 1-58113-998-5, pp. 451–460.

[23]

Huan W., Tu H., Li Z., Enabling finger pointing based text selection on touchscreen mobile devices, in: Proceedings of the Seventh International Symposium of Chinese CHI, in: Chinese CHI ’19, Association for Computing Machinery, New York, NY, USA, 2019, pp. 93–96.

[24]

Inc. A., iOS Human Interface Guidelines, 2020, https://developer.apple.com/ios/human-interface-guidelines/overview/themes/ (Accessed: October 2020).

[25]

Lai, J., Rajabi, N., Javadi, E., 2019. A Shortcut for Caret Positioning on Touch-Screen Phones. In: Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services. pp. 1–6.

[26]

Li, Y., Hinckley, K., Guan, Z., Landay, J.A., 2005. Experimental analysis of mode switching techniques in pen-based user interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. pp. 461–470.

[27]

Li, Y., Sarcar, S., Kim, S., Ren, X., 2020. Swap: A Replacement-based Text Revision Technique for Mobile Devices. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. pp. 1–12.

[28]

Li Y., Sarcar S., Zheng Y., Ren X., Exploring Text Revision with Backspace and Caret in Virtual Reality, CHI ’21, Association for Computing Machinery, New York, NY, USA, 2021,.

Digital Library

[29]

MacKenzie, I.S., Sellen, A., Buxton, W.A.S., 1991. A Comparison of Input Devices in Element Pointing and Dragging Tasks. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. CHI ’91, ISBN: 0-89791-383-3, pp. 161–166.

[30]

Miura M., Saisho K., A text selection technique using word snapping, Procedia Comput. Sci. 35 (2014) 1644–1651.

[31]

Nguyen J., How to copy and paste text on Samsung Galaxy S II, 2018, http://www.itjungles.com/how-to-copy-and-paste-text-on-samsung-galaxy-s-ii.html (Accessed: October 2020).

[32]

Ottoni C., Using smart text selection in Oreo for Android, 2020, https://ting.blog/smart-text-selection-android-oreo/ (Accessed: October 2020).

[33]

Parsoya, A., Rajamanickam, V., 2019. KeySlide: using directional gestures on keyboard for cursor positioning. In: Proceedings of the 10th Indian Conference on Human-Computer Interaction. pp. 1–11.

[34]

Raphael J., Gboard shortcut, 2020, https://www.computerworld.com/article/3048523/gboard-android-shortcuts.html (Accessed: October 2020).

[35]

Roth, V., Turner, T., 2009. Bezel Swipe: Conflict-free Scrolling and Multiple Selection on Mobile Touch Screen Devices. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. CHI ’09, ISBN: 978-1-60558-246-7, pp. 1523–1526.

[36]

Suzuki K., Okabe K., Sakamoto R., Sakamoto D., Fix and slide: Caret navigation with movable background, in: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services, ACM, 2016, pp. 478–482.

[37]

Tu H., Huang Q., Zhao Y., Gao B., Effects of holding postures on user-defined touch gestures for tablet interaction, Int. J. Hum.-Comput. Stud. 141 (2020).

[38]

Tu H., Ren X., Tian F., Wang F., Evaluation of flick and ring scrolling on touch-based smartphones, Int. J. Hum.-Comput. Inter. 30 (8) (2014) 643–653.

[39]

Tu H., Ren X., Zhai S., Differences and similarities between finger and pen stroke gestures on stationary and mobile devices, ACM Trans. Comput.-Hum. Interact. 22 (5) (2015) 1–39.

[40]

Tu, H., Wang, F., Tian, F., Ren, X., 2012a. A comparison of flick and ring document scrolling in touch-based mobile phones. In: Proceedings of the 10th Asia Pacific Conference on Computer Human Interaction. pp. 29–34.

[41]

Tu, H., Yang, X.-D., Wang, F., Tian, F., Ren, X., 2012b. Mode switching techniques through pen and device profiles. In: Proceedings of the 10th Asia Pacific Conference on Computer Human Interaction. pp. 169–176.

[42]

Vogel, D., Baudisch, P., 2007. Shift: A Technique for Operating Pen-based Interfaces Using Touch. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. CHI ’07, ISBN: 978-1-59593-593-9, pp. 657–666.

[43]

Wang, F., Ren, X., 2009. Empirical evaluation for finger input properties in multi-touch interaction. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. pp. 1063–1072.

[44]

Wobbrock J.O., Kay M., Nonparametric statistics in human–computer interaction, in: Modern Statistical Methods for HCI, Springer, 2016, pp. 135–170.

Cited By

Zhan LXiong TZhang HGuo SChen XGong JLin JQin Y(2024)TouchEditorProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314547:4(1-29)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631454

Recommendations

Enabling finger pointing based text selection on touchscreen mobile devices
Chinese CHI '19: Proceedings of the Seventh International Symposium of Chinese CHI

Text selection relying on adjustment handles is a frequently used method on touchscreen mobile devices. However, this method suffers from limitations such as slow and unconformable interactions when dragging handles and being inadequate to select non-...
Fix and Slide: Caret Navigation with Movable Background
UIST '15 Adjunct: Adjunct Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology

We present a ?Fix and Slide? technique, which is a concept to use a movable background to place a caret insertion point and to select text on a mobile device. Standard approach to select text on the mobile devices is touching to the text where a user ...
Understanding performance in touch selections: Tap, drag and radial pointing drag with finger, stylus and mouse

Touch-based interaction with computing devices is becoming more and more common. In order to design for this setting, it is critical to understand the basic human factors of touch interactions such as tapping and dragging; however, there is relatively ...

Comments

Information & Contributors

Information

Published In

cover image International Journal of Human-Computer Studies

International Journal of Human-Computer Studies Volume 175, Issue C

Jul 2023

112 pages

ISSN:1071-5819

Issue’s Table of Contents

Elsevier Ltd.

Publisher

Academic Press, Inc.

United States

Publication History

Published: 01 July 2023

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 12 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhan LXiong TZhang HGuo SChen XGong JLin JQin Y(2024)TouchEditorProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314547:4(1-29)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631454

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents