Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3411764.3445201acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

BezelGlide: Interacting with Graphs on Smartwatches with Minimal Screen Occlusion

Published: 07 May 2021 Publication History

Abstract

We present BezelGlide, a novel suite of bezel interaction techniques, designed to minimize screen occlusion and ‘fat finger’ effects, when interacting with common graphs on smartwatches. To explore the design of BezelGlide, we conducted two user studies. First, we quantified the amount of screen occlusion experienced when interacting with the smartwatch bezel. Next, we designed two techniques that involve gliding the finger along the smartwatch bezel for graph interaction. Full BezelGlide (FBG) and Partial BezelGlide (PBG), use the full or a portion of the bezel, respectively, to reduce screen occlusion while scanning a line chart for data. In the common value detection task, we find that PBG outperforms FBG and Shift, a touchscreen occlusion-free technique, both quantitatively and subjectively, also while mobile. We finally illustrate the generzability potential of PBG to interact with common graph types making it a valuable interaction technique for smartwatch users.

Supplementary Material

VTT File (3411764.3445201_videofigurecaptions.vtt)
MP4 File (3411764.3445201_videofigure.mp4)
Supplemental video

References

[1]
Sunggeun Ahn, Jaeyeon Lee, Keunwoo Park, and Geehyuk Lee. 2018. Evaluation of edge-based interaction on a square smartwatch. International Journal of Human-Computer Studies 109 (2018), 68–78.
[2]
Fereshteh Amini, Khalad Hasan, Andrea Bunt, and Pourang Irani. 2017. Data representations for in-situ exploration of health and fitness data. In Proceedings of the 11th EAI International Conference on Pervasive Computing Technologies for Healthcare. 163–172.
[3]
Shaikh Shawon Arefin Shimon, Courtney Lutton, Zichun Xu, Sarah Morrison-Smith, Christina Boucher, and Jaime Ruiz. 2016. Exploring non-touchscreen gestures for smartwatches. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 3822–3833.
[4]
Tanja Blascheck, Lonni Besançon, Anastasia Bezerianos, Bongshin Lee, and Petra Isenberg. 2018. Glanceable visualization: Studies of data comparison performance on smartwatches. IEEE transactions on visualization and computer graphics 25, 1(2018), 630–640.
[5]
Emeline Brulé, Gilles Bailly, Marcos Serrano, Marc Teyssier, and Samuel Huron. 2017. Investigating the design space of smartwatches combining physical rotary inputs. In Proceedings of the 29th Conference on l’Interaction Homme-Machine. 13–20.
[6]
Jaemin Chun, Anind Dey, Kyungtaek Lee, and SeungJun Kim. 2018. A qualitative study of smartwatch usage and its usability. Human Factors and Ergonomics in Manufacturing & Service Industries 28, 4(2018), 186–199.
[7]
Tak chung Fu, Fu lai Chung, Robert Luk, and Chak man Ng. 2007. Stock time series pattern matching: Template-based vs. rule-based approaches. Engineering Applications of Artificial Intelligence 20, 3(2007), 347 – 364. https://doi.org/10.1016/j.engappai.2006.07.003
[8]
Frederick E Croxton and Harold Stein. 1932. Graphic comparisons by bars, squares, circles, and cubes. J. Amer. Statist. Assoc. 27, 177 (1932), 54–60.
[9]
Walter Crosby Eells. 1926. The relative merits of circles and bars for representing component parts. J. Amer. Statist. Assoc. 21, 154 (1926), 119–132.
[10]
Paolo Federico, Stephan Hoffmann, Alexander Rind, Wolfgang Aigner, and Silvia Miksch. 2014. Qualizon graphs: Space-efficient time-series visualization with qualitative abstractions. In Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces. 273–280.
[11]
Johannes Fuchs, Fabian Fischer, Florian Mansmann, Enrico Bertini, and Petra Isenberg. 2013. Evaluation of alternative glyph designs for time series data in a small multiple setting. In Proceedings of the SIGCHI conference on human factors in computing systems. 3237–3246.
[12]
Rúben Gouveia, Fábio Pereira, Evangelos Karapanos, Sean A Munson, and Marc Hassenzahl. 2016. Exploring the design space of glanceable feedback for physical activity trackers. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 144–155.
[13]
Garrett Grolemund and Hadley Wickham. 2015. Visualizing complex data with embedded plots. Journal of Computational and Graphical Statistics 24, 1(2015), 26–43.
[14]
Radim Halır and Jan Flusser. 1998. Numerically stable direct least squares fitting of ellipses. In Proc. 6th International Conference in Central Europe on Computer Graphics and Visualization. WSCG, Vol. 98. Citeseer, 125–132.
[15]
Teng Han, Khalad Hasan, Keisuke Nakamura, Randy Gomez, and Pourang Irani. 2017. Soundcraft: Enabling spatial interactions on smartwatches using hand generated acoustics. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. 579–591.
[16]
Teng Han, Jiannan Li, Khalad Hasan, Keisuke Nakamura, Randy Gomez, Ravin Balakrishnan, and Pourang Irani. 2018. PageFlip: Leveraging Page-Flipping Gestures for Efficient Command and Value Selection on Smartwatches. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–12.
[17]
Ming C Hao, Umeshwar Dayal, Daniel A Keim, and Tobias Schreck. 2005. Importance-driven visualization layouts for large time series data. In IEEE Symposium on Information Visualization, 2005. INFOVIS 2005. IEEE, 203–210.
[18]
Ming C Hao, Manish Marwah, Halldór Janetzko, Umeshwar Dayal, Daniel A Keim, Debprakash Patnaik, Naren Ramakrishnan, and Ratnesh K Sharma. 2012. Visual exploration of frequent patterns in multivariate time series. Information Visualization 11, 1 (2012), 71–83.
[19]
Kiyotaka Hara, Takeshi Umezawa, and Noritaka Osawa. 2015. Effect of button size and location when pointing with index finger on smartwatch. In International Conference on Human-Computer Interaction. Springer, 165–174.
[20]
Khalad Hasan, Xing-Dong Yang, Hai-Ning Liang, and Pourang Irani. 2012. How to position the cursor? an exploration of absolute and relative cursor positioning for back-of-device input. In Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services. 103–112.
[21]
Jeffrey Heer and Michael Bostock. 2010. Crowdsourcing graphical perception: using mechanical turk to assess visualization design. In Proceedings of the SIGCHI conference on human factors in computing systems. 203–212.
[22]
Waqas Javed, Bryan McDonnel, and Niklas Elmqvist. 2010. Graphical perception of multiple time series. IEEE transactions on visualization and computer graphics 16, 6(2010), 927–934.
[23]
Amy K Karlson and Benjamin B Bederson. 2007. ThumbSpace: generalized one-handed input for touchscreen-based mobile devices. In IFIP Conference on Human-Computer Interaction. Springer, 324–338.
[24]
Eamonn Keogh, Harry Hochheiser, and Ben Shneiderman. 2002. An augmented visual query mechanism for finding patterns in time series data. In International Conference on Flexible Query Answering Systems. Springer, 240–250.
[25]
Frederic Kerber, Tobias Kiefer, Markus Löchtefeld, and Antonio Krüger. 2017. Investigating current techniques for opposite-hand smartwatch interaction. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services. 1–12.
[26]
Yuki Kubo, Buntarou Shizuki, and Jiro Tanaka. 2016. B2B-Swipe: Swipe gesture for rectangular smartwatches from a bezel to a bezel. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 3852–3856.
[27]
Bongshin Lee, Catherine Plaisant, Cynthia Sims Parr, Jean-Daniel Fekete, and Nathalie Henry. 2006. Task taxonomy for graph visualization. In Proceedings of the 2006 AVI workshop on BEyond time and errors: novel evaluation methods for information visualization. 1–5.
[28]
Luis A Leiva, Alireza Sahami, Alejandro Catala, Niels Henze, and Albrecht Schmidt. 2015. Text entry on tiny qwerty soft keyboards. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 669–678.
[29]
Jessica Lin, Eamonn Keogh, and Stefano Lonardi. 2005. Visualizing and discovering non-trivial patterns in large time series databases. Information visualization 4, 2 (2005), 61–82.
[30]
Donald McMillan, Barry Brown, Airi Lampinen, Moira McGregor, Eve Hoggan, and Stefania Pizza. 2017. Situating wearables: Smartwatch use in context. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 3582–3594.
[31]
Andrew Vande Moere and Helen Purchase. 2011. On the role of design in information visualization. Information Visualization 10, 4 (2011), 356–371.
[32]
Ali Neshati, Yumiko Sakamoto, Launa C Leboe-McGowan, Jason Leboe-McGowan, Marcos Serrano, and Pourang Irani. 2019. G-Sparks: Glanceable Sparklines on Smartwatches. In Graphics Interface. 23–1.
[33]
Alexander Ng, John Williamson, and Stephen Brewster. 2015. The effects of encumbrance and mobility on touch-based gesture interactions for mobile phones. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services. 536–546.
[34]
Ian Oakley and Doyoung Lee. 2014. Interaction on the edge: offset sensing for small devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 169–178.
[35]
Ian Oakley, Carina Lindahl, Khanh Le, DoYoung Lee, and MD Rasel Islam. 2016. The flat finger: Exploring area touches on smartwatches. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 4238–4249.
[36]
Keunwoo Park, Daehwa Kim, Seongkook Heo, and Geehyuk Lee. 2020. MagTouch: Robust Finger Identification for a Smartwatch Using a Magnet Ring and a Built-in Magnetometer. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376234
[37]
J Parnow. 2015. Micro visualizations: How can micro visualisations enhance text comprehension, memorability, and exploitation?Design MS Thesis, Potsdam Univ. Appl. Sci., Potsdam, Germany (2015).
[38]
Lewis V Peterson and Wilbur Schramm. 1954. How accurately are different kinds of graphs read?Audiovisual communication review 2, 3 (1954), 178–189.
[39]
Zablon Pingo and Bhuva Narayan. 2019. “My smartwatch told me to see a sleep doctor”: a study of activity tracker use. Online Information Review(2019).
[40]
Stefania Pizza, Barry Brown, Donald McMillan, and Airi Lampinen. 2016. Smartwatch in vivo. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 5456–5469.
[41]
Katrin Plaumann, Michael Müller, and Enrico Rukzio. 2016. CircularSelection: optimizing list selection for smartwatches. In Proceedings of the 2016 ACM International Symposium on Wearable Computers. 128–135.
[42]
Volker Roth and Thea Turner. 2009. Bezel swipe: conflict-free scrolling and multiple selection on mobile touch screen devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1523–1526.
[43]
Anne Roudaut, Stéphane Huot, and Eric Lecolinet. 2008. TapTap and MagStick: improving one-handed target acquisition on small touch-screens. In Proceedings of the working conference on Advanced visual interfaces. 146–153.
[44]
Léa Saviot, Frederik Brudy, and Steven Houben. 2017. WRISTBAND. IO: expanding input and output spaces of a Smartwatch. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. 2025–2033.
[45]
Marcos Serrano, Eric Lecolinet, and Yves Guiard. 2013. Bezel-Tap gestures: quick activation of commands from sleep mode on tablets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 3027–3036.
[46]
Tomoki Shibata, Daniel Afergan, Danielle Kong, Beste F Yuksel, I Scott MacKenzie, and Robert JK Jacob. 2016. DriftBoard: A panning-based text entry technique for ultra-small touchscreens. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. 575–582.
[47]
Katie A Siek, Yvonne Rogers, and Kay H Connelly. 2005. Fat finger worries: how older and younger users physically interact with PDAs. In IFIP Conference on Human-Computer Interaction. Springer, 267–280.
[48]
Gaganpreet Singh, William Delamare, and Pourang Irani. 2018. D-SWIME: A design space for smartwatch interaction techniques supporting mobility and encumbrance. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–13.
[49]
Srinath Sridhar, Anders Markussen, Antti Oulasvirta, Christian Theobalt, and Sebastian Boring. 2017. WatchSense: On-and above-skin input sensing through a wearable depth sensor. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 3891–3902.
[50]
John Trimpop, Hannes Schenk, Gerald Bieber, Friedrich Lämmel, and Paul Burggraf. 2017. Smartwatch based respiratory rate and breathing pattern recognition in an end-consumer environment. In Proceedings of the 4th international Workshop on Sensor-based Activity Recognition and Interaction. 1–5.
[51]
Aku Visuri, Zhanna Sarsenbayeva, Niels van Berkel, Jorge Goncalves, Reza Rawassizadeh, Vassilis Kostakos, and Denzil Ferreira. 2017. Quantifying sources and types of smartwatch usage sessions. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 3569–3581.
[52]
Daniel Vogel and Ravin Balakrishnan. 2010. Occlusion-aware interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 263–272.
[53]
Daniel Vogel and Patrick Baudisch. 2007. Shift: a technique for operating pen-based interfaces using touch. In Proceedings of the SIGCHI conference on Human factors in computing systems. 657–666.
[54]
Daniel Vogel and Géry Casiez. 2012. Hand occlusion on a multi-touch tabletop. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2307–2316.
[55]
Daniel Vogel, Matthew Cudmore, Géry Casiez, Ravin Balakrishnan, and Liam Keliher. 2009. Hand occlusion with tablet-sized direct pen input. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 557–566.
[56]
Bryan Wang and Tovi Grossman. 2020. BlyncSync: Enabling Multimodal Smartwatch Gestures with Synchronous Touch and Blink. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376132
[57]
Marc Weber, Marc Alexa, and Wolfgang Müller. 2001. Visualizing time-series on spirals. In Infovis, Vol. 1. 7–14.
[58]
Pui Chung Wong, Kening Zhu, Xing-Dong Yang, and Hongbo Fu. 2020. Exploring Eyes-free Bezel-initiated Swipe on Round Smartwatches. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–11.
[59]
Haijun Xia, Tovi Grossman, and George Fitzmaurice. 2015. NanoStylus: Enhancing input on ultra-small displays with a finger-mounted stylus. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. 447–456.
[60]
Robert Xiao, Teng Cao, Ning Guo, Jun Zhuo, Yang Zhang, and Chris Harrison. 2018. LumiWatch: On-arm projected graphics and touch input. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–11.
[61]
Hui-Shyong Yeo, Juyoung Lee, Andrea Bianchi, and Aaron Quigley. 2016. WatchMI: pressure touch, twist and pan gesture input on unmodified smartwatches. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services. 394–399.
[62]
Xin Yi, Chun Yu, Weijie Xu, Xiaojun Bi, and Yuanchun Shi. 2017. Compass: Rotational keyboard on non-touch smartwatches. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 705–715.
[63]
Cheng Zhang, Junrui Yang, Caleb Southern, Thad E Starner, and Gregory D Abowd. 2016. WatchOut: extending interactions on a smartwatch with inertial sensing. In Proceedings of the 2016 ACM International Symposium on Wearable Computers. 136–143.
[64]
Junhan Zhou, Yang Zhang, Gierad Laput, and Chris Harrison. 2016. AuraSense: enabling expressive around-smartwatch interactions with electric field sensing. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. 81–86.

Cited By

View all
  • (2024)SwivelTouch: Boosting Touchscreen Input with 3D Finger Rotation GestureProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595848:2(1-30)Online publication date: 15-May-2024
  • (2024)GestureMark: Shortcut Input Technique using Smartwatch Touch Gestures for XR GlassesProceedings of the Augmented Humans International Conference 202410.1145/3652920.3652941(63-71)Online publication date: 4-Apr-2024
  • (2024)PonDeFlick: A Japanese Text Entry on Smartwatch Commonalizing Flick Operation with Smartphone InterfaceProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642569(1-11)Online publication date: 11-May-2024
  • Show More Cited By

Index Terms

  1. BezelGlide: Interacting with Graphs on Smartwatches with Minimal Screen Occlusion
    Index terms have been assigned to the content through auto-classification.

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
    May 2021
    10862 pages
    ISBN:9781450380966
    DOI:10.1145/3411764
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 07 May 2021

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. data charts
    2. input
    3. interaction
    4. smartwatch
    5. visuzation

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    • NSERC, MITACS

    Conference

    CHI '21
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)88
    • Downloads (Last 6 weeks)4
    Reflects downloads up to 17 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)SwivelTouch: Boosting Touchscreen Input with 3D Finger Rotation GestureProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595848:2(1-30)Online publication date: 15-May-2024
    • (2024)GestureMark: Shortcut Input Technique using Smartwatch Touch Gestures for XR GlassesProceedings of the Augmented Humans International Conference 202410.1145/3652920.3652941(63-71)Online publication date: 4-Apr-2024
    • (2024)PonDeFlick: A Japanese Text Entry on Smartwatch Commonalizing Flick Operation with Smartphone InterfaceProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642569(1-11)Online publication date: 11-May-2024
    • (2024)SimUser: Generating Usability Feedback by Simulating Various Users Interacting with Mobile ApplicationsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642481(1-17)Online publication date: 11-May-2024
    • (2024)Micro Visualizations on a Smartwatch: Assessing Reading Performance While Walking2024 IEEE Visualization and Visual Analytics (VIS)10.1109/VIS55277.2024.00017(46-50)Online publication date: 13-Oct-2024
    • (2023)Investigating In-Situ Personal Health Data Queries on SmartwatchesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35694816:4(1-19)Online publication date: 11-Jan-2023
    • (2023)Towards Efficient Interaction for Personal Health Data Queries on SmartwatchesProceedings of the 25th International Conference on Mobile Human-Computer Interaction10.1145/3565066.3608700(1-7)Online publication date: 26-Sep-2023
    • (2023)Understanding how to Design Health Data Visualizations for Chilean Older Adults on Mobile DevicesProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596109(1309-1324)Online publication date: 10-Jul-2023
    • (2022)One Ring to Rule Them AllProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503156:3(1-20)Online publication date: 7-Sep-2022
    • (2022)Understanding and Adapting Bezel-to-Bezel Interactions for Circular Smartwatches in Mobile and Encumbered ScenariosProceedings of the ACM on Human-Computer Interaction10.1145/35467366:MHCI(1-28)Online publication date: 20-Sep-2022
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media