Extending the Interaction Space of Rotary Knobs by Multi-touch-based Grasp Recognition
Pages 198 - 209
Abstract
Rotary knobs are widely used input devices for computers, household appliances, cars and other machinery. So far, their input capabilities are limited since the rotation of a knob only controls one single parameter. This paper presents the concept of a rotary knob that is capable of recognizing a user’s grasp for controlling different parameters, called MultiKnob. We contribute the hardware and software of a knob for detecting how many fingers are used when touching it. It uses IR light and FTIR-based multi-touch recognition. Within a target acquisition study, we used this new feature for allowing users to select the speed of a cursor for solving tasks. We found that users are able to leverage this novel device: Our 24 participants could make use of this new knob for being faster when moving a cursor into a target area compared to a fixed slow speed knob, and having less overshoots compared to a fixed fast speed knob. Further, we found that the MultiKnob gave rise to the strategy of changing grasp for switching from a fast and coarse-grained cursor movement to a slow and fine-grained cursor movement. We discuss different applications for using such a knob.
Supplementary Material
Video of the MultiKnob in action.
- Download
- 83.23 MB
References
[1]
Gilles Bailly, Jörg Müller, and Eric Lecolinet. 2012. Design and Evaluation of Finger-Count Interaction: Combining Multitouch Gestures and Menus. International Journal of Human-Computer Studies 70, 10 (Oct. 2012), 673–689. https://doi.org/10.1016/j.ijhcs.2012.05.006
[2]
Emeline Brulé, Gilles Bailly, Marcos Serrano, Marc Teyssier, and Samuel Huron. 2017. Investigating the Design Space of Smartwatches Combining Physical Rotary Inputs. In Proceedings of the 29th Conference on l’Interaction Homme-Machine(IHM ’17). Association for Computing Machinery, New York, NY, USA, 13–20. https://doi.org/10.1145/3132129.3132139
[3]
Yuri De Pra, Federico Fontana, Hanna Järveläinen, Stefano Papetti, Matteo Bianchi, and Mauro Sonego. 2022. Evaluation of Rotation Gestures in Rotary vs. Motionless Knobs. In 2022 IEEE Haptics Symposium (HAPTICS). IEEE, Santa Barbara, CA, USA, 1–6. https://doi.org/10.1109/HAPTICS52432.2022.9765608
[4]
Yuri De Pra, Federico Fontana, and Stefano Papetti. 2021. Endless Knob with Programmable Resistive Force Feedback. In Human-Computer Interaction – INTERACT 2021(Lecture Notes in Computer Science), Carmelo Ardito, Rosa Lanzilotti, Alessio Malizia, Helen Petrie, Antonio Piccinno, Giuseppe Desolda, and Kori Inkpen (Eds.). Springer International Publishing, Cham, 580–589. https://doi.org/10.1007/978-3-030-85610-6_32
[5]
Yuri De Pra, Federico Fontana, Stefano Papetti, and Michele Simonato. 2020. A Low-Cost Endless Knob Controller with Programmable Resistive Force Feedback for Multimedia Production. In Proceedings of the 17th Sound and Music Computing Conference (SMC 2020). Axea sas/SMC Network, Torino, Italy, 242––246.
[6]
David Dobbelstein, Marcel Walch, Andreas Köll, Ömer Şahin, Tamino Hartmann, and Enrico Rukzio. 2016. Reducing In-Vehicle Interaction Complexity: Gaze-Based Mapping of a Rotary Knob to Multiple Interfaces. In Proceedings of the 15th International Conference on Mobile and Ubiquitous Multimedia(MUM ’16). Association for Computing Machinery, New York, NY, USA, 311–313. https://doi.org/10.1145/3012709.3016064
[7]
Thomas Feix, Ian M. Bullock, Yuri Gloumakov, and Aaron M. Dollar. 2015. Rotational Ranges of Human Precision Manipulation When Grasping Objects with Two to Five Digits. In 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, Milan, Italy, 5785–5790. https://doi.org/10.1109/EMBC.2015.7319707
[8]
Thomas Feix, Javier Romero, Heinz-Bodo Schmiedmayer, Aaron M. Dollar, and Danica Kragic. 2016. The GRASP Taxonomy of Human Grasp Types. IEEE Transactions on Human-Machine Systems 46, 1 (Feb. 2016), 66–77. https://doi.org/10.1109/THMS.2015.2470657
[9]
Edgar Gellert, David Petersen, and Matthias Böhmer. 2022. MultiKnob — A Knob for Multiplexing Rotation Inputs by Multitouch-based Grasp Recognition. In Proceedings of Mensch Und Computer 2022(MuC ’22). Association for Computing Machinery, New York, NY, USA, 483–487. https://doi.org/10.1145/3543758.3547561
[10]
Jan Gugenheimer, Florian Schaub, Gregory M. Neiswander, Eromi Guneratne, and Michael Weber. 2014. User Authentication for Rotary Knob Controlled In-car Applications. In Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications(AutomotiveUI ’14). Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/2667317.2667338
[11]
N. Gurari and A. M. Okamura. 2007. Human Performance in a Knob-Turning Task. In Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC’07). IEEE, Tsukuba, Japan, 96–101. https://doi.org/10.1109/WHC.2007.71
[12]
Jefferson Y. Han. 2005. Low-Cost Multi-Touch Sensing through Frustrated Total Internal Reflection. In Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology (Seattle, WA, USA) (UIST ’05). Association for Computing Machinery, New York, NY, USA, 115–118. https://doi.org/10.1145/1095034.1095054
[13]
Otmar Hilliges, Dominikus Baur, and Andreas Butz. 2007. Photohelix: Browsing, Sorting and Sharing Digital Photo Collections. In Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP’07). IEEE, Newport, RI, USA, 87–94. https://doi.org/10.1109/TABLETOP.2007.14
[14]
Hyunyoung Kim, Céline Coutrix, and Anne Roudaut. 2018. KnobSlider: Design of a Shape-Changing UI for Parameter Control. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–13.
[15]
Hyunyoung Kim, Céline Coutrix, and Anne Roudaut. 2019. KnobSlider: Design of a Shape-Changing Parameter Control UI and Study of User Preferences on Its Speed and Tangibility. Frontiers in Robotics and AI 6 (2019), 1–19. https://doi.org/10.3389/frobt.2019.00079
[16]
Hyunyoung Kim, Patrícia Deud Guimarães, Céline Coutrix, and Anne Roudaut. 2019. ExpanDial: Designing a Shape-Changing Dial. In Proceedings of the 2019 on Designing Interactive Systems Conference(DIS ’19). Association for Computing Machinery, New York, NY, USA, 949–961. https://doi.org/10.1145/3322276.3322283
[17]
Mathias Kirkegaard, Mathias Bredholt, Christian Frisson, and M. Wanderley. 2020. TorqueTuner: A Self Contained Module for Designing Rotary Haptic Force Feedback for Digital Musical Instruments. In Proceedings of the 2020 International Conference on New Interfaces for Musical Expression (NIME 2020). Zenodo, Birmingham, UK, 273––278. https://doi.org/10.5281/zenodo.4813359
[18]
Konstantin Klamka, Jannik Wojnar, and Raimund Dachselt. 2019. ScaleDial: A Novel Tangible Device for Teaching Musical Scales & Triads. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems(CHI EA ’19). Association for Computing Machinery, New York, NY, USA, 1–4. https://doi.org/10.1145/3290607.3313238
[19]
Kathrin Krieger, Alexandra Moringen, and Helge Ritter. 2019. Number of Fingers and Grasping Orientation Influence Human Performance During Haptic Rotation. In 2019 IEEE World Haptics Conference (WHC). IEEE, Tokyo, Japan, 79–84. https://doi.org/10.1109/WHC.2019.8816096
[20]
J. M. F. Landsmeer. 1962. Power Grip and Precision Handling. Annals of the Rheumatic Diseases 21, 2 (June 1962), 164–170.
[21]
G. Julian Lepinski, Tovi Grossman, and George Fitzmaurice. 2010. The Design and Evaluation of Multitouch Marking Menus. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’10). Association for Computing Machinery, New York, NY, USA, 2233–2242. https://doi.org/10.1145/1753326.1753663
[22]
J. R. Napier. 1956. The Prehensile Movements of the Human Hand. The Journal of Bone and Joint Surgery. British volume 38-B, 4 (Nov. 1956), 902–913. https://doi.org/10.1302/0301-620X.38B4.902
[23]
Keunwoo Park, Daehwa Kim, Seongkook Heo, and Geehyuk Lee. 2020. MagTouch: Robust Finger Identification for a Smartwatch Using a Magnet Ring and a Built-in Magnetometer. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems(CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376234
[24]
Munehiko Sato, Ivan Poupyrev, and Chris Harrison. 2012. Touché: Enhancing Touch Interaction on Humans, Screens, Liquids, and Everyday Objects. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’12). Association for Computing Machinery, New York, NY, USA, 483–492. https://doi.org/10.1145/2207676.2207743
[25]
Stefan Schneegaß, Bastian Pfleging, Dagmar Kern, and Albrecht Schmidt. 2011. Support for Modeling Interaction with Automotive User Interfaces. In Proceedings of the 3rd International Conference on Automotive User Interfaces and Interactive Vehicular Applications(AutomotiveUI ’11). Association for Computing Machinery, New York, NY, USA, 71–78. https://doi.org/10.1145/2381416.2381428
[26]
Johannes Schöning, Peter Brandl, Florian Daiber, Florian Echtler, Otmar Hilliges, Jonathan Hook, Markus Löchtefeld, Nima Motamedi, Laurence Muller, Patrick Olivier, 2008. Multi-touch surfaces: A technical guide.
[27]
Johannes Schöning, Jonathan Hook, Nima Motamedi, Patrick Olivier, Florian Echtler, Peter Brandl, Laurence Muller, Florian Daiber, Otmar Hilliges, Markus Loechtefeld, Tim Roth, Dominik Schmidt, and Ulrich von Zadow. 2009. Building Interactive Multi-Touch Surfaces. Journal of Graphics, GPU, and Game Tools 14, 3 (Jan. 2009), 35–55. https://doi.org/10.1080/2151237X.2009.10129285
[28]
Anke van Oosterhout, Miguel Bruns Alonso, and Satu Jumisko-Pyykkö. 2018. Ripple Thermostat: Affecting the Emotional Experience through Interactive Force Feedback and Shape Change. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3174229
[29]
Anke van Oosterhout and Eve Hoggan. 2020. Reshaping Interaction with Rotary Knobs: Combining Form, Feel and Function. In Proceedings of the 2020 ACM Designing Interactive Systems Conference. Association for Computing Machinery, New York, NY, USA, 1973–1982.
[30]
Anke van Oosterhout, Eve Hoggan, Majken Kirkegaard Rasmussen, and Miguel Bruns. 2019. DynaKnob: Combining Haptic Force Feedback and Shape Change. In Proceedings of the 2019 on Designing Interactive Systems Conference(DIS ’19). Association for Computing Machinery, New York, NY, USA, 963–974. https://doi.org/10.1145/3322276.3322321
[31]
Nicolas Villar, Shahram Izadi, Dan Rosenfeld, Hrvoje Benko, John Helmes, Jonathan Westhues, Steve Hodges, Eyal Ofek, Alex Butler, Xiang Cao, and Billy Chen. 2009. Mouse 2.0: Multi-Touch Meets the Mouse. In Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology(UIST ’09). Association for Computing Machinery, New York, NY, USA, 33–42. https://doi.org/10.1145/1622176.1622184
[32]
Simon Voelker, Christian Corsten, Nur Al-huda Hamdan, Kjell Ivar Øvergård, and Jan Borchers. 2014. An Interaction Model for Grasp-Aware Tangibles on Interactive Surfaces. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces(ITS ’14). Association for Computing Machinery, New York, NY, USA, 279–282. https://doi.org/10.1145/2669485.2669494
[33]
Simon Voelker, Kjell Ivar Øvergård, Chat Wacharamanotham, and Jan Borchers. 2015. Knobology Revisited: A Comparison of User Performance between Tangible and Virtual Rotary Knobs. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces(ITS ’15). Association for Computing Machinery, New York, NY, USA, 35–38. https://doi.org/10.1145/2817721.2817725
[34]
HyeonBeom Yi, Jiwoo Hong, Hwan Kim, and Woohun Lee. 2019. DexController : Designing a VR Controller with Grasp-Recognition for Enriching Natural Game Experience. In Proceedings of the 25th ACM Symposium on Virtual Reality Software and Technology(VRST ’19). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3359996.3364263
Index Terms
- Extending the Interaction Space of Rotary Knobs by Multi-touch-based Grasp Recognition
Recommendations
MultiKnob — A Knob for Multiplexing Rotation Inputs by Multitouch-based Grasp Recognition
MuC '22: Proceedings of Mensch und Computer 2022Rotary knobs are used on many devices. However, while we enrich the functionalities of smart devices, controlling such functionalities by using the rotation as sole input appears to be rather limited. Therefore, we created a physical rotary controller ...
Touch projector: mobile interaction through video
CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsIn 1992, Tani et al. proposed remotely operating machines in a factory by manipulating a live video image on a computer screen. In this paper we revisit this metaphor and investigate its suitability for mobile use. We present Touch Projector, a system ...
Hand distinction for multi-touch tabletop interaction
ITS '09: Proceedings of the ACM International Conference on Interactive Tabletops and SurfacesRecent multi-touch multi-user tabletop systems offer rich touch contact properties to applications. Not only they provide touch positions, but also finger orientations. Applications can use these properties separated for each finger or derive ...
Comments
Information & Contributors
Information
Published In
December 2023
607 pages
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 03 December 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- German Federal Ministry for Economic Affairs and Climate Action
Conference
MUM '23
MUM '23: International Conference on Mobile and Ubiquitous Multimedia
December 3 - 6, 2023
Vienna, Austria
Acceptance Rates
Overall Acceptance Rate 190 of 465 submissions, 41%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 127Total Downloads
- Downloads (Last 12 months)111
- Downloads (Last 6 weeks)9
Reflects downloads up to 16 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format