research-article

Bimanual marking menu for near surface interactions

Authors:

François Guimbretière,

Chau NguyenAuthors Info & Claims

CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 825 - 828

https://doi.org/10.1145/2207676.2208521

Published: 05 May 2012 Publication History

Abstract

We describe a mouseless, near-surface version of the Bimanual Marking Menu system. To activate the menu system, users create a pinch gesture with either their index or middle finger to initiate a left click or right click. Then they mark in the 3D space near the interactive area. We demonstrate how the system can be implemented using a commodity range camera such as the Microsoft Kinect, and report on several designs of the 3D marking system.

Like the multi-touch marking menu, our system offers a large number of accessible commands. Since it does not rely on contact points to operate, our system leaves the non-dominant hand available for other multi-touch interactions.

Supplementary Material

MOV File (paperfile986-3.mov)

Supplemental video for “Bimanual marking menu for near surface interactions”

Download
24.37 MB

References

[1]

Bailly, G., R. Walter, R. Müller, T. Ning, and E. Lecolinet. Comparing free hand menu techniques for distant displays using linear, marking and finger-count menus. Proceedings of IFIP INTERACT'11, pp. 248--262.

Digital Library

[2]

Benko, H. and A. D. Wilson, DepthTouch: Using Depth-Sensing Camera to Enable Freehand Interactions On and Above the Interactive Surface, Microsoft Research, MSR-TR-2009-23, 2009.

[3]

Chen, N., F. Guimbretière, and C. Loeckenhoff, Relative Role of Merging and Two Handed Operation on Command Selection Speed. International Journal of Human-Computer Studies, 2008. 66(10): p. 729--740.

Digital Library

[4]

Dang, C. T., M. Straub, and E. André. Hand distinction for multi-touch tabletop interaction. Proceedings of ITS'09, pp. 101--108.

Digital Library

[5]

Felzenszwalb, P. F. and D. P. Huttenlocher, Efficient Graph-Based Image Segmentation. International Journal of Computer Vision, 2004. 59(2): p. 167--181.

Digital Library

[6]

Grosjean, J., J.-M. Burkhardt, S. Coquillart, and P. Richard. Evaluation of the Command and Control Cube. Proceedings of ICMI'02, pp. 473--479.

Digital Library

[7]

Grossman, T., K. Hinckley, P. Baudisch, M. Agrawala, and R. Balakrishnan. Hover widgets: using the tracking state to extend the capabilities of pen-operated devices. Proceedings of CHI'06, pp. 861--870.

Digital Library

[8]

Grossman, T. and R. Balakrishnan. Collaborative interaction with volumetric displays. Proceedings of CHI'08, pp. 383--392.

Digital Library

[9]

Guimbretière, F. and T. Winograd. FlowMenu: combining command, text, and data entry. Proceedings of UIST'00, pp. 213--216.

Digital Library

[10]

Kurtenbach, G., The Design and Evaluation of Marking Menus. PhD thesis, University of Toronto, 1993.

Digital Library

[11]

Lenman, S., L. Bretzner, and B. Thuresson. Using marking menus to develop command sets for computer vision based hand gesture interfaces. Proceedings of NordiCHI'02, pp. 239--242.

Digital Library

[12]

Lepinski, G. J., T. Grossman, and G. Fitzmaurice. The design and evaluation of multitouch marking menus. Proceedings of CHI'10, pp. 2233--2242.

Digital Library

[13]

Loclair, C., S. Gustafson, and P. Baudisch. PinchWatch: A Wearable Device for One-Handed Microinteractions. Proceedings of MobileHCI'10, Workshop on Ensembles of On-Body Devices, pp. 1--4.

[14]

Matejka, J., T. Grossman, J. Lo, and G. Fitzmaurice. The design and evaluation of multi-finger mouse emulation techniques. Proceedings of CHI'09, pp. 1073--1082.

Digital Library

[15]

Ni, T., R. P. McMahan, and D. A. Bowman. rapMenu: Remote Menu Selection Using Freehand Gestural Input. Proceedings of 3DUI'08, pp. 55--58.

Digital Library

[16]

Odell, D., R. Davis, A. Smith, and P. K. Wright. Toolglasses, Marking Menus, and Hotkeys: A Comparison of One and Two-Handed Command Selection Techniques. Proceedings of GI'04, pp. 17--24.

Digital Library

[17]

Pook, S., E. Lecolinet, G. Vaysseix, and E. Barillot. Control menus: excecution and control in a single interactor. Proceedings of CHI'00 Extended Abstracts, pp. 263--264.

Digital Library

[18]

Tsochantaridis, I., T. Hofmann, T. Joachims, and Y. Altun. Support vector machine learning for interdependent and structured output spaces. Proceedings of ICML'04, pp. 104--111.

Digital Library

[19]

Vijayanandh, R. and G. Balakrishnan. Human face detection using color spaces and region property measures. Proceedings of ICARCV'10, pp. 1605--1610.

[20]

Wang, F., X. Cao, X. Ren, and P. Irani. Detecting and leveraging finger orientation for interaction with directtouch surfaces. Proceedings of UIST'09, pp. 23--32.

Digital Library

[21]

Wang, F. and X. Ren. Empirical evaluation for finger input properties in multi-touch interaction. Proceedings of CHI'09, pp. 1063--1072.

Digital Library

[22]

Wilson, A. D. Robust computer vision-based detection of pinching for one and two-handed gesture input. Proceedings of UIST'06, pp. 255--258.

Digital Library

[23]

Wobbrock, J. O., M. R. Morris, and A. D. Wilson. User-defined gestures for surface computing. Proceedings of CHI'09, pp. 1083--1092.

Digital Library

[24]

Zhao, S. and R. Balakrishnan. Simple vs. compound mark hierarchical marking menus. Proceedings of UIST'04, pp. 33--42.

Digital Library

Cited By

Ji BWang XLiang ZZhang HXia QXie LYan HSun FFeng HTao KShen QYin E(2023)Flexible Strain Sensor-Based Data Glove for Gesture Interaction in the Metaverse: A ReviewInternational Journal of Human–Computer Interaction10.1080/10447318.2023.221223240:21(6793-6812)Online publication date: 19-May-2023
https://doi.org/10.1080/10447318.2023.2212232
Lee LBraud THui P(2023)Embodied Interaction on Constrained Interfaces for Augmented RealitySpringer Handbook of Augmented Reality10.1007/978-3-030-67822-7_10(239-271)Online publication date: 1-Jan-2023
https://doi.org/10.1007/978-3-030-67822-7_10
Matulic FVogel D(2022)Terrain Modelling with a Pen & Touch Tablet and Mid-Air Gestures in Virtual RealityExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519867(1-7)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519867
Show More Cited By

Index Terms

Bimanual marking menu for near surface interactions
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

A framework for bimanual inter-device interactions

A shared interactive display (e.g., a tabletop) provides a large space for collaborative interactions. However, a public display lacks a private space for accessing sensitive information. On the other hand, a mobile device offers a private display and a ...
Enabling beyond-surface interactions for interactive surface with an invisible projection
UIST '10: Proceedings of the 23nd annual ACM symposium on User interface software and technology

This paper presents a programmable infrared (IR) technique that utilizes invisible, programmable markers to support interaction beyond the surface of a diffused-illumination (DI) multi-touch system. We combine an IR projector and a standard color ...
Periphery triggered menus for head mounted menu interface interactions
OzCHI '16: Proceedings of the 28th Australian Conference on Computer-Human Interaction

Interaction with head mounted displays is predominantly through use of additional controllers or the keyboard to initiate pointing, selections, and navigation. However, most modern head mounted displays have an orientation sensor to determine how the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

May 2012

3276 pages

ISBN:9781450310154

DOI:10.1145/2207676

General Chair:
Joseph A. Konstan
University of Minnesota
,
Program Chairs:
Ed H. Chi
Google
,
Kristina Höök
Mobile Life at KTH

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 May 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '12

Sponsor:

SIGCHI

CHI '12: CHI Conference on Human Factors in Computing Systems

May 5 - 10, 2012

Texas, Austin, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
830
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)1

Reflects downloads up to 16 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Ji BWang XLiang ZZhang HXia QXie LYan HSun FFeng HTao KShen QYin E(2023)Flexible Strain Sensor-Based Data Glove for Gesture Interaction in the Metaverse: A ReviewInternational Journal of Human–Computer Interaction10.1080/10447318.2023.221223240:21(6793-6812)Online publication date: 19-May-2023
https://doi.org/10.1080/10447318.2023.2212232
Lee LBraud THui P(2023)Embodied Interaction on Constrained Interfaces for Augmented RealitySpringer Handbook of Augmented Reality10.1007/978-3-030-67822-7_10(239-271)Online publication date: 1-Jan-2023
https://doi.org/10.1007/978-3-030-67822-7_10
Matulic FVogel D(2022)Terrain Modelling with a Pen & Touch Tablet and Mid-Air Gestures in Virtual RealityExtended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491101.3519867(1-7)Online publication date: 27-Apr-2022
https://dl.acm.org/doi/10.1145/3491101.3519867
Veras RSingh GFarhadi-Niaki FUdhani RPatekar PZhou WIrani PLi WKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Elbow-Anchored Interaction: Designing Restful Mid-Air InputProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445546(1-15)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445546
Nanjappan VLiang HLu FPapangelis KYue YMan K(2018)User-elicited dual-hand interactions for manipulating 3D objects in virtual reality environmentsHuman-centric Computing and Information Sciences10.1186/s13673-018-0154-58:1(1-16)Online publication date: 1-Dec-2018
https://dl.acm.org/doi/10.1186/s13673-018-0154-5
Lee LHui P(2018)Interaction Methods for Smart Glasses: A SurveyIEEE Access10.1109/ACCESS.2018.28310816(28712-28732)Online publication date: 2018
https://doi.org/10.1109/ACCESS.2018.2831081
Dubois ERaynal MSerrano M(2017)Taking advantage of rolling gestures on a multidimensionnal mouse for interacting with a menubarProceedings of the 29th Conference on l'Interaction Homme-Machine10.1145/3132129.3132131(83-92)Online publication date: 29-Aug-2017
https://dl.acm.org/doi/10.1145/3132129.3132131
Lin SCheng HLi WHuang ZHui PPeylo C(2017)UbiiIEEE Transactions on Mobile Computing10.1109/TMC.2016.256737816:3(872-885)Online publication date: 1-Mar-2017
https://dl.acm.org/doi/10.1109/TMC.2016.2567378
Bailly GLecolinet ENigay L(2016)Visual Menu TechniquesACM Computing Surveys10.1145/300217149:4(1-41)Online publication date: 12-Dec-2016
https://dl.acm.org/doi/10.1145/3002171
Bordegoni MCovarrubias MCaruso GCugini U(2016)Freehand Gesture and Tactile Interaction for Shape DesignJournal of Computing and Information Science in Engineering10.1115/1.403323016:4Online publication date: 7-Nov-2016
https://doi.org/10.1115/1.4033230
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents