research-article

PalmSpace: continuous around-device gestures vs. multitouch for 3D rotation tasks on mobile devices

Authors:

Michael NischtAuthors Info & Claims

AVI '12: Proceedings of the International Working Conference on Advanced Visual Interfaces

Pages 181 - 188

https://doi.org/10.1145/2254556.2254590

Published: 21 May 2012 Publication History

Abstract

Rotating 3D objects is a difficult task on mobile devices, because the task requires 3 degrees of freedom and (multi-)touch input only allows for an indirect mapping. We propose a novel style of mobile interaction based on mid-air gestures in proximity of the device to increase the number of DOFs and alleviate the limitations of touch interaction with mobile devices. While one hand holds the device, the other hand performs mid-air gestures in proximity of the device to control 3D objects on the mobile device's screen. A flat hand pose defines a virtual surface which we refer to as the PalmSpace for precise and intuitive 3D rotations. We constructed several hardware prototypes to test our interface and to simulate possible future mobile devices equipped with depth cameras. We conducted a user study to compare 3D rotation tasks using the most promising two designs for the hand location during interaction -- behind and beside the device -- with the virtual trackball, which is the current state-of-art technique for orientation manipulation on touch-screens. Our results show that both variants of PalmSpace have significantly lower task completion times in comparison to the virtual trackball.

References

[1]

G. Bailly, J. Müeller, M. Rohs, D. Wigdor, and S. Kratz. Shoesense: Shoesense: A new perspective on hand gestures and wearable applications. In Proceedings of the SIGCHI conference on human factors in computing systems (CHI 2012). ACM, 2012.

Digital Library

[2]

A. Butler, S. Izadi, and S. Hodges. SideSight: Multi-touch interaction around small devices. In Proc. UIST, pages 201--204, 2008.

Digital Library

[3]

M. A. Fischler and R. C. Bolles. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM, 24(6):381--395, 1981.

Digital Library

[4]

E. Grandjean. Fitting the task to the man: A textbook of occupational ergonomics. Taylor & Francis/Hemisphere, 1989.

Digital Library

[5]

M. Hachet, J. Pouderoux, and P. Guitton. A camera-based interface for interaction with mobile handheld computers. In Proc. Symp. Interactive 3D Graphics and Games, pages 65--72, 2005.

Digital Library

[6]

C. Harrison and S. E. Hudson. Abracadabra: Wireless, high-precision, and unpowered finger input for very small mobile devices. In Proc. UIST, pages 121--124, 2009.

Digital Library

[7]

K. Henriksen, J. Sporring, and K. Hornbæk. Virtual trackballs revisited. IEEE Transactions on Visualization and Computer Graphics, 10(2):206--216, 2004.

Digital Library

[8]

D. Huynh. Metrics for 3D rotations: Comparison and analysis. Journal of Mathematical Imaging and Vision, 35(2):155--164, 2009.

Digital Library

[9]

ISO. Ergonomic requirements for office work with visual display terminals (vdts) - part 9: Requirements for non-keyboard input devices. In International Organization for Standardization, ISO/DIS 9241--9, 2000.

[10]

H. Ketabdar, K. Yüksel, and M. Roshandel. MagiTact: Interaction with mobile devices based on compass (magnetic) sensor. In Proceedings of the 15th international conference on Intelligent user interfaces, pages 413--414. ACM, 2010.

Digital Library

[11]

E. Kollorz, J. Penne, J. Hornegger, and A. Barke. Gesture recognition with a time-of-flight camera. Int. J. of Intelligent Systems Technologies and Applications, 5(3):334--343, 2008.

Digital Library

[12]

S. Kratz and M. Rohs. HoverFlow: Expanding the design space of around-device interaction. In Proc. MobileHCI, pages 31--38, 2009.

Digital Library

[13]

S. Kratz and M. Rohs. Extending the virtual trackball metaphor to rear touch input. In 3D User Interfaces (3DUI), 2010 IEEE Symposium on, pages 111--114. IEEE, 2010.

Digital Library

[14]

NASA. Man-Systems Integration Standards. Rev. B, 1995.

[15]

I. Oakley and S. O'Modhrain. Tilt to Scroll: Evaluating a Motion Based Vibrotactile Mobile Interface. In IEEE Proceedings of the World Haptics Conference, Pisa, Italy, 2005.

Digital Library

[16]

V. Pavlovic, R. Sharma, and T. Huang. Visual interpretation of hand gestures for human-computer interaction: A review. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 19(7):677--695, 1997.

Digital Library

[17]

M. Rahman, S. Gustafson, P. Irani, and S. Subramanian. Tilt techniques: Investigating the dexterity of wrist-based input. In Proceedings of the 27th international conference on Human factors in computing systems, pages 1943--1952. ACM, 2009.

Digital Library

[18]

R. B. Rusu and S. Cousins. 3D is here: Point Cloud Library (PCL). In IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China, May 9--13 2011.

[19]

K. Siek, Y. Rogers, and K. Connelly. Fat finger worries: How older and younger users physically interact with pdas. Human-Computer Interaction-INTERACT 2005, pages 267--280, 2005.

Digital Library

[20]

G. Turk and M. Levoy. Zippered polygon meshes from range images. In Proceedings of the 21st annual conference on Computer graphics and interactive techniques, pages 311--318, 1994.

Digital Library

[21]

D. Vogel and P. Baudisch. Shift: A technique for operating pen-based interfaces using touch. In Proceedings of the SIGCHI conference on Human factors in computing systems, pages 657--666. ACM, 2007.

Digital Library

[22]

D. Wigdor, C. Forlines, P. Baudisch, J. Barnwell, and C. Shen. LucidTouch: A see-through mobile device. In Proc. UIST, pages 269--278, 2007.

Digital Library

Cited By

Sun WHuang MWu CYang RYue YJiang M(2024)Tangible and Mid-Air Interactions in Hand-Held Augmented Reality for Upper Limb Rehabilitation: An Evaluation of User Experience and Motor PerformanceInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2342089(1-18)Online publication date: 8-May-2024
https://doi.org/10.1080/10447318.2024.2342089
Nath PDelamare WHasan K(2024)PalmSpaceInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103219184:COnline publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103219
Hosseini MIhmels TChen ZKoelle MMüller HBoll S(2023)Towards a Consensus Gesture Set: A Survey of Mid-Air Gestures in HCI for Maximized Agreement Across DomainsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581420(1-24)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581420
Show More Cited By

Index Terms

PalmSpace: continuous around-device gestures vs. multitouch for 3D rotation tasks on mobile devices
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
    2. Interaction paradigms

Recommendations

Ether-Toolbars: Evaluating Off-Screen Toolbars for Mobile Interaction
IUI '18 Companion: Companion Proceedings of the 23rd International Conference on Intelligent User Interfaces

In mobile interaction, the use of touchscreen interaction, while beneficial from the perspective of portability, has limited spatial accuracy due to the "fat finger problem". As a result, an important challenge on mobile interaction is to find solutions ...
Designing gestures for mobile 3D gaming
MUM '12: Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia

In the last years 3D is getting more and more popular. Besides the increasing number of movies for 3D stereoscopic cinemas and television, serious steps have also been undertaken in the field of 3D gaming. Games with stereoscopic 3D output are now ...
Exploring 3D manipulation on large stereoscopic displays
PerDis '16: Proceedings of the 5th ACM International Symposium on Pervasive Displays

In the last years stereoscopic 3D has seen a drastic increase in popularity especially in terms of consumer-ready hardware and software. While the technology for input (smart-phone, Kinect, etc.) as well as output (passive/active stereoscopic and auto-...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

AVI '12: Proceedings of the International Working Conference on Advanced Visual Interfaces

May 2012

846 pages

ISBN:9781450312875

DOI:10.1145/2254556

Editors:
Genny Tortora
Università di Salerno, Italy
,
Stefano Levialdi
Sapienza Università di Roma, Italy
,
Maurizio Tucci
Università di Salerno, Italy

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Consulta Umbria SRL
University of Salerno: University of Salerno

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 May 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

AVI'12

Sponsor:

University of Salerno

AVI'12: International Working Conference on Advanced Visual Interfaces

May 21 - 25, 2012

Capri Island, Italy

Acceptance Rates

Overall Acceptance Rate 128 of 490 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

41
Total Citations
View Citations
810
Total Downloads

Downloads (Last 12 months)27
Downloads (Last 6 weeks)3

Reflects downloads up to 11 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sun WHuang MWu CYang RYue YJiang M(2024)Tangible and Mid-Air Interactions in Hand-Held Augmented Reality for Upper Limb Rehabilitation: An Evaluation of User Experience and Motor PerformanceInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2342089(1-18)Online publication date: 8-May-2024
https://doi.org/10.1080/10447318.2024.2342089
Nath PDelamare WHasan K(2024)PalmSpaceInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103219184:COnline publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103219
Hosseini MIhmels TChen ZKoelle MMüller HBoll S(2023)Towards a Consensus Gesture Set: A Survey of Mid-Air Gestures in HCI for Maximized Agreement Across DomainsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581420(1-24)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581420
Shen VHarrison C(2022)Pull Gestures with Coordinated Graphics on Dual-Screen DevicesProceedings of the 2022 International Conference on Multimodal Interaction10.1145/3536221.3556620(270-277)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3536221.3556620
Koreng RKrömker H(2021)User Interface Pattern for AR in Industrial ApplicationsInformation10.3390/info1206025112:6(251)Online publication date: 16-Jun-2021
https://doi.org/10.3390/info12060251
Besançon LYnnerman AKeefe DYu LIsenberg T(2021)The State of the Art of Spatial Interfaces for 3D VisualizationComputer Graphics Forum10.1111/cgf.1418940:1(293-326)Online publication date: 6-Jan-2021
https://doi.org/10.1111/cgf.14189
Menzner TGesslein TOtte AGrubert J(2020)Above Surface Interaction for Multiscale Navigation in Mobile Virtual Reality2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR46266.2020.1581107639032(372-381)Online publication date: Mar-2020
https://doi.org/10.1109/VR46266.2020.1581107639032
Menzner TGesslein TOtte AGrubert J(2020)Above Surface Interaction for Multiscale Navigation in Mobile Virtual Reality2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR46266.2020.00057(372-381)Online publication date: Mar-2020
https://doi.org/10.1109/VR46266.2020.00057
Büschel WMitschick AMeyer TDachselt R(2019)Investigating Smartphone-based Pan and Zoom in 3D Data Spaces in Augmented RealityProceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/3338286.3340113(1-13)Online publication date: 1-Oct-2019
https://dl.acm.org/doi/10.1145/3338286.3340113
Goh ESunar MIsmail A(2019)3D Object Manipulation Techniques in Handheld Mobile Augmented Reality Interface: A ReviewIEEE Access10.1109/ACCESS.2019.29063947(40581-40601)Online publication date: 2019
https://doi.org/10.1109/ACCESS.2019.2906394
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents