research-article

Press-n-Paste: Copy-and-Paste Operations with Pressure-sensitive Caret Navigation for Miniaturized Surface in Mobile Augmented Reality

Authors:

Susanna PirttikangasAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 5, Issue EICS

Article No.: 199, Pages 1 - 29

https://doi.org/10.1145/3457146

Published: 29 May 2021 Publication History

Abstract

Copy-and-paste operations are the most popular features on computing devices such as desktop computers, smartphones and tablets. However, the copy-and-paste operations are not sufficiently addressed on the Augmented Reality (AR) smartglasses designated for real-time interaction with texts in physical environments. This paper proposes two system solutions, namely Granularity Scrolling (GS) and Two Ends (TE), for the copy-and-paste operations on AR smartglasses. By leveraging a thumb-size button on a touch-sensitive and pressure-sensitive surface, both the multi-step solutions can capture the target texts through indirect manipulation and subsequently enables the copy-and-paste operations. Based on the system solutions, we implemented an experimental prototype named Press-n-Paste (PnP). After the eight-session evaluation capturing 1,296 copy-and-paste operations, 18 participants with GS and TE achieve the peak performance of 17,574 ms and 13,951 ms per copy-and-paste operation, with 93.21% and 98.15% accuracy rates respectively, which are as good as the commercial solutions using direct manipulation on touchscreen devices. The user footprints also show that PnP has a distinctive feature of miniaturized interaction area within 12.65 mm * 14.48 mm. PnP not only proves the feasibility of copy-and-paste operations with the flexibility of various granularities on AR smartglasses, but also gives significant implications to the design space of pressure widgets as well as the input design on smart wearables.

References

[1]

Toshiyuki Ando, Toshiya Isomoto, Buntarou Shizuki, and Shin Takahashi. 2018. Press Tilt: One-Handed Text Selection and Command Execution on Smartphone. In Proceedings of the 30th Australian Conference on Computer-Human Interaction (OzCHI '18). Association for Computing Machinery, New York, NY, USA, 401--405. https://doi.org/10.1145/3292147.3292178

Digital Library

[2]

Axel Antoine, Sylvain Malacria, and Géry Casiez. 2017. ForceEdge: Controlling Autoscroll on Both Desktop and Mobile Computers Using the Force. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). Association for Computing Machinery, New York, NY, USA, 3281--3292. https://doi.org/10.1145/3025453.3025605

Digital Library

[3]

Shiri Azenkot and Nicole B. Lee. 2013. Exploring the Use of Speech Input by Blind People on Mobile Devices. In Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '13). Association for Computing Machinery, New York, NY, USA, Article Article 11, 8 pages. https://doi.org/10.1145/2513383.2513440

Digital Library

[4]

Daniel Buschek, Alexander De Luca, and Florian Alt. 2015. Improving Accuracy, Applicability and Usability of Keystroke Biometrics on Mobile Touchscreen Devices. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). Association for Computing Machinery, New York, NY, USA, 1393--140 https://doi.org/10.1145/2702123.2702252

Digital Library

[5]

Olivier Chapuis and Nicolas Roussel. 2007. Copy-and-Paste between Overlapping Windows. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). Association for Computing Machinery, New York, NY, USA, 201--210. https://doi.org/10.1145/1240624.1240657

Digital Library

[6]

Chen Chen, Simon T. Perrault, Shengdong Zhao, and Wei Tsang Ooi. 2014. BezelCopy: An Efficient Cross-Application Copy-Paste Technique for Touchscreen Smartphones. In Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces (AVI '14). Association for Computing Machinery, New York, NY, USA, 185--192. https://doi.org/10.1145/2598153.2598162

Digital Library

[7]

Christian Corsten, Marcel Lahaye, Jan Borchers, and Simon Voelker. 2019. ForceRay: Extending Thumb Reach via Force Input Stabilizes Device Grip for Mobile Touch Input. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). Association for Computing Machinery, New York, NY, USA, Article Paper 212, 12 pages. https://doi.org/10.1145/3290605.3300442

Digital Library

[8]

Christian Corsten, Simon Voelker, and Jan Borchers. 2017. Release, Don't Wait! Reliable Force Input Confirmation with Quick Release. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (ISS '17). Association for Computing Machinery, New York, NY, USA, 246--251. https://doi.org/10.1145/3132272.3134116

Digital Library

[9]

Vittorio Fuccella, Poika Isokoski, and Benoit Martin. 2013. Gestures and Widgets: Performance in Text Editing on Multi-Touch Capable Mobile Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). Association for Computing Machinery, New York, NY, USA, 2785--2794. https://doi.org/10.1145/2470654.2481385

Digital Library

[10]

Alix Goguey, Sylvain Malacria, and Carl Gutwin. 2018. Improving Discoverability and Expert Performance in Force-Sensitive Text Selection for Touch Devices with Mode Gauges. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Association for Computing Machinery, New York, NY, USA, Article Paper 477, 12 pages. https://doi.org/10.1145/3173574.3174051

Digital Library

[11]

Yizheng Gu, Chun Yu, Zhipeng Li, Weiqi Li, Shuchang Xu, Xiaoying Wei, and Yuanchun Shi. 20Accurate and Low-Latency Sensing of Touch Contact on Any Surface with Finger-Worn IMU Sensor. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (UIST '19). Association for Computing Machinery, New York, NY, USA, 1059--1070. https://doi.org/10.1145/3332165.3347947

Digital Library

[12]

Seongkook Heo and Geehyuk Lee. 2011. Force Gestures: Augmenting Touch Screen Gestures with Normal and Tangential Forces. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). Association for Computing Machinery, New York, NY, USA, 621--626. https://doi.org/10.1145/2047196.2047278

Digital Library

[13]

Jonggi Hong and Leah Findlater. 2018. Identifying Speech Input Errors Through Audio-Only Interaction. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Association for Computing Machinery, New York, NY, USA, Article Paper 567, 12 pages. https://doi.org/10.1145/3173574.3174141

Digital Library

[14]

Eva Hornecker. 2012. Beyond Affordance: Tangibles' Hybrid Nature. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction (TEI '12). Association for Computing Machinery, New York, NY, USA, 175--182. https://doi.org/10.1145/2148131.2148168

Digital Library

[15]

Weiyang Huan, Huawei Tu, and Zhuying Li. 2019. Enabling Finger Pointing Based Text Selection on Touchscreen Mobile Devices. In Proceedings of the Seventh International Symposium of Chinese CHI (Chinese CHI '19). Association for Computing Machinery, New York, NY, USA, 93--96. https://doi.org/10.1145/3332169.3332172

Digital Library

[16]

NASA AMES Research Center Human Performance Research Group. 1999. NASA Task Load Index (TLX). https://humansystems.arc.nasa.gov/groups/TLX/downloads/TLX.pdf

[17]

Kaori Ikematsu and Itiro Siio. 2013. Memory Stones: An Intuitive Copy-and-Paste Method between Multi-Touch Computers. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (CHI EA '13). Association for Computing Machinery, New York, NY, USA, 1287--1292. https://doi.org/10.1145/2468356.2468586

Digital Library

[18]

Howell Istance, Richard Bates, Aulikki Hyrskykari, and Stephen Vickers. 2008. Snap Clutch, a Moded Approach to Solving the Midas Touch Problem. Eye Tracking Research and Applications Symposium (ETRA), 221--228. https://doi.org/10.1145/1344471.1344523

Digital Library

[19]

Ricardo Jota, Albert Ng, Paul Dietz, and Daniel Wigdor. 2013. How Fast is Fast Enough? A Study of the Effects of Latency in Direct-Touch Pointing Tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). Association for Computing Machinery, New York, NY, USA, 2291--2300. https://doi.org/10.1145/2470654.2481317

Digital Library

[20]

R. Kishi and T. Hayashi. 2015. Effective gazewriting with support of text copy and paste. In 2015 IEEE/ACIS 14th International Conference on Computer and Information Science (ICIS). 125--130. https://doi.org/10.1109/ICIS.2015.7166581

[21]

Abinaya Kumar, Aishwarya Radjesh, Sven Mayer, and Huy Viet Le. 2019. Improving the Input Accuracy of Touchscreens Using Deep Learning. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA '19). Association for Computing Machinery, New York, NY, USA, Article Paper LBW1514, 6 pages. https://doi.org/10.1145/3290607.3312928

Digital Library

[22]

Jianwei Lai, Navid Rajabi, and Elahe Javadi. 2019. A Shortcut for Caret Positioning on Touch-Screen Phones. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '19). Association for Computing Machinery, New York, NY, USA, Article Article 35, 6 pages. https://doi.org/10.1145/3338286.3340146

Digital Library

[23]

K. Y. Lam, L. H. Lee, T. Braud, and P. Hui. 2019. M2A: A Framework for Visualizing Information from Mobile Web to Mobile Augmented Reality. In 2019 IEEE International Conference on Pervasive Computing and Communications (PerCom. 1--10. https://doi.org/10.1109/ PERCOM.2019.8767388

[24]

Felix Lauber, Anna Follmann, and Andreas Butz. 2014. What You See is What You Touch: Visualizing Touch Screen Interaction in the Head-up Display. In Proceedings of the 2014 Conference on Designing Interactive Systems (DIS '14). Association for Computing Machinery, New York, NY, USA, 171--180. https://doi.org/10.1145/2598510.2598521

Digital Library

[25]

L. Lee and P. Hui. 2018. Interaction Methods for Smart Glasses: A Survey. IEEE Access 6 (2018), 28712--28732. https://doi.org/10.1109/ ACCESS.2018.2831081

[26]

Lik Hang Lee, Tristan Braud, Farshid Hassani Bijarbooneh, and Pan Hui. 2019. TiPoint: Detecting Fingertip for Mid-Air Interaction on Computational Resource Constrained Smartglasses. In Proceedings of the 23rd International Symposium on Wearable Computers (ISWC '19). Association for Computing Machinery, New York, NY, USA, 118--12 https://doi.org/10.1145/3341163.3347723

Digital Library

[27]

Lik Hang Lee, Kit Yung Lam, Tong Li, Tristan Braud, Xiang Su, and Pan Hui. 2019. Quadmetric Optimized Thumb-to-Finger Interaction for Force Assisted One-Handed Text Entry on Mobile Headsets. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 3, Article Article 94 (Sept. 2019), 27 pages. https://doi.org/10.1145/3351252

Digital Library

[28]

L. H. Lee, K. Yung Lam, Y. P. Yau, T. Braud, and P. Hui. 2019. HIBEY: Hide the Keyboard in Augmented Reality. In 2019 IEEE International Conference on Pervasive Computing and Communications (PerCom. 1--10. https://doi.org/10.1109/PERCOM.2019.8767420

[29]

Hannah Limerick, James W. Moore, and David Coyle. 2015. Empirical Evidence for a Diminished Sense of Agency in Speech Interfaces. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). Association for Computing Machinery, New York, NY, USA, 3967--3970. https://doi.org/10.1145/2702123.2702379

Digital Library

[30]

Sylvain Malacria, Jonathan Aceituno, Philip Quinn, Géry Casiez, Andy Cockburn, and Nicolas Roussel. 2015. Push-Edge and Slide-Edge: Scrolling by Pushing Against the Viewport Edge. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). Association for Computing Machinery, New York, NY, USA, 2773--277 https://doi.org/10.1145/2702123.2702132

Digital Library

[31]

Yuki Matsuura, Tsutomu Terada, Tomohiro Aoki, Susumu Sonoda, Naoya Isoyama, and Masahiko Tsukamoto. 2019. Readability and Legibility of Fonts Considering Shakiness of Head Mounted Displays. In Proceedings of the 23rd International Symposium on Wearable Computers (ISWC '19). Association for Computing Machinery, New York, NY, USA, 150--159. https://doi.org/10.1145/3341163.3347748

Digital Library

[32]

Motoki Miura and Kenji Saisho. 2014. A Text Selection Technique Using Word Snapping. Procedia Computer Science 35 (2014), 1644 -- 1651. https://doi.org/10.1016/j.procs.2014.08.257 Knowledge-Based and Intelligent Information Engineering Systems 18th Annual Conference, KES-2014 Gdynia, Poland, September 2014 Proceedings.

[33]

Sachi Mizobuchi, Shinya Terasaki, Turo Keski-Jaskari, Jari Nousiainen, Matti Ryynanen, and Miika Silfverberg. 2005. Making an Impression: Force-Controlled Pen Input for Handheld Devices. In CHI '05 Extended Abstracts on Human Factors in Computing Systems (CHI EA '05). Association for Computing Machinery, New York, NY, USA, 1661--1664. https://doi.org/10.1145/1056808.1056991

Digital Library

[34]

P. Mohan, W. B. Goh, C. Fu, and S. Yeung. 2018. DualGaze: Addressing the Midas Touch Problem in Gaze Mediated VR Interaction. In 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). 79--84.

[35]

Alex Olwal, Steven Feiner, and Susanna Heyman. 2008. Rubbing and Tapping for Precise and Rapid Selection on Touch-Screen Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). Association for Computing Machinery, New York, NY, USA, 295--304. https://doi.org/10.1145/1357054.1357105

Digital Library

[36]

Henri Palleis, Julie Wagner, and Heinrich Hussmann. 2016. Novel Indirect Touch Input Techniques Applied to Finger-Forming 3D Models. In Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI '16). Association for Computing Machinery, New York, NY, USA, 228--235. https://doi.org/10.1145/2909132.2909257

Digital Library

[37]

X. Qin, Z. Zhang, C. Huang, C. Gao, M. Dehghan, and M. Jagersand. 2019. BASNet: Boundary-Aware Salient Object Detection. In 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 7471--7481.

[38]

Gonzalo Ramos and Ravin Balakrishnan. 2005. Zliding: Fluid Zooming and Sliding for High Precision Parameter Manipulation. In Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology (UIST '05). Association for Computing Machinery, New York, NY, USA, 143--152. https://doi.org/10.1145/1095034.1095059

Digital Library

[39]

Gonzalo Ramos, Matthew Boulos, and Ravin Balakrishnan. 2004. Pressure Widgets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04). Association for Computing Machinery, New York, NY, USA, 487--494. https://doi.org/10.1145/ 985692.985754

Digital Library

[40]

Gonzalo Ramos, Matthew Boulos, and Ravin Balakrishnan. 2004. Pressure Widgets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04). Association for Computing Machinery, New York, NY, USA, 487--494. https://doi.org/10.1145/ 985692.985754

Digital Library

[41]

Umar Rashid, Miguel A. Nacenta, and Aaron Quigley. 2012. Factors Influencing Visual Attention Switch in Multi-Display User Interfaces: A Survey. In Proceedings of the 2012 International Symposium on Pervasive Displays (PerDis '12). Association for Computing Machinery, New York, NY, USA, Article Article 1, 6 pages. https://doi.org/10.1145/2307798.2307799

Digital Library

[42]

Radiah Rivu, Yasmeen Abdrabou, Ken Pfeuffer, Mariam Hassib, and Florian Alt. 2020. Gaze'N'Touch: Enhancing Text Selection on Mobile Devices Using Gaze. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA '20). Association for Computing Machinery, New York, NY, USA, 1--8. https://doi.org/10.1145/3334480.3382802

Digital Library

[43]

Sherry Ruan, Jacob O. Wobbrock, Kenny Liou, Andrew Ng, and James A. Landay. 2018. Comparing Speech and Keyboard Text Entry for Short Messages in Two Languages on Touchscreen Phones. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 4, Article Article 159 (Jan. 2018), 23 pages. https://doi.org/10.1145/3161187

Digital Library

[44]

Dominik Schmidt, Corina Sas, and Hans Gellersen. 2013. Personal Clipboards for Individual Copy-and-Paste on Shared Multi-User Surfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). Association for Computing Machinery, New York, NY, USA, 3335--3344. https://doi.org/10.1145/2470654.2466457

Digital Library

[45]

Roy Shilkrot, Jochen Huber, Jürgen Steimle, Suranga Nanayakkara, and Pattie Maes. 2015. Digital Digits: A Comprehensive Survey of Finger Augmentation Devices. ACM Comput. Surv. 48, 2, Article Article 30 (Nov. 2015), 29 pages. https://doi.org/10.1145/2828993

Digital Library

[46]

Jeffrey Stylos, Brad A. Myers, and Andrew Faulring. 2004. Citrine: Providing Intelligent Copy-and-Paste. In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology (UIST '04). Association for Computing Machinery, New York, NY, USA, 185--188. https://doi.org/10.1145/1029632.1029665

Digital Library

[47]

Kenji Suzuki, Kazumasa Okabe, Ryuuki Sakamoto, and Daisuke Sakamoto. 2016. Fix and Slide: Caret Navigation with Movable Background. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '16). Association for Computing Machinery, New York, NY, USA, 478--482. https://doi.org/10.1145/2935334.2935357

Digital Library

[48]

Kenji Suzuki, Ryuuki Sakamoto, Daisuke Sakamoto, and Tetsuo Ono. 2018. Pressure-Sensitive Zooming-out Interfaces for One-Handed Mobile Interaction. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '18). Association for Computing Machinery, New York, NY, USA, Article Article 30, 8 pages. https://doi.org/10.1145/3229434.3229446

Digital Library

[49]

Eric Whitmire, Mohit Jain, Divye Jain, Greg Nelson, Ravi Karkar, Shwetak Patel, and Mayank Goel. 2017. DigiTouch: Reconfigurable Thumb-to-Finger Input and Text Entry on Head-Mounted Displays. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article Article 113 (Sept. 2017), 21 pages. https://doi.org/10.1145/3130978

Digital Library

[50]

Graham Wilson, Craig Stewart, and Stephen A. Brewster. 2010. Pressure-Based Menu Selection for Mobile Devices. In Proceedings of the 12th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '10). Association for Computing Machinery, New York, NY, USA, 181--190. https://doi.org/10.1145/1851600.1851631

Digital Library

[51]

R. Xiao, J. Schwarz, N. Throm, A. D. Wilson, and H. Benko. 2018. MRTouch: Adding Touch Input to Head-Mounted Mixed Reality. IEEE Transactions on Visualization and Computer Graphics 24, 4 (2018), 1653--1660.

Digital Library

[52]

Zhican Yang, Chun Yu, Xin Yi, and Yuanchun Shi. 2019. Investigating Gesture Typing for Indirect Touch. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 3, Article Article 117 (Sept. 2019), 22 pages. https://doi.org/10.1145/3351275

Digital Library

[53]

Yui-Pan Yau, Lik Hang Lee, Zheng Li, Tristan Braud, Yi-Hsuan Ho, and Pan Hui. 2020. How Subtle Can It Get? A Trimodal Study of Ring-Sized Interfaces for One-Handed Drone Control. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 2, Article 63 (June 2020), 29 pages. https://doi.org/10.1145/3397319

Digital Library

[54]

Shengdong Zhao, Fanny Chevalier, Wei Tsang Ooi, Chee Yuan Lee, and Arpit Agarwal. 2012. AutoComPaste: Auto-Completing Text as an Alternative to Copy-Paste. In Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI '12). Association for Computing Machinery, New York, NY, USA, 365--372. https://doi.org/10.1145/2254556.2254626

Digital Library

[55]

Mingyuan Zhong, Chun Yu, Qian Wang, Xuhai Xu, and Yuanchun Shi. 2018. ForceBoard: Subtle Text Entry Leveraging Pressure. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Association for Computing Machinery, New York, NY, USA, Article Paper 528, 10 pages. https://doi.org/10.1145/3173574.3174102

Digital Library

[56]

Fengyuan Zhu and Tovi Grossman. 2020. BISHARE: Exploring Bidirectional Interactions Between Smartphones and Head-Mounted Augmented Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3313831.3376233

Digital Library

Cited By

Lee JLee BChoi SSeo JChoe E(2024)Identify, Adapt, PersistProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595858:2(1-21)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659585
Li XZhou XDong RZhang YWang X(2024)Efficient Bottom-Up Synthesis for Programs with Local VariablesProceedings of the ACM on Programming Languages10.1145/36328948:POPL(1540-1568)Online publication date: 5-Jan-2024
https://dl.acm.org/doi/10.1145/3632894
Figueiredo MAnkrah EPowell JEpstein DChen Y(2024)Powered by AIProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314147:4(1-24)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631414
Show More Cited By

Index Terms

Press-n-Paste: Copy-and-Paste Operations with Pressure-sensitive Caret Navigation for Miniaturized Surface in Mobile Augmented Reality
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality

Recommendations

A Review of Augmented Reality-Based Human-Computer Interaction Applications of Gesture-Based Interaction
HCI International 2019 – Late Breaking Papers
Abstract
In recent years, augmented reality (AR) is an extremely growing field in information technology, computer science, and computer engineering. Although there are many recent works that use augmented reality for different purposes, most of the ...
Experiencing 3D interactions in virtual reality and augmented reality
EUSAI '04: Proceedings of the 2nd European Union symposium on Ambient intelligence

We demonstrate basic 2D and 3D interactions in both a Virtual Reality (VR) system, called the Personal Space Station, and an Augmented Reality (AR) system, called the Visual Interaction Platform. Since both platforms use identical (optical) tracking ...
Using an Augmented Reality Cube-Like Interface and 3D Gesture-Based Interaction to Navigate and Manipulate Data
VINCI '18: Proceedings of the 11th International Symposium on Visual Information Communication and Interaction

In this paper we describe our work-in-progress to create an interface that enables users to browse and select data within an Augmented Reality environment, using a virtual cube object that can be interacted with through 3D gestural input. We present the ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 5, Issue EICS

EICS

June 2021

546 pages

EISSN:2573-0142

DOI:10.1145/3468527

Editor:
Jeff Nichols
Apple Inc., United States

Issue’s Table of Contents

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 May 2021

Published in PACMHCI Volume 5, Issue EICS

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
324
Total Downloads

Downloads (Last 12 months)44
Downloads (Last 6 weeks)2

Reflects downloads up to 01 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Lee JLee BChoi SSeo JChoe E(2024)Identify, Adapt, PersistProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595858:2(1-21)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659585
Li XZhou XDong RZhang YWang X(2024)Efficient Bottom-Up Synthesis for Programs with Local VariablesProceedings of the ACM on Programming Languages10.1145/36328948:POPL(1540-1568)Online publication date: 5-Jan-2024
https://dl.acm.org/doi/10.1145/3632894
Figueiredo MAnkrah EPowell JEpstein DChen Y(2024)Powered by AIProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314147:4(1-24)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631414
Jiang PFeng LSun FSarkar PXia HLiu C(2023)1D-Touch: NLP-Assisted Coarse Text Selection via a Semi-Direct GestureProceedings of the ACM on Human-Computer Interaction10.1145/36264837:ISS(463-482)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1145/3626483
Murnane EGlazko YCosta JYao RZhao GMoya PLanday J(2023)Narrative-Based Visual Feedback to Encourage Sustained Physical ActivityProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35807867:1(1-36)Online publication date: 28-Mar-2023
https://dl.acm.org/doi/10.1145/3580786
Jain GTeng YCho DXing YAziz MSmith B(2023)"I Want to Figure Things Out": Supporting Exploration in Navigation for People with Visual ImpairmentsProceedings of the ACM on Human-Computer Interaction10.1145/35794967:CSCW1(1-28)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579496
Zhao YTao YLe GMaki RAdams ALopes PChoudhury T(2023)Affective Touch as Immediate and Passive Wearable InterventionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35694846:4(1-23)Online publication date: 11-Jan-2023
https://dl.acm.org/doi/10.1145/3569484
Love RCohen PKulić D(2023)Teachable Robots Learn What to Say: Improving Child Engagement During Teaching InteractionSocial Robotics10.1007/978-981-99-8718-4_3(27-37)Online publication date: 3-Dec-2023
https://dl.acm.org/doi/10.1007/978-981-99-8718-4_3
Rahman MAhmed TAhmed MDinh MNemati EKuang JGao J(2022)BreatheBuddyProceedings of the ACM on Human-Computer Interaction10.1145/35467486:MHCI(1-18)Online publication date: 20-Sep-2022
https://dl.acm.org/doi/10.1145/3546748
Lee HAshok V(2022)Customizable Tabular Access to Web Data Records for Convenient Low-vision Screen Magnifier InteractionACM Transactions on Accessible Computing10.1145/351704415:2(1-22)Online publication date: 19-May-2022
https://dl.acm.org/doi/10.1145/3517044
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents