TARPS: A Toolbox for Enhancing Privacy and Security for Collaborative AR
Article No.: 251, Pages 1 - 22
Abstract
Modern AR applications collect a wide range of data to leverage context-specific functionalities. This includes data that might be private or security-critical (e.g., the camera view of a private home), calling for protective measures, especially in collaborative settings where data is inherently shared. A literature research revealed a lack of development support for privacy and security in collaborative AR. This makes it difficult for developers to find the time and resources to include protection mechanisms, leading to very limited options for end-users to control what data about them is shared. To address this problem, we present TARPS, a development Toolbox for enhancing collaborative AR applications with Privacy and Security protection mechanisms. TARPS is an out-of-the-box solution to add protection features to collaborative AR applications in a configurable manner. In developer interviews, the idea of TARPS was well received and an end-user study with an application created using TARPS showed that the included protection features were usable and accepted by end-users.
Supplemental Material
MP4 File
Demonstration video
- Download
- 208.33 MB
References
[1]
Hassanin M. Al-Barhamtoshy and Abdullah. Al-Ghamdi. 2017. Toward cloud-based mixed reality e-learning system. In 2017 International Conference on Informatics, Health & Technology (ICIHT). 1--6. https://doi.org/10.1109/ICIHT.2017.7899008
[2]
Ronald T. Azuma. 1997. A Survey of Augmented Reality. Presence: Teleoper. Virtual Environ. 6, 4 (Aug. 1997), 355--385.
[3]
Matthias Baldauf and Peter Fröhlich. 2013. The augmented video wall: multi-user AR interaction with public displays. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (CHI EA '13). Association for Computing Machinery, New York, NY, USA, 3015--3018. https://doi.org/10.1145/2468356.2479599
[4]
Matthias Baldauf, Katrin Lasinger, and Peter Fröhlich. 2012. Private public screens: detached multi-user interaction with large displays through mobile augmented reality. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia (MUM '12). Association for Computing Machinery, New York, NY, USA, 1--4. https://doi.org/10.1145/2406367.2406401
[5]
Valentin Bauer, Tifanie Bouchara, and Patrick Bourdot. 2021. Designing an Extended Reality Application to Expand Clinic-Based Sensory Strategies for Autistic Children Requiring Substantial Support: Participation of Practitioners. In 2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). 254--259. https://doi.org/10.1109/ISMAR-Adjunct54149.2021.00059
[6]
John Brooke. 1995. SUS: A quick and dirty usability scale. Usability Eval. Ind. 189 (11 1995).
[7]
Jaybie A. De Guzman, Kanchana Thilakarathna, and Aruna Seneviratne. 2019. Security and Privacy Approaches in Mixed Reality: A Literature Survey. ACM Comput. Surv. 52, 6, Article 110 (oct 2019), 37 pages. https://doi.org/10.1145/3359626
[8]
International Organization for Standardization. 2018. Information technology --- Security techniques --- Information security management systems --- Overview and vocabulary. Standard. International Organization for Standardization, Geneva, CH.
[9]
International Organization for Standardization. 2019. Ergonomics of human-system interaction Part 210: Human-centred design for interactive systems. Standard. International Organization for Standardization, Geneva, CH.
[10]
Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In Human Mental Workload, Peter A. Hancock and Najmedin Meshkati (Eds.). Advances in Psychology, Vol. 52. North-Holland, 139--183. https://doi.org/10.1016/S0166-4115(08)62386-9
[11]
Robin Helmert, Tobias Hardes, and Enes Yigitbas. 2023. Design and Evaluation of an AR Voice-based Indoor UAV Assistant for Smart Home Scenarios. In Proceedings of the ACM Symposium on Spatial User Interaction (SUI 2023). ACM.
[12]
Anik Islam, Md Masuduzzaman, Arifa Akter, and Soo Young Shin. 2020. MR-Block: A Blockchain-Assisted Secure Content Sharing Scheme for Multi-User Mixed-Reality Applications in Internet of Military Things. In 2020 International Conference on Information and Communication Technology Convergence (ICTC). 407--411. https://doi.org/10.1109/ICTC49870.2020.9289327 ISSN: 2162--1233.
[13]
Pierrick Jouet, Vincent Alleaume, Anthony Laurent, Matthieu Fradet, Tao Luo, and Caroline Baillard. 2020. AR-Chat: an AR-based instant messaging system. In 2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). 153--157. https://doi.org/10.1109/ISMAR-Adjunct51615.2020.00050
[14]
Hanna Kallio, Anna-Maija Pietilä, Martin Johnson, and Mari Kangasniemi. 2016. Systematic methodological review: developing a framework for a qualitative semi-structured interview guide. Journal of advanced nursing 72, 12 (2016), 2954--2965.
[15]
Ginga Kamei, Takeshi Matsuyama, and Ken-ichi Okada. 2010. Augmentation of check in/out model for remote collaboration with Mixed Reality. In 2010 IEEE International Symposium on Mixed and Augmented Reality. 243--244. https://doi.org/10.1109/ISMAR.2010.5643588
[16]
Fabian Kilger, Alexandre Kabil, Volker Tippmann, Gudrun Klinker, and Marc-Oliver Pahl. 2021. Detecting and Preventing Faked Mixed Reality. In 2021 IEEE 4th International Conference on Multimedia Information Processing and Retrieval (MIPR). 399--405. https://doi.org/10.1109/MIPR51284.2021.00074
[17]
Sarah Claudia Krings, Enes Yigitbas, Kai Biermeier, and Gregor Engels. 2022. Design and Evaluation of AR-Assisted End-User Robot Path Planning Strategies. In Proceedings of the 14th ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS 2022).
[18]
Diane Lambert. 1996. Measures of Disclosure Risks and Harm. Journal of Official Statistics (06 1996), 313--331.
[19]
Michael Langfinger, Michael Schneider, Didier Stricker, and Hans D. Schotten. 2017. Addressing security challenges in industrial augmented reality systems. In 2017 IEEE 15th International Conference on Industrial Informatics (INDIN). 299--304. https://doi.org/10.1109/INDIN.2017.8104789 ISSN: 2378-363X.
[20]
Paul Lapides, Nicole Sultanum, Ehud Sharlin, and Mario Costa Sousa. 2012. Seamless mixed reality tracking in tabletop reservoir engineering interaction. In Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI '12). Association for Computing Machinery, New York, NY, USA, 725--728. https://doi.org/10.1145/2254556.2254694
[21]
Kiron Lebeck, Kimberly Ruth, Tadayoshi Kohno, and Franziska Roesner. 2018. Towards Security and Privacy for Multi-user Augmented Reality: Foundations with End Users. In 2018 IEEE Symposium on Security and Privacy (SP). 392--408. https://doi.org/10.1109/SP.2018.00051 ISSN: 2375-1207.
[22]
James R. Lewis and Jeff Sauro. 2018. Item Benchmarks for the System Usability Scale. J. Usability Studies 13, 3 (may 2018), 158--167.
[23]
Charles Z. Liu and Manolya Kavakli. 2018. An agent-based collaborative information processing system for mixed reality applications --- Part A: Agent-aware computing. In 2018 13th IEEE Conference on Industrial Electronics and Applications (ICIEA). 1273--1278. https://doi.org/10.1109/ICIEA.2018.8397905 ISSN: 2158--2297.
[24]
Mayra Donaji Barrera Machuca, Winyu Chinthammit, Yi Yang, and Henry Duh. 2014. 3D mobile interactions for public displays. In SIGGRAPH Asia 2014 Mobile Graphics and Interactive Applications (SA '14). Association for Computing Machinery, New York, NY, USA, 1. https://doi.org/10.1145/2669062.2684184
[25]
Shwetha Rajaram, Chen Chen, Franziska Roesner, and Michael Nebeling. 2023. Eliciting Security & Privacy-Informed Sharing Techniques for Multi-User Augmented Reality. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI '23). Association for Computing Machinery, New York, NY, USA, Article 98, 17 pages. https://doi.org/10.1145/3544548.3581089
[26]
Holger Regenbrecht, Sander Zwanenburg, and Tobias Langlotz. 2022. Pervasive Augmented Reality---Technology and Ethics. IEEE Pervasive Computing 21, 3 (July 2022), 84--91. https://doi.org/10.1109/MPRV.2022.3152993 Conference Name: IEEE Pervasive Computing.
[27]
Derek Reilly, Mohamad Salimian, Bonnie MacKay, Niels Mathiasen, W. Keith Edwards, and Juliano Franz. 2014. SecSpace: prototyping usable privacy and security for mixed reality collaborative environments. In Proceedings of the 2014 ACM SIGCHI symposium on Engineering interactive computing systems (EICS '14). Association for Computing Machinery, New York, NY, USA, 273--282. https://doi.org/10.1145/2607023.2607039
[28]
Mohamad H. Salimian, Derek Reilly, Stephen Brooks, and Bonnie MacKay. 2016. Physical-Digital Privacy Interfaces for Mixed Reality Collaboration: An Exploratory Study. In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces (ISS '16). Association for Computing Machinery, New York, NY, USA, 261--270. https://doi.org/10.1145/2992154.2992167
[29]
Ivo Sluganovic, Matej Serbec, Ante Derek, and Ivan Martinovic. 2017. HoloPair: Securing Shared Augmented Reality Using Microsoft HoloLens. In Proceedings of the 33rd Annual Computer Security Applications Conference (ACSAC '17). Association for Computing Machinery, New York, NY, USA, 250--261. https://doi.org/10.1145/3134600.3134625
[30]
Ivan E. Sutherland. 1968. A Head-Mounted Three Dimensional Display. In Fall Joint Computer Conference (San Francisco, California). Association for Computing Machinery, New York, NY, USA, 757--764.
[31]
Lan Anh Tran, Benedikt Hensen, Ralf Klamma, and Soamsiri Chantaraskul. 2022. Privacy and Security in Mixed Reality Learning Environments by Input and User/Bot Interaction Protection. In 2022 4th Asia Pacific Information Technology Conference (APIT 2022). Association for Computing Machinery, New York, NY, USA, 63--71. https://doi.org/10.1145/3512353.3512363
[32]
Fengchao Wang, Yanwei Liu, Jinxia Liu, Antonios Argyriou, Liming Wang, and Zhen Xu. 2021. Output Security for Multi-user Augmented Reality using Federated Reinforcement Learning. In 2021 IEEE Symposium on Computers and Communications (ISCC). 1--7. https://doi.org/10.1109/ISCC53001.2021.9631507 ISSN: 2642--7389.
[33]
Alan F. Westin. 1967. Privacy and Freedom. Atheneum, New York.
[34]
Enes Yigitbas and Gregor Engels. 2023. Enhancing Robot Programming through Digital Twin and Augmented Reality. In 56th Hawaii International Conference on System Science (HICSS 2023). ScholarSpace.
[35]
Enes Yigitbas, Sebastian Krois, Timo Renzelmann, and Gregor Engels. 2022. Comparative Evaluation of AR-based, VR-based, and Traditional Basic Life Support Training. In Proceedings of the 10th International Conference on Serious Games and Applications for Health (SeGAH'22). IEEE.
Index Terms
- TARPS: A Toolbox for Enhancing Privacy and Security for Collaborative AR
Recommendations
RFID system with fairness within the framework of security and privacy
ESAS'05: Proceedings of the Second European conference on Security and Privacy in Ad-Hoc and Sensor NetworksRadio Frequency Identification (RFID) systems are expected to be widely deployed in automated identification and supply-chain applications. Although RFID systems have several advantages, the technology may also create new threats to user privacy. In ...
Are RNGs Achilles' Heel of RFID Security and Privacy Protocols?
Security and privacy concerns have been growing with the increased utilisation of RFID technology in our daily lives. To mitigate these issues, numerous privacy-friendly authentication protocols have been published in the last decade. Random number ...
A Novel Anonymous RFID Authentication Protocol Providing Strong Privacy and Security
MINES '10: Proceedings of the 2010 International Conference on Multimedia Information Networking and SecurityAs the radio frequency identification (RFID) technology continues to evolve and mature, RFID tags can be implemented in a wide range of applications. Due to the shared wireless medium between the RFID reader and the RFID tag, however, adversaries can ...
Comments
Information & Contributors
Information
Published In
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 17 June 2024
Accepted: 01 February 2024
Revised: 01 February 2024
Received: 01 October 2023
Published in PACMHCI Volume 8, Issue EICS
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 108Total Downloads
- Downloads (Last 12 months)108
- Downloads (Last 6 weeks)38
Reflects downloads up to 12 Sep 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in