Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3462244.3479885acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
research-article

PARA: Privacy Management and Control in Emerging IoT Ecosystems using Augmented Reality

Published: 18 October 2021 Publication History

Abstract

The ubiquity of smart devices, combined with a lack of information about data garnered by them, make privacy a significant challenge for adopting smart devices. Ensuring users can safeguard their privacy without compromising the devices’ functionality requires effective yet intuitive ways to manage personal privacy preferences. Current solutions for privacy management are severely lacking as they are ineffective in making users aware of potential privacy risks or how to mitigate them and as they offer limited support for interaction. As our first contribution, we develop a novel AR privacy management interface (PARA) that uses AR visualization to contextualize data disclosure and improve user’s perceptions of privacy threats. Besides offering support for enhancing user’s privacy perceptions, our interface supports privacy control on compatible devices through privacy-enhancing technologies. As our second contribution, we systematically study factors affecting privacy perceptions and privacy control for two device classes (smart camera and smart speaker) through a user study with N = 32 participants. Our results show that PARA’s contextualization and visualization of privacy disclosure strongly affect the participants’ privacy perceptions. For privacy control, we demonstrate that our prototype improves the participant’s capability to identify risks and provides an effective and easy-to-use mechanism for controlling privacy disclosure, in contrast to existing state-of-the-art privacy management interfaces.

References

[1]
Noah Apthorpe, Yan Shvartzshnaider, Arunesh Mathur, Dillon Reisman, and Nick Feamster. 2018. Discovering smart home internet of things privacy norms using contextual integrity. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 2 (2018), 1–23.
[2]
Paritosh Bahirat, Yangyang He, Abhilash Menon, and Bart Knijnenburg. 2018. A Data-Driven Approach to Developing IoT Privacy-Setting Interfaces. In 23rd International Conference on Intelligent User Interfaces. ACM, 165–176.
[3]
Vincent Becker, Felix Rauchenstein, and Gábor Sörös. 2020. Connecting and Controlling Appliances Through Wearable Augmented Reality. Augmented Human Research 5, 1 (2020), 2.
[4]
Christopher Champion, Ilesanmi Olade, Constantinos Papangelis, Haining Liang, and Charles Fleming. 2019. The Smart2 Speaker Blocker: An Open-Source Privacy Filter for Connected Home Speakers. arXiv preprint arXiv:1901.04879(2019).
[5]
Eugene Cho, S Shyam Sundar, Saeed Abdullah, and Nasim Motalebi. 2020. Will Deleting History Make Alexa More Trustworthy? Effects of Privacy and Content Customization on User Experience of Smart Speakers. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13.
[6]
J Cohen. 1988. Statistical Power Analysis for the Behavioral Sciences. Hillsdle.
[7]
Jessica Colnago, Yuanyuan Feng, Tharangini Palanivel, Sarah Pearman, Megan Ung, Alessandro Acquisti, Lorrie Faith Cranor, and Norman Sadeh. 2020. Informing the design of a personalized privacy assistant for the internet of things. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13.
[8]
Anupam Das, Martin Degeling, Daniel Smullen, and Norman Sadeh. 2018. Personalized privacy assistants for the internet of things: providing users with notice and choice. IEEE Pervasive Computing 17, 3 (2018), 35–46.
[9]
Nigel Davies, Nina Taft, Mahadev Satyanarayanan, Sarah Clinch, and Brandon Amos. 2016. Privacy mediators: Helping IoT cross the chasm. In Proceedings of the 17th International Workshop on Mobile Computing Systems and Applications. ACM, 39–44.
[10]
Ronan De Renesse. 2017. Virtual digital assistants to overtake world population by 2021. Ovum, May 17(2017).
[11]
Serge Egelman, Raghudeep Kannavara, and Richard Chow. 2015. Is this thing on? Crowdsourcing privacy indicators for ubiquitous sensing platforms. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 1669–1678.
[12]
Pardis Emami-Naeini, Yuvraj Agarwal, Lorrie Faith Cranor, and Hanan Hibshi. 2020. Ask the experts: What should be on an IoT privacy and security label?. In 2020 IEEE Symposium on Security and Privacy (SP). IEEE, 447–464.
[13]
Carlos Bermejo Fernandez, Petteri Nurmi, and Pan Hui. 2021. Seeing is Believing? Effects of Visualization on Smart Device Privacy Perceptions. Proceedings of the 29th ACM International Conference on Multimedia (MM ’21).
[14]
Hamza Harkous, Kassem Fawaz, Kang G. Shin, and Karl Aberer. 2016. PriBots: Conversational Privacy with Chatbots. In Twelfth Symposium on Usable Privacy and Security (SOUPS 2016). USENIX Association.
[15]
Anfeng He, Chong Luo, Xinmei Tian, and Wenjun Zeng. 2018. A twofold siamese network for real-time object tracking. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4834–4843.
[16]
Valentin Heun, Shunichi Kasahara, and Pattie Maes. 2013. Smarter objects: using AR technology to program physical objects and their interactions. In CHI’13 Extended Abstracts on Human Factors in Computing Systems. ACM, 961–966.
[17]
Dongsik Jo and Gerard Jounghyun Kim. 2016. ARIoT: scalable augmented reality framework for interacting with Internet of Things appliances everywhere. IEEE Transactions on Consumer Electronics 62, 3 (2016), 334–340.
[18]
Kosuke Kaneko, Yusuke Tsutsumi, Subodh Sharma, and Yoshihiro Okada. 2020. PACKUARIUM: Network Packet Visualization Using Mixed Reality for Detecting Bot IoT Device of DDoS Attack. Springer Science and Business Media Deutschland GmbH, 361–372.
[19]
Sarah Krings, Enes Yigitbas, Ivan Jovanovikj, Stefan Sauer, and Gregor Engels. 2020. Development framework for context-aware augmented reality applications. In Companion Proceedings of the 12th ACM SIGCHI Symposium on Engineering Interactive Computing Systems. 1–6.
[20]
Abhishek Kumar, Tristan Braud, Lik-Hang Lee, and Pan Hui. 2021. Theophany: Multimodal Speech Augmentation in Instantaneous Privacy Channels. Proceedings of the 29th ACM International Conference on Multimedia (MM ’21).
[21]
Marc Langheinrich. 2002. A privacy awareness system for ubiquitous computing environments. In international conference on Ubiquitous Computing. Springer, 237–245.
[22]
Josephine Lau, Benjamin Zimmerman, and Florian Schaub. 2018. Alexa, are you listening?: Privacy perceptions, concerns and privacy-seeking behaviors with smart speakers. Proceedings of the ACM on Human-Computer Interaction 2, CSCW(2018), 102.
[23]
Hosub Lee and Alfred Kobsa. 2016. Understanding user privacy in Internet of Things environments. In Internet of Things (WF-IoT), 2016 IEEE 3rd World Forum on. IEEE, 407–412.
[24]
Lik-Hang Lee and Pan Hui. 2018. Interaction Methods for Smart Glasses: A Survey. IEEE Access 6(2018), 28712–28732.
[25]
Tao Li and Lei Lin. 2019. AnonymousNet: Natural face de-identification with measurable privacy. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops.
[26]
Naresh K Malhotra, Sung S Kim, and James Agarwal. 2004. Internet users’ information privacy concerns (IUIPC): The construct, the scale, and a causal model. Information systems research 15, 4 (2004), 336–355.
[27]
Lydia Manikonda, Aditya Deotale, and Subbarao Kambhampati. 2018. What’s up with Privacy?: User Preferences and Privacy Concerns in Intelligent Personal Assistants. In Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society. ACM, 229–235.
[28]
Shrirang Mare, Franziska Roesner, and Tadayoshi Kohno. 2020. Smart Devices in Airbnbs: Considering Privacy and Security for both Guests and Hosts. Proceedings on Privacy Enhancing Technologies 2020, 2(2020), 436–458.
[29]
Simon Mayer, Yassin N Hassan, and Gábor Sörös. 2014. A magic lens for revealing device interactions in smart environments. In SIGGRAPH Asia 2014 Mobile Graphics and Interactive Applications. 1–6.
[30]
Vikram Mehta, Daniel Gooch, Arosha Bandara, Blaine Price, and Bashar Nuseibeh. 2021. Privacy Care: A Tangible Interaction Framework for Privacy Management. ACM Trans. Internet Technol. 21, 1, Article 25 (Feb. 2021), 32 pages.
[31]
M. Mikusz, S. Houben, N. Davies, K. Moessner, and M. Langheinrich. 2018. Raising awareness of IoT sensor deployments. In Living in the Internet of Things: Cybersecurity of the IoT - 2018. 1–8.
[32]
Pardis Emami Naeini, Sruti Bhagavatula, Hana Habib, Martin Degeling, Lujo Bauer, Lorrie Faith Cranor, and Norman Sadeh. 2017. Privacy Expectations and Preferences in an IoT World. In Thirteenth Symposium on Usable Privacy and Security (SOUPS 2017). USENIX Association, 399–412.
[33]
Vansh Narula, Kexin Feng, and Theodora Chaspari. 2020. Preserving Privacy in Image-based Emotion Recognition through User Anonymization. In Proceedings of the 2020 International Conference on Multimodal Interaction. 452–460.
[34]
Katarzyna Olejnik, Italo Dacosta, Joana Soares Machado, Kévin Huguenin, Mohammad Emtiyaz Khan, and Jean-Pierre Hubaux. 2017. Smarper: Context-aware and automatic runtime-permissions for mobile devices. In 2017 IEEE Symposium on Security and Privacy (SP). IEEE, 1058–1076.
[35]
Antti Oulasvirta, Aurora Pihlajamaa, Jukka Perkiö, Debarshi Ray, Taneli Vähäkangas, Tero Hasu, Niklas Vainio, and Petri Myllymäki. 2012. Long-term effects of ubiquitous surveillance in the home. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing. ACM, 41–50.
[36]
Yongtae Park, Sangki Yun, and Kyu-Han Kim. 2019. When IoT met Augmented Reality: Visualizing the Source of the Wireless Signal in AR View. In Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 117–129.
[37]
Sarah Prange, Ahmed Shams, Robin Piening, Yomna Abdelrahman, and Florian Alt. 2021. PriView–Exploring Visualisations to Support Users’ Privacy Awareness. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–18.
[38]
Kirill A. Shatilov, Dimitris Chatzopoulos, Lik-Hang Lee, and Pan Hui. 2021. Emerging ExG-based NUI Inputs in Extended Realities: A Bottom-up Survey. ACM Transactions on Interactive Intelligent Systems (TiiS) 11 (2021), 1 – 49.
[39]
Peter Shaw, Mateusz Mikusz, Petteri Nurmi, and Nigel Davies. 2019. IoT Maps:Charting the Internet of Things. In The 20th International Workshop on Mobile Computing Systems and Applications (HotMobile). ACM.
[40]
Zhiqi Shen, Shaojing Fan, Yongkang Wong, Tian-Tsong Ng, and Mohan Kankanhalli. 2019. Human-imperceptible Privacy Protection Against Machines. In Proceedings of the 27th ACM International Conference on Multimedia. 1119–1128.
[41]
Sola Shirai and Jacob Whitehill. 2019. Privacy-Preserving Annotation of Face Images through Attc ribute-Preserving Face Synthesis. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops.
[42]
Mingcong Song, Kan Zhong, Jiaqi Zhang, Yang Hu, Duo Liu, Weigong Zhang, Jing Wang, and Tao Li. 2018. In-situ AI: Towards autonomous and incremental deep learning for IoT systems. In 2018 IEEE International Symposium on High Performance Computer Architecture (HPCA). IEEE, 92–103.
[43]
Yunpeng Song, Yun Huang, Zhongmin Cai, and Jason I Hong. 2020. I’m All Eyes and Ears: Exploring Effective Locators for Privacy Awareness in IoT Scenarios. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13.
[44]
Yufeng Yin, Baiyu Huang, Yizhen Wu, and Mohammad Soleymani. 2020. Speaker-invariant adversarial domain adaptation for emotion recognition. In Proceedings of the 2020 International Conference on Multimodal Interaction. 481–490.
[45]
Shikun Zhang, Yuanyuan Feng, Lujo Bauer, Lorrie Faith Cranor, Anupam Das, and Norman Sadeh. 2021. “Did you know this camera tracks your mood?”: Understanding Privacy Expectations and Preferences in the Age of Video Analytics. Proceedings on Privacy Enhancing Technologies 2021, 2(2021), 282–304.
[46]
Serena Zheng, Noah Apthorpe, Marshini Chetty, and Nick Feamster. 2018. User Perceptions of Smart Home IoT Privacy. Proc. ACM Hum.-Comput. Interact. 2, CSCW, Article 200, 200:1–200:20 pages.

Cited By

View all
  • (2024)Connecting Home: Human-Centric Setup Automation in the Augmented Smart HomeProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642862(1-16)Online publication date: 11-May-2024
  • (2024)Digital Transformation Towards Sustainability in Education: Overview on Metaverse System Adoption in E-learning2024 Arab ICT Conference (AICTC)10.1109/AICTC58357.2024.10735043(37-43)Online publication date: 27-Feb-2024
  • (2023)Enhancing Multi-Modal Perception and Interaction: An Augmented Reality Visualization System for Complex Decision MakingSystems10.3390/systems1201000712:1(7)Online publication date: 25-Dec-2023
  • Show More Cited By
  1. PARA: Privacy Management and Control in Emerging IoT Ecosystems using Augmented Reality

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ICMI '21: Proceedings of the 2021 International Conference on Multimodal Interaction
    October 2021
    876 pages
    ISBN:9781450384810
    DOI:10.1145/3462244
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 18 October 2021

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. AR-IoT interaction.
    2. augmented reality
    3. control
    4. graphical user interfaces
    5. management
    6. mixed reality
    7. privacy
    8. smart devices

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    Conference

    ICMI '21
    Sponsor:
    ICMI '21: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION
    October 18 - 22, 2021
    QC, Montréal, Canada

    Acceptance Rates

    Overall Acceptance Rate 453 of 1,080 submissions, 42%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)105
    • Downloads (Last 6 weeks)16
    Reflects downloads up to 24 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Connecting Home: Human-Centric Setup Automation in the Augmented Smart HomeProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642862(1-16)Online publication date: 11-May-2024
    • (2024)Digital Transformation Towards Sustainability in Education: Overview on Metaverse System Adoption in E-learning2024 Arab ICT Conference (AICTC)10.1109/AICTC58357.2024.10735043(37-43)Online publication date: 27-Feb-2024
    • (2023)Enhancing Multi-Modal Perception and Interaction: An Augmented Reality Visualization System for Complex Decision MakingSystems10.3390/systems1201000712:1(7)Online publication date: 25-Dec-2023
    • (2023)From Digital Media to Empathic Spaces: A Systematic Review of Empathy Research in Extended Reality EnvironmentsACM Computing Surveys10.1145/362651856:5(1-40)Online publication date: 25-Nov-2023
    • (2023)Players are not Ready 101: A Tutorial on Organising Mixed-mode Events in the MetaverseProceedings of the First Workshop on Metaverse Systems and Applications10.1145/3597063.3597360(14-20)Online publication date: 18-Jun-2023
    • (2023)Data Transparency Design in Internet of Things: A Systematic ReviewInternational Journal of Human–Computer Interaction10.1080/10447318.2023.222899740:18(5003-5025)Online publication date: 18-Jul-2023
    • (2023)User-centric privacy preserving models for a new era of the Internet of ThingsJournal of Network and Computer Applications10.1016/j.jnca.2023.103695217:COnline publication date: 1-Aug-2023
    • (2023)Review of the theory, principles, and design requirements of human-centric Internet of Things (IoT)Journal of Ambient Intelligence and Humanized Computing10.1007/s12652-023-04539-314:3(2827-2859)Online publication date: 4-Feb-2023
    • (2023)Increasing Users’ Privacy Awareness in the Internet of Things: Design Space and Sample ScenariosHuman Factors in Privacy Research10.1007/978-3-031-28643-8_16(321-336)Online publication date: 10-Mar-2023
    • (2022)Influencing Factors of Usage Intention of Metaverse Education Application Platform: Empirical Evidence Based on PPM and TAM ModelsSustainability10.3390/su14241703714:24(17037)Online publication date: 19-Dec-2022
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media