WiP: An On-device LLM-based Approach to Query Privacy Protection
Authors: 
Yizhen Yuan, Rui Kong, Yuanchun Li, and Yunxin LiuAuthors Info & Claims
Yizhen Yuan, Rui Kong, Yuanchun Li, and Yunxin LiuAuthors Info & ClaimsJune 2024
Pages 7 - 9
Abstract
Privacy leakage from user queries is a widely-concerned issue in search engines and chatbot services. Existing solutions based on privacy information removal, obfuscation, and encryption may inevitably hurt service quality or require full trust of the service provider. Inspired by the remarking language understanding and generation abilities of large language models (LLMs), we introduce LLM-QueryGuard, an LLM-based tool designed to mitigate privacy leakage in continuous user queries. The core of LLM-QueryGuard is an on-device LLM that automatically understands the private properties contained in the user queries and generates false queries to obfuscate the private properties. By making the generated queries indistinguishable and mixing them into the real queries, our approach can be seamlessly integrated into any query-driven applications (e.g. search engine and ChatGPT), with some cost of additional queries.
References
[1]
Huimin Chen, Fengran Mo, Yanhao Wang, Cen Chen, Jian-Yun Nie, Chengyu Wang, and Jamie Cui. 2022. A customized text sanitization mechanism with differential privacy. arXiv preprint arXiv:2207.01193 (2022).
[2]
Yuanchun Li, Hao Wen, Weijun Wang, Xiangyu Li, Yizhen Yuan, Guohong Liu, Jiacheng Liu, Wenxing Xu, Xiang Wang, Yi Sun, Rui Kong, Yile Wang, Hanfei Geng, Jian Luan, Xuefeng Jin, Zilong Ye, Guanjing Xiong, Fan Zhang, Xiang Li, Mengwei Xu, Zhijun Li, Peng Li, Yang Liu, Ya-Qin Zhang, and Yunxin Liu. 2024. Personal LLM Agents: Insights and Survey about the Capability, Efficiency and Security. arXiv preprint arXiv:2401.05459 (2024).
[3]
OpenAI. 2022. Introduce ChatGPT. https://openai.com/blog/chatgpt. [Online; accessed November 28, 2023].
[4]
Richard Plant, Dimitra Gkatzia, and Valerio Giuffrida. 2021. CAPE: Context-aware private embeddings for private language learning. arXiv preprint arXiv:2108.12318 (2021).
[5]
Hao Wen, Yuanchun Li, Guohong Liu, Shanhui Zhao, Tao Yu, Toby Jia-Jun Li, Shiqi Jiang, Yunhao Liu, Yaqin Zhang, and Yunxin Liu. 2023. Empowering llm to use smartphone for intelligent task automation. arXiv preprint arXiv:2308.15272 (2023).
[6]
Yixiang Yao, Fei Wang, Srivatsan Ravi, and Muhao Chen. 2024. Privacy-Preserving Language Model Inference with Instance Obfuscation. arXiv preprint arXiv:2402.08227 (2024).
[7]
Xin Zhou, Jinzhu Lu, Tao Gui, Ruotian Ma, Zichu Fei, Yuran Wang, Yong Ding, Yibo Cheung, Qi Zhang, and Xuanjing Huang. 2022. TextFusion: Privacy-Preserving Pre-trained Model Inference via Token Fusion. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, Yoav Goldberg, Zornitsa Kozareva, and Yue Zhang (Eds.). Association for Computational Linguistics, Abu Dhabi, United Arab Emirates, 8360--8371. https://doi.org/10.18653/v1/2022.emnlp-main.572
[8]
Xin Zhou, Yi Lu, Ruotian Ma, Tao Gui, Qi Zhang, and Xuan-Jing Huang. 2023. TextMixer: Mixing Multiple Inputs for Privacy-Preserving Inference. In Findings of the Association for Computational Linguistics: EMNLP 2023. 3749--3762.
Recommendations
A privacy controller approach for privacy protection in web services
SWS '07: Proceedings of the 2007 ACM workshop on Secure web servicesThe growth of the Internet has been accompanied by the growth of web services (e.g. e-commerce, e-health). This increased use of web services has meant that more and more user personal information is being shared with web service providers, leading to ...
A privacy-aware visual query approach for location-based data
AbstractVisual querying of location-based data assists users in expressing query requirements, investigating query results and making inferences. However, directly accessing data records exposes individual location information and may cause privacy ...
Graphical abstractDisplay Omitted
Highlights- Directly query location data may lead to privacy issues.
- Anonymizing data preserves data privacy but limits data utility.
- Graph-based anonymization sanitizes data privacy effectively and dynamically.
- Interactive visual query ...
Web search query privacy: Evaluating query obfuscation and anonymizing networks
Web Search is one of the most rapidly growing applications on the internet today. However, the current practice followed by most search engines --of logging and analyzing users' queries --raises serious privacy concerns. In this paper, we concentrate on ...
Comments
Information & Contributors
Information
Published In
June 2024
44 pages
ISBN:9798400706639
DOI:10.1145/3662006
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 June 2024
Check for updates
Author Tags
Qualifiers
- Short-paper
- Research
- Refereed limited
Conference
MOBISYS '24
Sponsor:
MOBISYS '24: The 22nd Annual International Conference on Mobile Systems, Applications and Services
June 3 - 7, 2024
Tokyo, Minato-ku, Japan
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 37Total Downloads
- Downloads (Last 12 months)37
- Downloads (Last 6 weeks)37
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in