Demonstrating LLM-for-X: Application-agnostic Integration of Large Language Models to Support Writing Workflows
Authors: 
Lukas Teufelberger, Xintong Liu, Zhipeng Li, Max Möbus, Christian HolzAuthors Info & Claims
Lukas Teufelberger, Xintong Liu, Zhipeng Li, Max Möbus, Christian HolzAuthors Info & ClaimsArticle No.: 11, Pages 1 - 3
Abstract
In this demonstration, we show LLM-for-X, a system-wide shortcut layer that connects any application to backend LLM support through a lightweight popup dialog. LLM-for-X provides users with quick and easy-to-use LLM assistance without context switching to support writing and reading tasks. We show the use of LLM-for-X across several applications, such as Microsoft Office, VSCode, and Adobe Acrobat, which our tool seamlessly connects to the backends of OpenAI ChatGPT and Google Gemini. We also demonstrate the use of our system inside web apps such as Overleaf.
Supplemental Material
MP4 File
Video figure
- Download
- 116.61 MB
References
[1]
Tamara Babaian, Barbara Grosz, and Stuart Shieber. 2002. A Writer’s Collaborative Assistant. International Conference on Intelligent User Interfaces, Proceedings IUI (06 2002). https://doi.org/10.1145/502716.502722
[2]
Carey D Chisholm, Amanda M Dornfeld, David R Nelson, and William H Cordell. 2001. Work interrupted: a comparison of workplace interruptions in emergency departments and primary care offices. Annals of emergency medicine 38, 2 (2001), 146–151.
[3]
Github. 2024. Github Copilot. https://github.com/features/copilot Accessed: 30-03-2024.
[4]
Sophie Leroy, Aaron M Schmidt, and Nora Madjar. 2020. Interruptions and task transitions: Understanding their characteristics, processes, and consequences. Academy of Management Annals 14, 2 (2020), 661–694.
[5]
André N Meyer, Laura E Barton, Gail C Murphy, Thomas Zimmermann, and Thomas Fritz. 2017. The work life of developers: Activities, switches and perceived productivity. IEEE Transactions on Software Engineering 43, 12 (2017), 1178–1193.
[6]
Grégoire Mialon, Roberto Dessì, Maria Lomeli, Christoforos Nalmpantis, Ram Pasunuru, Roberta Raileanu, Baptiste Rozière, Timo Schick, Jane Dwivedi-Yu, Asli Celikyilmaz, 2023. Augmented language models: a survey. arXiv preprint arXiv:2302.07842 (2023).
[7]
Bryan Min, Matthew T Beaudouin-Lafon, Sangho Suh, and Haijun Xia. 2023. Demonstration of Masonview: Content-Driven Viewport Management. In Adjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (, San Francisco, CA, USA,) (UIST ’23 Adjunct). Association for Computing Machinery, New York, NY, USA, Article 60, 3 pages. https://doi.org/10.1145/3586182.3615827
[8]
OpenAI. 2024. Introducing GPTs. https://openai.com/blog/introducing-gpts Accessed: 30-03-2024.
[9]
Filip Radlinski and Nick Craswell. 2017. A theoretical framework for conversational search. In Proceedings of the 2017 conference on conference human information interaction and retrieval. 117–126.
[10]
Timo Schick, Jane Dwivedi-Yu, Roberto Dessì, Roberta Raileanu, Maria Lomeli, Eric Hambro, Luke Zettlemoyer, Nicola Cancedda, and Thomas Scialom. 2024. Toolformer: Language models can teach themselves to use tools. Advances in Neural Information Processing Systems 36 (2024).
[11]
Shahab Saquib Sohail, Faiza Farhat, Yassine Himeur, Mohammad Nadeem, Dag Øivind Madsen, Yashbir Singh, Shadi Atalla, and Wathiq Mansoor. 2023. Decoding ChatGPT: A taxonomy of existing research, current challenges, and possible future directions. Journal of King Saud University - Computer and Information Sciences 35, 8 (2023), 101675. https://doi.org/10.1016/j.jksuci.2023.101675
[12]
Lukas Teufelberger, Xintong Liu, Zhipeng Li, Max Moebus, and Christian Holz. 2024. LLM-for-X: Application-agnostic Integration of Large Language Models to Support Personal Writing Workflows. arxiv:2407.21593 [cs.HC] https://arxiv.org/abs/2407.21593
[13]
Jiayin Wang, Weizhi Ma, Peijie Sun, Min Zhang, and Jian-Yun Nie. 2024. Understanding User Experience in Large Language Model Interactions. arxiv:2401.08329 [cs.HC]
[14]
Writeful. 2024. TexGPT: Harness the power of ChatGPT in Overleaf. https://blog.writefull.com/texgpt-harness-the-power-of-chatgpt-in-overleaf/ Accessed: 30-03-2024.
[15]
Julie S Zide, Maura J Mills, Comila Shahani-Denning, and Carolyn Sweetapple. 2017. Work interruptions resiliency: toward an improved understanding of employee efficiency. Journal of Organizational Effectiveness: People and Performance 4, 1 (2017), 39–58.
Index Terms
- Demonstrating LLM-for-X: Application-agnostic Integration of Large Language Models to Support Writing Workflows
Comments
Information & Contributors
Information
Published In
October 2024
394 pages
Copyright © 2024 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 13 October 2024
Check for updates
Author Tags
Qualifiers
- Demonstration
- Research
- Refereed limited
Conference
UIST '24: The 37th Annual ACM Symposium on User Interface Software and Technology
October 13 - 16, 2024
PA, Pittsburgh, USA
Acceptance Rates
Overall Acceptance Rate 355 of 1,733 submissions, 20%
Upcoming Conference
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 88Total Downloads
- Downloads (Last 12 months)88
- Downloads (Last 6 weeks)11
Reflects downloads up to 10 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format