Exploring the Untapped Potential of Text Fields in Creative Software
Authors: 
Maëva Calmettes, Jean-Baptiste Joatton, Nolwenn Maudet, Joelle ThollotAuthors Info & Claims
Maëva Calmettes, Jean-Baptiste Joatton, Nolwenn Maudet, Joelle ThollotAuthors Info & ClaimsArticle No.: 10, Pages 1 - 16
Abstract
After the rise of direct manipulation, textual interactions have been progressively devalued in creative software. Text fields within creative software currently support limited use cases such as fine tuning of numerical values or layer naming. Following the increased popularity of programming in art and design, we believe that text field based interaction can be enhanced so as to combine the unique strengths of GUI with those of text. Based on the anatomy of the text field: both an interactive interface element and a writing space, we propose a design space that explores its interactive capabilities to facilitate both reading and comprehension as well as to support writing. To explore its potential, we apply this design space to VectorPattern, a pattern creation tool that focuses on complex pattern repetition based on explicit mathematical expressions written in text fields. With this work, we call for reevaluating the place of text fields within creative software.
Supplemental Material
MP4 File
Demonstration video of implemented concepts in Vector Pattern
- Download
- 143.07 MB
References
[1]
Aarya. 2022. AutoRegex: Convert from English to RegEx with Natural Language Processing. https://www.autoregex.xyz. [Online; accessed 19-January-2023].
[2]
R. Ballagas, J. Borchers, M. Rohs, and J.G. Sheridan. 2006. The smart phone: a ubiquitous input device. IEEE Pervasive Computing 5, 1 (Jan. 2006), 70–77. https://doi.org/10.1109/MPRV.2006.18 Conference Name: IEEE Pervasive Computing.
[3]
Rafael Ballagas, Sarthak Ghosh, and James Landay. 2018. The Design Space of 3D Printable Interactivity. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 2 (July 2018), 1–21. https://doi.org/10.1145/3214264
[4]
Michael Mose Biskjaer, Peter Dalsgaard, and Kim Halskov. 2014. A Constraint-Based Understanding of Design Spaces. (2014), 10.
[5]
blinry. 2022. Sliderland. https://sliderland.blinry.org. [Online; accessed 19-January-2023].
[6]
William Buxton. 1990. A Three-State Model of Graphical Input. In Proceedings of the IFIP TC13 Third Interational Conference on Human-Computer Interaction(INTERACT ’90). North-Holland Publishing Co., NLD, 449–456.
[7]
Christian Cantrell. 2022. The Stability Photoshop plugin. https://christiancantrell.com/#ai-ml. [Online; accessed 21-January-2023].
[8]
John Carroll and Mary Beth Rosson. 1987. Paradox of the active user. In Interfacing Thought : Cognitive Aspects of Human-Computer Interaction. The MIT press, 80–111.
[9]
The Qt Company. 2022. Qt Documentation: TextField QML Type. https://doc.qt.io/qt-5/qml-qtquick-controls-textfield.html. [Online; accessed 21-January-2023].
[10]
LMU Munich CompVis, Stability AI, and Runway ML. 2022. DreamStudio Prompt Guide. https://beta.dreamstudio.ai/prompt-guide. [Online; accessed 21-January-2023].
[11]
Alan Cooper, Robert Reimann, David Cronin, and Christopher Noessel. 2014. About face: the essentials of interaction design. John Wiley & Sons.
[12]
Stephen W. Draper and Stephen B. Barton. 1993. Learning by Exploration and Affordance Bugs. In INTERACT ’93 and CHI ’93 Conference Companion on Human Factors in Computing Systems (Amsterdam, The Netherlands) (CHI ’93). Association for Computing Machinery, New York, NY, USA, 75–76. https://doi.org/10.1145/259964.260084
[13]
Sébastien Ferré. 2017. SPARKLIS: An Expressive Query Builder for SPARQL Endpoints with Guidance in Natural Language. Open Journal Of Semantic Web 0 (2017). https://hal.inria.fr/hal-01485093
[14]
Claudio Fuentes. 2022. Prompt Tool for MidJourney. https://prompt.noonshot.com/midjourney. [Online; accessed 21-January-2023].
[15]
Don Gentner and Jakob Nielsen. 1996. The Anti-Mac Interface. Commun. ACM 39, 8 (aug 1996), 70–82. https://doi.org/10.1145/232014.232032
[16]
Google. 2021. Material Design. https://m3.material.io. [Online; accessed 21-January-2023].
[17]
Chris Granger. 2014. Light Table. http://lighttable.com. [Online; accessed 19-January-2023].
[18]
Sumit Gulwani and Mark Marron. 2014. NLyze: Interactive Programming by Natural Language for Spreadsheet Data Analysis and Manipulation. In Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data (Snowbird, Utah, USA) (SIGMOD ’14). Association for Computing Machinery, New York, NY, USA, 803–814. https://doi.org/10.1145/2588555.2612177
[19]
Philip J. Guo. 2013. Online Python Tutor: Embeddable Web-Based Program Visualization for Cs Education. In Proceeding of the 44th ACM Technical Symposium on Computer Science Education (Denver, Colorado, USA) (SIGCSE ’13). Association for Computing Machinery, New York, NY, USA, 579–584. https://doi.org/10.1145/2445196.2445368
[20]
Mars Gäfvert. 2022. Lost Minds Patternodes 3 - Parametric design and animation. https://lostminds.com/patternodes3/. [Online; accessed 21-January-2023].
[21]
Baku Hashimoto. 2020. Glisp. A Lisp-based Design Tool Bridging Graphic Design and Computational Arts. https://github.com/baku89/glisp. [Online; accessed 19-January-2023].
[22]
Brian Hempel, Justin Lubin, and Ravi Chugh. 2019. Sketch-n-Sketch: Output-Directed Programming for SVG. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST ’19). Association for Computing Machinery, New York, NY, USA, 281–292. https://doi.org/10.1145/3332165.3347925
[23]
Teresa Hirzle, Jan Gugenheimer, Florian Geiselhart, Andreas Bulling, and Enrico Rukzio. 2019. A Design Space for Gaze Interaction on Head-mounted Displays. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, Glasgow Scotland Uk, 1–12. https://doi.org/10.1145/3290605.3300855
[24]
Jane Hoffswell, Arvind Satyanarayan, and Jeffrey Heer. 2018. Augmenting Code with In Situ Visualizations to Aid Program Understanding. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3173574.3174106
[25]
Olivia Jack. 2018. Hydra. https://hydra.ojack.xyz. [Online; accessed 19-January-2023].
[26]
Carson Katri. 2022. Dream Textures. Stable Diffusion built-in to Blender. https://github.com/carson-katri/dream-textures. [Online; accessed 21-January-2023].
[27]
Caitlin Kelleher and Randy Pausch. 2005. Lowering the Barriers to Programming: A Taxonomy of Programming Environments and Languages for Novice Programmers. ACM Comput. Surv. 37, 2 (jun 2005), 83–137. https://doi.org/10.1145/1089733.1089734
[28]
Martin Kleppe. 2020. (t,i,x,y) => "creative code golfing". https://tixy.land. [Online; accessed 19-January-2023].
[29]
Amy J. Ko and Brad A. Myers. 2006. Barista: An Implementation Framework for Enabling New Tools, Interaction Techniques and Views in Code Editors. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Montréal, Québec, Canada) (CHI ’06). Association for Computing Machinery, New York, NY, USA, 387–396. https://doi.org/10.1145/1124772.1124831
[30]
Jürg Lehni. 2006. Scriptographer. https://scriptographer.org/. [Online; accessed 23-January-2023].
[31]
Jingyi Li, Joel Brandt, Radomír Mech, Maneesh Agrawala, and Jennifer Jacobs. 2020. Supporting Visual Artists in Programming through Direct Inspection and Control of Program Execution. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376765
[32]
Hugo Loi, Thomas Hurtut, Romain Vergne, and Joelle Thollot. 2017. Programmable 2D Arrangements for Element Texture Design. ACM Trans. Graph. 36, 3, Article 27 (may 2017), 17 pages. https://doi.org/10.1145/2983617
[33]
Nolwenn Maudet. 2018. Reinventing Graphic Design Software by Bridging the Gap Between Graphical User Interfaces and Programming. https://doi.org/10.21606/drs.2018.611
[34]
Donald A Norman. 1988. The psychology of everyday things.Basic books.
[35]
Donald A Norman. 2007. The next UI breakthrough: command lines. Interactions 14, 3 (2007), 44–45.
[36]
Notion Labs Inc.2016. Keyboard shortcuts - Notion help center. https://www.notion.so/help/keyboard-shortcuts. [Online; accessed 21-January-2023].
[37]
Stephen Oney and Joel Brandt. 2012. Codelets: Linking Interactive Documentation and Example Code in the Editor. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI ’12). Association for Computing Machinery, New York, NY, USA, 2697–2706. https://doi.org/10.1145/2207676.2208664
[38]
Peter Pirolli and Stuart Card. 1999. Information foraging.Psychological review 106, 4 (1999), 643.
[39]
Peter G. Polson and Clayton H. Lewis. 1990. Theory-Based Design for Easily Learned Interfaces. Hum. Comput. Interact. 5 (1990), 191–220.
[40]
Inigo Quilez. 2020. Graphtoy. https://graphtoy.com [Online; accessed 19-January-2023].
[41]
Casey Reas and Ben Fry. 2006. Processing: programming for the media arts. Ai & Society 20, 4 (2006), 526–538.
[42]
Christian Santoni and Fabio Pellacini. 2016. gTangle: A Grammar for the Procedural Generation of Tangle Patterns. ACM Trans. Graph. 35, 6 (Nov. 2016), 182:1–182:11. https://doi.org/10.1145/2980179.2982417
[43]
Martin Schneider and Moritz Wallawitsch. 2020. RemNote. https://www.remnote.com. [Online; accessed 19-January-2023].
[44]
Ben Shneiderman. 1983. Direct Manipulation: A Step Beyond Programming Languages. Computer 16, 8 (Aug. 1983), 57–69. https://doi.org/10.1109/MC.1983.1654471
[45]
Bret Victor. 2012. Learnable Programming. Designing a programming system for understanding programs. http://worrydream.com/#!/LearnableProgramming. [Online; accessed 19-January-2023].
[46]
Julie Wagner, Mathieu Nancel, Sean G. Gustafson, Stephane Huot, and Wendy E. Mackay. 2013. Body-centric design space for multi-surface interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’13). Association for Computing Machinery, New York, NY, USA, 1299–1308. https://doi.org/10.1145/2470654.2466170
[47]
David Ward, Alan Blackwell, and David Mackay. 2000. Dasher—a data entry interface using continuous gestures and language models. 129–137. https://doi.org/10.1145/354401.354427
[48]
Adam Wathan, Jonathan Reinink, David Hemphill, and Steve Schoger. 2019. Tailwind CSS. https://tailwindcss.com. [Online; accessed 21-January-2023].
Index Terms
- Exploring the Untapped Potential of Text Fields in Creative Software
Recommendations
The Creative Proteus Effect: How Self-Similarity, Embodiment, and Priming of Creative Stereotypes with Avatars Influences Creative Ideation
C&C '17: Proceedings of the 2017 ACM SIGCHI Conference on Creativity and CognitionCreative ideation can be enhanced in 3D virtual environments by manipulating the appearance of a user's avatar so that it primes a creative stereotype. However, not much is known about the factors that influence the effectiveness of using avatars to ...
Alchemy: experiments in interactive drawing, creativity, & serendipity
C&C '09: Proceedings of the seventh ACM conference on Creativity and cognitionThis paper presents an overview of Alchemy, an experimental drawing application aimed at exploring how we can sketch, draw, and create on computers in new ways. Alchemy focuses on the absolute initial stage of the creative process, to provide an ...
Homogenization Effects of Large Language Models on Human Creative Ideation
C&C '24: Proceedings of the 16th Conference on Creativity & CognitionLarge language models (LLMs) are now being used in a wide variety of contexts, including as creativity support tools (CSTs) intended to help their users come up with new ideas. But do LLMs actually support user creativity? We hypothesized that the use ...
Comments
Information & Contributors
Information
Published In
April 2023
288 pages
ISBN:9781450398244
DOI:10.1145/3583961
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 29 May 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Data Availability
Demonstration video of implemented concepts in Vector Pattern https://dl.acm.org/doi/10.1145/3583961.3583971#Demonstration_video_ihm23-10_VectorPattern_Exploring_potential_text_fields_Creative_software.mp4
Conference
IHM '23
IHM '23: 34th International Francophone Conference on Human-Computer Interaction
April 3 - 6, 2023
TROYES, France
Acceptance Rates
Overall Acceptance Rate 103 of 199 submissions, 52%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 46Total Downloads
- Downloads (Last 12 months)32
- Downloads (Last 6 weeks)6
Reflects downloads up to 17 Oct 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format