research-article

Metaphoraction: Support Gesture-based Interaction Design with Metaphorical Meanings

Authors:

Chengzhong Liu,

Xiaojuan MaAuthors Info & Claims

ACM Transactions on Computer-Human Interaction, Volume 29, Issue 5

Article No.: 45, Pages 1 - 33

https://doi.org/10.1145/3511892

Published: 20 October 2022 Publication History

Abstract

Previous user experience research emphasizes meaning in interaction design beyond conventional interactive gestures. However, existing exemplars that successfully reify abstract meanings through interactions are usually case-specific, and it is currently unclear how to systematically create or extend meanings for general gesture-based interactions. We present Metaphoraction, a creativity support tool that formulates design ideas for gesture-based interactions to show metaphorical meanings with four interconnected components: gesture, action, object, and meaning. To represent the interaction design ideas with these four components, Metaphoraction links interactive gestures to actions based on the similarity of appearances, movements, and experiences; relates actions to objects by applying the immediate association; bridges objects and meanings by leveraging the metaphor TARGET-SOURCE mappings. We build a dataset containing 588,770 unique design idea candidates through surveying related research and conducting two crowdsourced studies to support meaningful gesture-based interaction design ideation. Five design experts validate that Metaphoraction can effectively support creativity and productivity during the ideation process. The paper concludes by presenting insights into meaningful gesture-based interaction design and discussing potential future uses of the tool.

References

[1]

Natasha Abner, Kensy Cooperrider, and Susan Goldin-Meadow. 2015. Gesture for linguists: A handy primer. Language and Linguistics Compass 9, 11 (2015), 437–451. DOI:

[2]

AccpleMind. 2014. GuitarPad App for iPad. Retrieved from https://www.merlot.org/merlot/viewMaterial.htm?id=908036. (2014). (Accessed on 12/05/2019).

[3]

Sunggeun Ahn, Jaeyeon Lee, Keunwoo Park, and Geehyuk Lee. 2018. Evaluation of edge-based interaction on a square smartwatch. International Journal of Human-Computer Studies 109 (2018), 68–78. DOI:

Digital Library

[4]

Niek Althuizen and Berend Wierenga. 2014. Supporting creative problem solving with a case-based reasoning system. Journal of Management Information Systems 31, 1 (2014), 309–340.

[5]

Oliver Amft, Roman Amstutz, Asim Smailagic, Dan Siewiorek, and Gerhard Tröster. 2009. Gesture-Controlled user input to complete questionnaires on wrist-worn watches. In Proceedings of the Human-Computer Interaction. Novel Interaction Methods and Techniques, Julie A. Jacko (Ed.). Springer Berlin Heidelberg, Berlin, 131–140.

Digital Library

[6]

Stephen P. Anderson. 2011. Seductive Interaction Design: Creating Playful, Fun, and Effective User Experiences. Pearson Education, Berkeley, CA.

[7]

Rufino Ansara and Audrey Girouard. 2014. Augmenting bend gestures with pressure zones on flexible displays. In Proceedings of the 16th International Conference on Human-computer Interaction with Mobile Devices & Services. ACM, New York, NY, 531–536. DOI:

Digital Library

[8]

Alissa N. Antle, Milena Droumeva, and Greg Corness. 2008. Playing with the sound maker: Do embodied metaphors help children learn?. In Proceedings of the 7th International Conference on Interaction Design and Children. ACM, New York, NY, 178–185. DOI:

Digital Library

[9]

Shaikh Shawon Arefin Shimon, Courtney Lutton, Zichun Xu, Sarah Morrison-Smith, Christina Boucher, and Jaime Ruiz. 2016. Exploring non-touchscreen gestures for smartwatches. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 3822–3833. DOI:

Digital Library

[10]

Ilhan Aslan, Tabea Schmidt, Jens Woehrle, Lukas Vogel, and Elisabeth André. 2018. Pen + Mid-Air gestures: Eliciting contextual gestures. In Proceedings of the 20th ACM International Conference on Multimodal Interaction. ACM, New York, NY, 135–144. DOI:

Digital Library

[11]

Jeff Avery, Mark Choi, Daniel Vogel, and Edward Lank. 2014. Pinch-to-zoom-plus: An enhanced pinch-to-zoom that reduces clutching and panning. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, 595–604. DOI:

Digital Library

[12]

awwwards. 2016. Five Minutes - Drag, Gestures & Other Interactions - Awwwards. Retrieved from https://www.awwwards.com/inspiration/five-minutes. (September 2016). (Accessed on 09/19/2019).

[13]

Haitham Badi. 2016. RETRACTED ARTICLE: A survey on recent vision-based gesture recognition. Intelligent Industrial Systems 2, 2 (1 Jun. 2016), 179–191. DOI:

[14]

Suyun Sandra Bae, Oh-Hyun Kwon, Senthil Chandrasegaran, and Kwan-Liu Ma. 2020. Spinneret: Aiding creative ideation through non-obvious concept associations. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, 1–13. DOI:

Digital Library

[15]

Mathias Baglioni, Eric Lecolinet, and Yves Guiard. 2011. JerkTilts: Using accelerometers for eight-choice selection on mobile devices. In Proceedings of the 13th International Conference on Multimodal Interfaces. ACM, New York, NY, 121–128. DOI:

Digital Library

[16]

Saskia Bakker, Alissa N. Antle, and Elise Van Den Hoven. 2012. Embodied metaphors in tangible interaction design. Personal and Ubiquitous Computing 16, 4 (April 2012), 433–449. DOI:

Digital Library

[17]

Woodrow Barfield, Robert Shieldst, and Stephen Cooper. 1993. A survey of computer-aided design: Implications for creativity, productivity, decision making, and job satisfaction. International Journal of Human Factors in Manufacturing 3, 2 (1993), 153–167. DOI:

[18]

Arthur Asa Berger. 2018. Media and Communication Research Methods: An Introduction to Qualitative and Quantitative Approaches. Sage Publications, Los Angeles.

[19]

Alan F. Blackwell. 2006. The reification of metaphor as a design tool. ACM Transactions on Computer-Human Interaction 13, 4 (Dec. 2006), 490–530. DOI:

Digital Library

[20]

Mikhail Blinov, Matthieu Deru, and Daniel Sonntag. 2011. Mobile thumb interaction and speech. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services. ACM, New York, NY, 691–694. DOI:

Digital Library

[21]

Nathalie Bonnardel and Franck Zenasni. 2010. The impact of technology on creativity in design: An enhancement?Creativity and Innovation Management 19, 2 (2010), 180–191. DOI:

[22]

Andrei Broder. 2002. A taxonomy of web search. SIGIR Forum 36, 2 (Sept. 2002), 3–10. DOI:

Digital Library

[23]

Marc Brysbaert, Amy Beth Warriner, and Victor Kuperman. 2014. Concreteness ratings for 40 thousand generally known english word lemmas. Behavior Research Methods 46, 3 (1 Sep. 2014), 904–911. DOI:

[24]

Bill Buxton. 2007. Sketching User Experiences: Getting the Design Right and the Right Design. Morgan Kaufmann Publishers Inc., San Francisco, CA.

Digital Library

[25]

Vanessa Julia Carpenter and Elisa D. Mekler. 2019. Towards metrics of meaningfulness for tech practitioners. In Proceedings of the Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, Article CS03, 8 pages. DOI:

Digital Library

[26]

Erin A. Carroll. 2011. Convergence of self-report and physiological responses for evaluating creativity support tools. In Proceedings of the 8th ACM Conference on Creativity and Cognition. Association for Computing Machinery, New York, NY, 455–456. DOI:

Digital Library

[27]

Edwin Chan, Teddy Seyed, Wolfgang Stuerzlinger, Xing-Dong Yang, and Frank Maurer. 2016. User elicitation on single-hand microgestures. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 3403–3414. DOI:

Digital Library

[28]

Wei-Hung Chen. 2015. Blowatch: Blowable and hands-free interaction for smartwatches. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, 103–108. DOI:

Digital Library

[29]

Erin Cherry and Celine Latulipe. 2014. Quantifying the creativity support of digital tools through the creativity support index. ACM Transactions on Computer-Human Interaction 21, 4, Article 21 (June 2014), 25 pages. DOI:

Digital Library

[30]

Max Coltheart. 1981. The MRC psycholinguistic database. The Quarterly Journal of Experimental Psychology Section A 33, 4 (1981), 497–505.

[31]

Sara J. Czaja, Walter R. Boot, Neil Charness, and Wendy A. Rogers. 2019. Designing for Older Adults: Principles and Creative Human Factors Approaches. CRC press, Boca Raton.

[32]

Krzysztof Czuszynski, Jacek Ruminski, Adam Bujnowski, and Jerzy Wtorek. 2016. Semi complex navigation with an active optical gesture sensor. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct. ACM, New York, NY, 269–272. DOI:

Digital Library

[33]

James Deen, Seungyon “Claire” Lee, BoHao Li, and Thad Starner. 2010. Improving the form factor of a wrist-based mobile gesture interface. In Proceedings of the CHI’10 Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, 3679–3684. DOI:

Digital Library

[34]

Alice Deignan. 2005. Metaphor and Corpus Linguistics. John Benjamins Publishing, Amsterdam Philadelphia. 2005048393 Retrieved from https://books.google.com.au/books?id=aKJskGc_iPwC.

[35]

Xue Dou and S. Shyam Sundar. 2016. Power of the swipe: Why mobile websites should add horizontal swiping to tapping, clicking, and scrolling interaction techniques. International Journal of Human-Computer Interaction 32, 4 (2016), 352–362. DOI:

[36]

Paul Dourish. 2001. Where the Action is: The Foundations of Embodied Interaction. MIT Press, Cambridge, MA.

[37]

Alexander Keith Eady and Audrey Girouard. 2015. Caret manipulation using deformable input in mobile devices. In Proceedings of the 9th International Conference on Tangible, Embedded, and Embodied Interaction. ACM, New York, NY, 587–591. DOI:

Digital Library

[38]

PAUL EKMAN and WALLACE V. FRIESEN. 2010. The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding. De Gruyter Mouton, Berlin, Boston, 57–106. DOI:

[39]

Stephen H. Fairclough, Kiel Gilleade, Lennart E. Nacke, and Regan L. Mandryk. 2011. Brain and body interfaces: Designing for meaningful interaction. In Proceedings of the CHI’11 Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, 65–68. DOI:

Digital Library

[40]

Haakon Faste and Honray Lin. 2012. The untapped promise of digital mind maps. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 1017–1026. DOI:

Digital Library

[41]

Jonas Frich, Lindsay MacDonald Vermeulen, Christian Remy, Michael Mose Biskjaer, and Peter Dalsgaard. 2019. Mapping the landscape of creativity support tools in HCI. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, Article 389, 18 pages. DOI:

Digital Library

[42]

Eva Garcia-Lopez, Luis de Marcos, Antonio Garcia-Cabot, and Jose-Javier Martinez-Herraiz. 2015. Comparing zooming methods in mobile devices: Effectiveness, efficiency, and user satisfaction in touch and nontouch smartphones. International Journal of Human-Computer Interaction 31, 11 (2015), 777–789. DOI:

[43]

Monica J. Garfield, Nolan J. Taylor, Alan R. Dennis, and John W. Satzinger. 2001. Research report: Modifying paradigms—individual differences, creativity techniques, and exposure to ideas in group idea generation. Information Systems Research 12, 3 (2001), 322–333. DOI:

Digital Library

[44]

Romisa Rohani Ghahari, Jennifer George-Palilonis, and Davide Bolchini. 2013. Mobile web browsing with aural flows: An exploratory study. International Journal of Human-Computer Interaction 29, 11 (2013), 717–742. DOI:

[45]

Jun Gong, Yang Zhang, Xia Zhou, and Xing-Dong Yang. 2017. Pyro: Thumb-Tip gesture recognition using pyroelectric infrared sensing. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, 553–563. DOI:

Digital Library

[46]

Mitchell L. Gordon and Shumin Zhai. 2019. Touchscreen haptic augmentation effects on tapping, drag and drop, and path following. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, Article 373, 12 pages. DOI:

Digital Library

[47]

Sukeshini A. Grandhi, Gina Joue, and Irene Mittelberg. 2011. Understanding naturalness and intuitiveness in gesture production: Insights for touchless gestural interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 821–824. DOI:

Digital Library

[48]

Kristen K. Greene, Franklin P. Tamborello, and Ross J. Micheals. 2013. Computational cognitive modeling of touch and gesture on mobile multitouch devices: Applications and challenges for existing theory. In Proceedings of the Human-Computer Interaction. Interaction Modalities and Techniques, Masaaki Kurosu (Ed.). Springer Berlin Heidelberg, Berlin, 449–455.

Digital Library

[49]

Joy Paul Guilford. 1967. The Nature of Human Intelligence. McGraw-Hill, New York.

[50]

Hiroyuki Hakoda, Takuro Kuribara, Keigo Shima, Buntarou Shizuki, and Jiro Tanaka. 2015. AirFlip: A double crossing in-air gesture using boundary surfaces of hover zone for mobile devices. In Proceedings of the Human-Computer Interaction: Interaction Technologies, Masaaki Kurosu (Ed.). Springer International Publishing, Cham, 44–53.

[51]

Robert Hamilton, Jeffery Smith, and Ge Wang. 2011. Social composition: Musical data systems for expressive mobile music. Leonardo Music Journal 21, 21 (12/2011 2011), 57–64. DOI: .

[52]

Teng Han, Khalad Hasan, Keisuke Nakamura, Randy Gomez, and Pourang Irani. 2017. SoundCraft: Enabling spatial interactions on smartwatches using hand generated acoustics. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, 579–591. DOI:

Digital Library

[53]

Chris Harrison, Hrvoje Benko, and Andrew D. Wilson. 2011. OmniTouch: Wearable multitouch interaction everywhere. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, 441–450. DOI:

Digital Library

[54]

Steve Harrison, Deborah Tatar, and Phoebe Sengers. 2007. The three paradigms of HCI. In Proceedings of the Alt. Chi. Session at the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 1–18.

[55]

Sandra G. Hart. 2006. Nasa-Task load index (NASA-TLX); 20 years later. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 50, 9 (2006), 904–908. DOI:

[56]

Rex Hartson and Pardha S. Pyla. 2012. The UX Book: Process and Guidelines for Ensuring a Quality User Experience. Morgan Kaufmann, Boston.

Digital Library

[57]

Scarlett R. Herring, Chia-Chen Chang, Jesse Krantzler, and Brian P. Bailey. 2009. Getting inspired!: Understanding how and why examples are used in creative design practice. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 87–96. DOI:

Digital Library

[58]

Tom Hewett, Mary Czerwinski, Michael Terry, Jay Nunamaker, Linda Candy, Bill Kules, and Elisabeth Sylvan. 2005. Creativity support tool evaluation methods and metrics. Creativity Support Tools (2005), 10–24.

[59]

Juan David Hincapié-Ramos, Sophie Roscher, Wolfgang Büschel, Ulrike Kister, Raimund Dachselt, and Pourang Irani. 2014. tPad: Designing transparent-display mobile interactions. In Proceedings of the 2014 Conference on Designing Interactive Systems. ACM, New York, NY, 161–170. DOI:

Digital Library

[60]

Donny Huang, Xiaoyi Zhang, T. Scott Saponas, James Fogarty, and Shyamnath Gollakota. 2015. Leveraging dual-observable input for fine-grained thumb interaction using forearm EMG. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. ACM, New York, NY, 523–528. DOI:

Digital Library

[61]

Da-Yuan Huang, Liwei Chan, Shuo Yang, Fan Wang, Rong-Hao Liang, De-Nian Yang, Yi-Ping Hung, and Bing-Yu Chen. 2016. DigitSpace: Designing thumb-to-fingers touch interfaces for one-handed and eyes-free interactions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 1526–1537. DOI:

Digital Library

[62]

Ko-Hsun Huang and Yi-Shin Deng. 2008. Social interaction design in cultural context: A case study of a traditional social activity. International Journal of Design 2, 2 (2008), 81–96.

[63]

Kuo-Ying Huang. 2009. Challenges in human-computer interaction design for mobile devices. In Proceedings of the World Congress on Engineering and Computer Science, Vol. 1. Newswood Limited, San Francisco, 236–241.

[64]

Shah Rukh Humayoun, Franca-Alexandra Rupprecht, Steffen Hess, and Achim Ebert. 2014. Adding multi-touch gesture interaction in mobile web applications. In Proceedings of the Human-Computer Interaction. Advanced Interaction Modalities and Techniques, Masaaki Kurosu (Ed.). Springer International Publishing, Cham, 48–57.

[65]

C. C. M. Hummels, P. R. Ross, and C. J. Overbeeke. 2003. In search of resonant human computer interaction: Building and testing aesthetic installations. In Proceedings of Human-computer Interaction (Interact’03): IFIP TC13 International Conference, M. Rauterberg, M. Menozzi, Wesson, and J. Wesson (Eds.). IOS Press, Netherlands, 399–406.

[66]

Jörn Hurtienne, Christian Stöíel, Christine Sturm, Alexander Maus, Matthias Rötting, Patrick Langdon, and John Clarkson. 2010. Physical gestures for abstract concepts: Inclusive design with primary metaphors. Interacting with Computers 22, 6 (Nov. 2010), 475–484. DOI:

Digital Library

[67]

Nanna Inie and Peter Dalsgaard. 2017. A typology of design ideas. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition. ACM, New York, NY, 393–406. DOI:

Digital Library

[68]

Xu Jia, Kun-Pyo Lee, and Hyeon-Jeong Suk. 2011. Considerations of applying surface-based phone gestures to natural context. In Proceedings of the 13th International Conference on Ubiquitous Computing. ACM, New York, NY, 545–546. DOI:

Digital Library

[69]

Michael Johnston and Patrick Ehlen. 2012. Collecting multimodal data in the wild. In Proceedings of the 2012 ACM International Conference on Intelligent User Interfaces. ACM, New York, NY, 339–340. DOI:

Digital Library

[70]

Youwen Kang, Zhida Sun, Sitong Wang, Zeyu Huang, Ziming Wu, and Xiaojuan Ma. 2021. MetaMap: Supporting visual metaphor ideation through multi-dimensional example-based exploration. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, Article 427, 15 pages. DOI:

Digital Library

[71]

Guolin Ke, Qi Meng, Thomas Finley, Taifeng Wang, Wei Chen, Weidong Ma, Qiwei Ye, and Tie-Yan Liu. 2017. LightGBM: A highly efficient gradient boosting decision tree. In Proceedings of the 31st International Conference on Neural Information Processing Systems. Curran Associates Inc., Red Hook, NY, 3149–3157.

[72]

Guolin Ke, Qi Meng, Thomas Finley, Taifeng Wang, Wei Chen, Weidong Ma, Qiwei Ye, and Tie-Yan Liu. 2017. LightGBM: A highly efficient gradient boosting decision tree. In Proceedings of the 31st International Conference on Neural Information Processing Systems. Curran Associates Inc., 3149–3157. Retrieved from http://dl.acm.org/citation.cfm?id=3294996.3295074.

[73]

Andruid Kerne, Andrew M. Webb, Steven M. Smith, Rhema Linder, Nic Lupfer, Yin Qu, Jon Moeller, and Sashikanth Damaraju. 2014. Using metrics of curation to evaluate information-based ideation. ACM Transactions on Computer-Human Interaction 21, 3, Article 14 (June 2014), 48 pages. DOI:

Digital Library

[74]

Johan Kildal, Susanna Paasovaara, and Viljakaisa Aaltonen. 2012. Kinetic device: Designing interactions with a deformable mobile interface. In Proceedings of the CHI’12 Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, 1871–1876. DOI:

Digital Library

[75]

David Kim, Otmar Hilliges, Shahram Izadi, Alex D. Butler, Jiawen Chen, Iason Oikonomidis, and Patrick Olivier. 2012. Digits: Freehand 3D interactions anywhere using a wrist-worn gloveless sensor. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, 167–176. DOI:

Digital Library

[76]

Ju-Whan Kim, Han-Jong Kim, and Tek-Jin Nam. 2016. M.Gesture: An acceleration-based gesture authoring system on multiple handheld and wearable devices. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 2307–2318. DOI:

Digital Library

[77]

Panayiotis Koutsabasis and Panagiotis Vogiatzidakis. 2019. Empirical research in mid-air interaction: A systematic review. International Journal of Human–Computer Interaction 0, 0 (2019), 1–22. DOI:

[78]

Sven Kratz and Michael Rohs. 2009. HoverFlow: Expanding the design space of around-device interaction. In Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, New York, NY, Article 4, 8 pages. DOI:

Digital Library

[79]

Sven Kratz, Michael Rohs, and Georg Essl. 2013. Combining acceleration and gyroscope data for motion gesture recognition using classifiers with dimensionality constraints. In Proceedings of the 2013 International Conference on Intelligent User Interfaces. ACM, New York, NY, 173–178. DOI:

Digital Library

[80]

Interface Ecology Lab. 2015. \(IdeaM\hat{a}ch\acute{e}\). Retrieved from https://ideamache.ecologylab.net/. (2015). (Accessed on 08/19/2020).

[81]

Byron Lahey, Audrey Girouard, Winslow Burleson, and Roel Vertegaal. 2011. PaperPhone: understanding the use of bend gestures in mobile devices with flexible electronic paper displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 1303–1312. DOI:

Digital Library

[82]

Jianwei Lai, Dongsong Zhang, and Sen Wang. 2017. ContextZoom: A single-handed partial zooming technique for touch-screen mobile devices. International Journal of Human-Computer Interaction 33, 6 (2017), 475–485. DOI:

[83]

George Lakoff and Mark Johnson. 2008. Metaphors We Live by. University of Chicago Press, Chicago, IL.

[84]

Patrick Langdon, P. John Clarkson, and Peter Robinson. 2014. Designing Inclusive Interactions: Inclusive Interactions Between People and Products in Their Contexts of Use. Springer Publishing Company, Incorporated, London, UK.

[85]

Lucrezia Crescenzi Lanna and Mariona Grané© Oro. 2019. Touch gesture performed by children under 3 years old when drawing and coloring on a tablet. International Journal of Human-Computer Studies 124 (2019), 1–12. DOI:

[86]

Gierad Laput, Robert Xiao, and Chris Harrison. 2016. ViBand: High-Fidelity bio-acoustic sensing using commodity smartwatch accelerometers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST’16). ACM, New York, NY, USA, 321–333.

Digital Library

[87]

DoYoung Lee, Youryang Lee, Yonghwan Shin, and Ian Oakley. 2018. Designing socially acceptable hand-to-face input. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, 711–723. DOI:

Digital Library

[88]

H. Lee, S. Noh, and W. Woo. 2017. TunnelSlice: Freehand subspace acquisition using an egocentric tunnel for wearable augmented reality. IEEE Transactions on Human-Machine Systems 47, 1 (Feb. 2017), 128–139. DOI:

[89]

Hongsong Li, Kenny Q. Zhu, and Haixun Wang. 2013. Data-Driven metaphor recognition and explanation. Transactions of the Association for Computational Linguistics 1 (2013), 379–390.

[90]

Hyunchul Lim, Jungmin Chung, Changhoon Oh, SoHyun Park, Joonhwan Lee, and Bongwon Suh. 2018. Touch+Finger: Extending touch-based user interface capabilities with “idle” finger gestures in the air. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, 335–346. DOI:

Digital Library

[91]

Edward Loper and Steven Bird. 2002. NLTK: The natural language toolkit. In Proceedings of the ACL-02 Workshop on Effective Tools and Methodologies for Teaching Natural Language Processing and Computational Linguistics. Association for Computational Linguistics, Stroudsburg, PA, 63–70. DOI:

Digital Library

[92]

Kenneth R. MacCrimmon and Christian Wagner. 1994. Stimulating ideas through creative software. Management Science 40, 11 (1994), 1514–1532.

Digital Library

[93]

Mary Lou Maher and Lina Lee. 2017. Designing for gesture and tangible interaction. Synthesis Lectures on Human-Centered Interaction 10, 2 (2017), 111.

[94]

Theo Mahut, Carole Bouchard, Jean-François Omhover, Carole Favart, and Daniel Esquivel. 2017. Interaction design and metaphor through a physical and digital taxonomy. International Journal on Interactive Design and Manufacturing 12, 2 (July 2017), 629–649. DOI:

[95]

Laura Malinverni and Marie-Monique Schaper. 2018. An experience-centered framework for designing non-task-oriented embodied interaction environments. Multimodal Technologies and Interaction 2, 2 (May 2018), 22. DOI:

[96]

Meethu Malu, Pramod Chundury, and Leah Findlater. 2018. Exploring accessible smartwatch interactions for people with upper body motor impairments. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, Article 488, 12 pages. DOI:

Digital Library

[97]

William McGrath and Yang Li. 2014. Detecting tapping motion on the side of mobile devices by probabilistically combining hand postures. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, 215–219. DOI:

Digital Library

[98]

David McNeill. 1992. Hand and Mind: What Gestures Reveal About Thought. University of Chicago press, Chicago, IL. lc91032575

[99]

Elisa D. Mekler and Kasper Hornbæk. 2019. A framework for the experience of meaning in human-computer interaction. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, Article 225, 15 pages. DOI:

Digital Library

[100]

David Moher, Alessandro Liberati, Jennifer Tetzlaff, Douglas G. Altman, and the PRISMA Group. 2009. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA StatementThe PRISMA statement. Annals of Internal Medicine 151, 4 (08 2009), 264–269. DOI:

[101]

Felix Müller-Wienbergen, Oliver Müller, Stefan Seidel, and Jörg Becker. 2011. Leaving the beaten tracks in creative work–A design theory for systems that support convergent and divergent thinking. Journal of the Association for Information Systems 12, 11 (2011), 2. DOI:

[102]

Dennis C. Neale and John M. Carroll. 1997. The role of metaphors in user interface design. In Proceedings of the Handbook of Human-Computer Interaction (2nd edition ed.), Marting G. Helander, Thomas K. Landauer, and Prasad V. Prabhu (Eds.). North-Holland, Amsterdam, 441–462. DOI:

[103]

Alexander Ng, John Williamson, and Stephen Brewster. 2015. The effects of encumbrance and mobility on touch-based gesture interactions for mobile phones. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, New York, NY, 536–546. DOI:

Digital Library

[104]

Ian Oakley, DoYoung Lee, MD. Rasel Islam, and Augusto Esteves. 2015. Beats: Tapping gestures for smart watches. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, New York, NY, 1237–1246. DOI:

Digital Library

[105]

Gözde Özbal, Carlo Strapparava, Serra Sinem Tekiroğlu, and Daniele Pighin. 2016. Learning to identify metaphors from a corpus of proverbs. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Austin, Texas, 2060–2065. DOI:

[106]

Natalie Parde and Rodney D. Nielsen. 2018. Exploring the terrain of metaphor novelty: A regression-based approach for automatically scoring metaphors. Proceedings of the AAAI Conference on Artificial Intelligence 32, 1 (Apr. 2018), 5366–5373.

[107]

Doyun Park, Ji-Hyun Lee, and Sangtae Kim. 2011. Investigating the affective quality of interactivity by motion feedback in mobile touchscreen user interfaces. International Journal of Human-Computer Studies 69, 12 (2011), 839–853. DOI:

Digital Library

[108]

Jerome Pasquero, Scott J. Stobbe, and Noel Stonehouse. 2011. A haptic wristwatch for eyes-free interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 3257–3266. DOI:

Digital Library

[109]

Bhavina Patel, Vandana Shah, and Ravindra Kshirsagar. 2011. Microcontroller based gesture recognition system for the handicap people. Journal of Engineering Research and Studies 2, IV (2011), 113–115.

[110]

Vladimir I. Pavlovic, Rajeev Sharma, and Thomas S. Huang. 1997. Visual interpretation of hand gestures for human-computer interaction: A review. IEEE Transactions on Pattern Analysis 19, 7 (July 1997), 677–695. DOI:

Digital Library

[111]

Siddharth S. Rautaray and Anupam Agrawal. 2015. Vision based hand gesture recognition for human computer interaction: A survey. Artificial Intelligence Review 43, 1 (Jan. 2015), 1–54. DOI:

Digital Library

[112]

Kolle Rebbe. 2014. MISEREOR - The Social Swipe. Retrieved from https://www.kolle-rebbe.de/en/work/the-social-swipe/. (2014). (Accessed on 06/16/2019).

[113]

Christian Rendl, David Kim, Patrick Parzer, Sean Fanello, Martin Zirkl, Gregor Scheipl, Michael Haller, and Shahram Izadi. 2016. FlexCase: Enhancing mobile interaction with a flexible sensing and display cover. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 5138–5150. DOI:

Digital Library

[114]

Mitchel Resnick, Brad Myers, Kumiyo Nakakoji, Ben Shneiderman, Randy Pausch, Ted Selker, and Mike Eisenberg. 2005. Design principles for tools to support creative thinking. (2005). https://kilthub.cmu.edu/articles/journal_contribution/Design_Principles_for_Tools_to_Support_Creative_Thinking/6621917.

[115]

Thomas Van Rompay and Geke Ludden. 2015. Types of embodiment in design: The embodied foundations of meaning and affect in product design. International Journal of Design 9, 1 (2015), 1–11. Retrieved from http://www.ijdesign.org/index.php/IJDesign/article/view/1670/673.

[116]

Jaime Ruiz and Yang Li. 2010. DoubleFlip: A motion gesture delimiter for interaction. In Adjunct Proceedings of the 23rd Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, 449–450. DOI:

Digital Library

[117]

Jaime Ruiz, Yang Li, and Edward Lank. 2011. User-defined motion gestures for mobile interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 197–206. DOI:

Digital Library

[118]

Dan Saffer. 2005. The Role of Metaphor in Interaction Design. Diploma thesis. Carnegie Mellon University.

[119]

Katie Salen and Eric Zimmerman. 2005. Game Design and Meaningful Play. MIT Press Cambridge, MA, London, England, Chapter Design, 59–79.

[120]

Beatriz Sousa Santos, João Cardoso, Beatriz Quintino Ferreira, Carlos Ferreira, and Paulo Dias. 2016. Developing 3d freehand gesture-based interaction methods for virtual walkthroughs: Using an iterative approach. In Proceedings of the Handbook of Research on Human-Computer Interfaces, Developments, and Applications (1st ed.). IGI Global, 52–72.

[121]

Munehiko Sato, Ivan Poupyrev, and Chris Harrison. 2012. Touché: Enhancing touch interaction on humans, screens, liquids, and everyday objects. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 483–492. DOI:

Digital Library

[122]

Google Scholar. 2019. Human Computer Interaction - Google Scholar Metrics. Retrieved from https://scholar.google.com/citations?view_op=top_venues&hl=en&vq=eng_humancomputerinteraction. (2019). (Accessed on 06/01/2019).

[123]

Phoebe Sengers and Bill Gaver. 2006. Staying open to interpretation: Engaging multiple meanings in design and evaluation. In Proceedings of the 6th Conference on Designing Interactive Systems. Association for Computing Machinery, New York, NY, 99–108. DOI:

Digital Library

[124]

Marcos Serrano, Barrett M. Ens, and Pourang P. Irani. 2014. Exploring the use of hand-to-face input for interacting with head-worn displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 3181–3190. DOI:

Digital Library

[125]

Vidya Setlur, Agathe Battestini, Timothy Sohn, and Hiroshi Horii. 2010. Using gestures on mobile phones to create SMS comics. In Proceedings of the 4th International Conference on Tangible, Embedded, and Embodied Interaction. ACM, New York, NY, 217–220. DOI:

Digital Library

[126]

Shaikh Shawon Arefin Shimon, Sarah Morrison-Smith, Noah John, Ghazal Fahimi, and Jaime Ruiz. 2015. Exploring user-defined back-of-device gestures for mobile devices. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, New York, NY, 227–232. DOI:

Digital Library

[127]

Ben Shneiderman. 1996. The eyes have it: A task by data type taxonomy for information visualizations. In Proceedings of the 1996 IEEE Symposium on Visual Languages. IEEE Computer Society, 336–343. DOI:

[128]

Ben Shneiderman. 2002. Creativity support tools. Communications of the ACM 45, 10 (Oct. 2002), 116–120. DOI:

Digital Library

[129]

Smule. 2008. Ocarina on the App Store. Retrieved from https://apps.apple.com/us/app/ocarina/id293053479. (2008). (Accessed on 07/07/2019).

[130]

Jie Song, Gábor Sörös, Fabrizio Pece, Sean Ryan Fanello, Shahram Izadi, Cem Keskin, and Otmar Hilliges. 2014. In-air gestures around unmodified mobile devices. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, 319–329. DOI:

Digital Library

[131]

Jessica Speir, Rufino R. Ansara, Colin Killby, Emily Walpole, and Audrey Girouard. 2014. Wearable remote control of a mobile device: Comparing one- and two-handed interaction. In Proceedings of the 16th International Conference on Human-computer Interaction with Mobile Devices & Services. ACM, New York, NY, 489–494. DOI:

Digital Library

[132]

Christian Stössel. 2009. Familiarity as a factor in designing finger gestures for elderly users. In Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, New York, NY, Article 78, 2 pages. DOI:

Digital Library

[133]

Ke Sun, Yuntao Wang, Chun Yu, Yukang Yan, Hongyi Wen, and Yuanchun Shi. 2017. Float: One-Handed and touch-free target selection on smartwatches. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 692–704. DOI:

Digital Library

[134]

Liang Tan and Kenny K. N. Chow. 2017. Facilitating meaningful experience with ambient media: An embodied engagement model. In Proceedings of the 5th International Symposium of Chinese CHI. ACM, New York, NY, 36–46. DOI:

Digital Library

[135]

Liang Tan and Kenny K. N. Chow. 2018. An embodied approach to designing meaningful experiences with ambient media. Multimodal Technologies and Interaction 2, 2 (Apr. 2018), 13. DOI:

[136]

Aneesh P. Tarun, Byron Lahey, Audrey Girouard, Winslow Burleson, and Roel Vertegaal. 2011. Snaplet: Using body shape to inform function in mobile flexible display devices. In Proceedings of the (CHI’11) Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, 329–334. DOI:

Digital Library

[137]

Serra Sinem Tekiroğlu, Gözde Özbal, and Carlo Strapparava. 2015. Exploring sensorial features for metaphor identification. In Proceedings of the 3rd Workshop on Metaphor in NLP. Association for Computational Linguistics, Denver, Colorado, 31–39. DOI:

[138]

TetraBIN. 2013. TetraBIN|Your Favourite Trash Bin. Retrieved from http://www.tetrabin.com/. (2013). (Accessed on 12/04/2019).

[139]

Theophanis Tsandilas, Caroline Appert, Anastasia Bezerianos, and David Bonnet. 2014. Coordination of tilt and touch in one- and two-handed use. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 2001–2004. DOI:

Digital Library

[140]

Bradley Paul van Tonder and Janet Louise Wesson. 2012. Improving the controllability of tilt interaction for mobile map-based applications. International Journal of Human-Computer Studies 70, 12 (2012), 920–935. DOI:

Digital Library

[141]

Alvaro Videla. 2017. Metaphors we compute by. Communications of the ACM 60, 10 (Sept. 2017), 42–45. DOI:

Digital Library

[142]

Panagiotis Vogiatzidakis and Panayiotis Koutsabasis. 2018. Gesture elicitation studies for mid-air interaction: A review. Multimodal Technologies and Interaction 2, 4 (2018), 65. DOI:

[143]

Tijana Vuletic, Alex Duffy, Laura Hay, Chris McTeague, Gerard Campbell, and Madeleine Grealy. 2019. Systematic literature review of hand gestures used in human computer interaction interfaces. International Journal of Human-Computer Studies 129 (2019), 74–94. DOI:

Digital Library

[144]

Kai Wang and Jeffrey V. Nickerson. 2017. A literature review on individual creativity support systems. Computers in Human Behavior 74 (2017), 139–151. DOI:

[145]

Saiwen Wang, Jie Song, Jaime Lien, Ivan Poupyrev, and Otmar Hilliges. 2016. Interacting with soli: Exploring fine-grained dynamic gesture recognition in the radio-frequency spectrum. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, New York, NY, 851–860. DOI:

Digital Library

[146]

Andy Warr and Eamonn O’Neill. 2005. Understanding design as a social creative process. In Proceedings of the 5th Conference on Creativity & Cognition. ACM, New York, NY, 118–127. DOI:

Digital Library

[147]

Martin Weigel and Jürgen Steimle. 2017. DeformWear: deformation input on tiny wearable devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 2, Article 28 (June 2017), 23 pages. DOI:

Digital Library

[148]

Hongyi Wen, Julian Ramos Rojas, and Anind K. Dey. 2016. Serendipity: Finger gesture recognition using an off-the-shelf smartwatch. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, New York, NY, 3847–3851. DOI:

Digital Library

[149]

Anusha Withana, Roshan Peiris, Nipuna Samarasekara, and Suranga Nanayakkara. 2015. zSense: Enabling shallow depth gesture recognition for greater input expressivity on smart wearables. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, New York, NY, 3661–3670. DOI:

Digital Library

[150]

Anusha Withana, Shanaka Ransiri, Tharindu Kaluarachchi, Chanaka Singhabahu, Yilei Shi, Samitha Elvitigala, and Suranga Nanayakkara. 2016. waveSense: Ultra low power gesture sensing based on selective volumetric illumination. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, New York, NY, 139–140. DOI:

Digital Library

[151]

Claes Wohlin. 2014. Guidelines for snowballing in systematic literature studies and a replication in software engineering. In Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering. ACM, New York, NY, Article 38, 10 pages. DOI:

Digital Library

[152]

Wanyu Xi, Han Gong, and Quansheng Wang. 2019. How hand gestures influence the enjoyment in gamified mobile marketing. International Journal of Human-Computer Studies 127 (2019), 169–180. DOI:

Digital Library

[153]

Xiang Xiao, Teng Han, and Jingtao Wang. 2013. LensGesture: Augmenting mobile interactions with back-of-device finger gestures. In Proceedings of the 15th ACM on International Conference on Multimodal Interaction. ACM, New York, NY, 287–294. DOI:

Digital Library

[154]

Wataru Yamada, Hiroyuki Manabe, Hiroyuki Hakoda, Keiichi Ochiai, and Daizo Ikeda. 2017. CamTrackPoint: Pointing stick for mobile device using rear camera. In Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers. ACM, New York, NY, 321–324. DOI:

Digital Library

[155]

Yukang Yan, Chun Yu, Xin Yi, and Yuanchun Shi. 2018. HeadGesture: Hands-Free input approach leveraging head movements for HMD devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 4, Article 198 (Dec. 2018), 23 pages. DOI:

Digital Library

[156]

J. Ylipulli, A. Luusua, and T. Ojala. 2017. On creative metaphors in technology design: Case “Magic”. In Proceedings of the 8th International Conference on Communities and Technologies. Association for Computing Machinery, New York, NY, 280–289. DOI:

Digital Library

[157]

Lenka Zdrazilova, David M. Sidhu, and Penny M. Pexman. 2018. Communicating abstract meaning: Concepts revealed in words and gestures. Philosophical transactions of the Royal Society of London. Series B, Biological sciences 373, 1752 (August 2018), 10. DOI:

[158]

Yang Zhang and Chris Harrison. 2015. Tomo: Wearable, low-cost electrical impedance tomography for hand gesture recognition. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. ACM, New York, NY, 167–173. DOI:

Digital Library

[159]

Chen Zhao, Ke-Yu Chen, Md Tanvir Islam Aumi, Shwetak Patel, and Matthew S. Reynolds. 2014. SideSwipe: Detecting in-air gestures around mobile devices using actual GSM signal. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, 527–534. DOI:

Digital Library

Cited By

Caro-Alvaro SGarcia-Lopez EBrun-Guajardo AGarcia-Cabot AMavri A(2024)Gesture-Based Interactions: Integrating Accelerometer and Gyroscope Sensors in the Use of Mobile AppsSensors10.3390/s2403100424:3(1004)Online publication date: 4-Feb-2024
https://doi.org/10.3390/s24031004
Zeng XWang XZhang TYu CZhao SChen Y(2024)GestureGPT: Toward Zero-Shot Free-Form Hand Gesture Understanding with Large Language Model AgentsProceedings of the ACM on Human-Computer Interaction10.1145/36981458:ISS(462-499)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698145
Wu LLafreniere BGrossman TWhite TSantosa S(2024)Body Language for VUIs: Exploring Gestures to Enhance Interactions with Voice User InterfacesProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660691(133-150)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660691
Show More Cited By

Index Terms

Metaphoraction: Support Gesture-based Interaction Design with Metaphorical Meanings
1. Human-centered computing
  1. Interaction design
    1. Interaction design theory, concepts and paradigms
    2. Systems and tools for interaction design

Recommendations

Embodied metaphors in tangible interaction design

For centuries, learning and development has been supported by physical activity and manipulating physical objects. With the introduction of embedded technologies, opportunities for employing tangible or embodied interaction for learning and development ...
Fostering metaphorical creativity using computational metaphor identification
C&C '09: Proceedings of the seventh ACM conference on Creativity and cognition

Metaphor is often seen as a mode of creative thinking or as a means of fostering creativity. However, little work has studied creative generation of novel metaphors. This paper explores the use of computational metaphor identification (CMI) to foster ...
Fluid gesture interaction design: Applications of continuous recognition for the design of modern gestural interfaces

This article presents Gesture Interaction DEsigner (GIDE), an innovative application for gesture recognition. Instead of recognizing gestures only after they have been entirely completed, as happens in classic gesture recognition systems, GIDE exploits ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Computer-Human Interaction

ACM Transactions on Computer-Human Interaction Volume 29, Issue 5

October 2022

453 pages

ISSN:1073-0516

EISSN:1557-7325

DOI:10.1145/3561950

Editor:
Kristina Höök
KTH Royal Institute of Technology, Sweden

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 October 2022

Online AM: 24 February 2022

Accepted: 16 January 2022

Revised: 08 August 2021

Received: 28 December 2019

Published in TOCHI Volume 29, Issue 5

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Refereed

Funding Sources

Research Grants Council of the Hong Kong Special Administrative Region, China under General Research Fund (GRF)
HKUST-WeBank Joint Laboratory Project

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
2,012
Total Downloads

Downloads (Last 12 months)643
Downloads (Last 6 weeks)79

Reflects downloads up to 24 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Caro-Alvaro SGarcia-Lopez EBrun-Guajardo AGarcia-Cabot AMavri A(2024)Gesture-Based Interactions: Integrating Accelerometer and Gyroscope Sensors in the Use of Mobile AppsSensors10.3390/s2403100424:3(1004)Online publication date: 4-Feb-2024
https://doi.org/10.3390/s24031004
Zeng XWang XZhang TYu CZhao SChen Y(2024)GestureGPT: Toward Zero-Shot Free-Form Hand Gesture Understanding with Large Language Model AgentsProceedings of the ACM on Human-Computer Interaction10.1145/36981458:ISS(462-499)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698145
Wu LLafreniere BGrossman TWhite TSantosa S(2024)Body Language for VUIs: Exploring Gestures to Enhance Interactions with Voice User InterfacesProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660691(133-150)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660691
Chen QShuai WZhang JSun ZCao N(2024)Beyond Numbers: Creating Analogies to Enhance Data Comprehension and Communication with Generative AIProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642480(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642480
Illi MGustafsson RMasoodian M(2024)Visual metaphors for collaboration planning in strategy meetingsJournal of Strategy and Management10.1108/JSMA-05-2024-008917:4(781-801)Online publication date: 17-Oct-2024
https://doi.org/10.1108/JSMA-05-2024-0089
Bilius LUngurean OVatavu R(2023)An Expressivity-Complexity Tradeoff?: User-Defined Gestures from the Wheelchair Space are Mostly DeicticExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585695(1-8)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585695
Zhang YWang ZZhang JShan GTian D(2023)A survey of immersive visualization: Focus on perception and interactionVisual Informatics10.1016/j.visinf.2023.10.0037:4(22-35)Online publication date: Dec-2023
https://doi.org/10.1016/j.visinf.2023.10.003

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View full text|Download PDF

View Issue’s Table of Contents