Becoming Q: Using Design Workshops to Explore Everyday Objects as Interaction Devices for an Augmented Reality Spy Game
Article No.: 6, Pages 1 - 11
Abstract
The work in this paper extends state of the art research in the field of interaction design for everyday objects as interaction devices in Augmented Reality (AR), by taking a user defined approach to explore how users understand everyday objects as interaction devices in an AR game. A survey (n = 16) and workshop (n = 10) were conducted with members of the general public. The survey asked participants to select several everyday objects from their day to day life, answer questions regarding the object’s normal function, to think of and consider what the object could do if it was a spy gadget. The workshop followed up on this survey, participants were asked to bring their selected objects along, and during the workshop participants considered the objects they and other participants brought to collaboratively create new ideas about how these objects could be used if they were spy gadgets. The workshops were recorded and reviewed using reflexive thematic analysis, identifying four themes for interaction designers in this space to consider: ‘what players look for in objects’, ‘how players want to use objects’, ‘what players want their objects to be capable of in game’ and ‘concerns players have about object use’.
References
[1]
Thomas Binder. 2015. Setting the stage for improvised video scenarios. In CHI ’99 Extended Abstracts on Human Factors in Computing Systems (New York, NY, USA, 1999-05-15) (CHI EA ’99). Association for Computing Machinery, New York, NY, USA, 230–231. https://doi.org/10.1145/632716.632859
[2]
Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3 (01 2006), 77–101. https://doi.org/10.1191/1478088706qp063oa
[3]
Kai-Yin Cheng, Rong-Hao Liang, Bing-Yu Chen, Rung-Huei Laing, and Sy-Yen Kuo. 2010. ICon: Utilizing Everyday Objects as Additional, Auxiliary and Instant Tabletop Controllers. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI ’10). Association for Computing Machinery, New York, NY, USA, 1155–1164. https://doi.org/10.1145/1753326.1753499
[4]
Christian Corsten, Ignacio Avellino, Max Möllers, and Jan Borchers. 2013. Instant User Interfaces: Repurposing Everyday Objects as Input Devices. In Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces (St. Andrews, Scotland, United Kingdom) (ITS ’13). Association for Computing Machinery, New York, NY, USA, 71–80. https://doi.org/10.1145/2512349.2512799
[5]
Yngve Dahl and Kshitij Sharma. 2022. Six Facets of Facilitation: Participatory Design Facilitators’ Perspectives on Their Role and Its Realization. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems(CHI ’22). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3491102.3502013
[6]
Florian Daiber, Donald Degraen, André Zenner, Tanja Döring, Frank Steinicke, Oscar Javier Ariza Nunez, and Adalberto L. Simeone. 2021. Everyday Proxy Objects for Virtual Reality. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems(CHI EA ’21). Association for Computing Machinery, New York, NY, USA, 1–6. https://doi.org/10.1145/3411763.3441343
[7]
Peter Dalsgaard. 2012. Participatory Design in Large-Scale Public Projects: Challenges and Opportunities. Design Issues 28, 3 (2012), 34–47. https://www.jstor.org/stable/23273837 Publisher: The MIT Press.
[8]
Adam Drogemuller, James Walsh, Ross T. Smith, Matt Adcock, and Bruce H Thomas. 2021. Turning Everyday Objects into Passive Tangible Controllers. In Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction (Salzburg, Austria) (TEI ’21). Association for Computing Machinery, New York, NY, USA, Article 54, 4 pages. https://doi.org/10.1145/3430524.3442460
[9]
Ruofei Du, Alex Olwal, Mathieu Le Goc, Shengzhi Wu, Danhang Tang, Yinda Zhang, Jun Zhang, David Joseph Tan, Federico Tombari, and David Kim. 2022. Opportunistic Interfaces for Augmented Reality: Transforming Everyday Objects into Tangible 6DoF Interfaces Using Ad hoc UI. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (New York, NY, USA, 2022-04-28) (CHI EA ’22). Association for Computing Machinery, New York, NY, USA, 1–4. https://doi.org/10.1145/3491101.3519911
[10]
Pelle Ehn. 1988. Work-Oriented Design of Computer Artifacts. Arbetslivscentrum, Umeå, Sweden.
[11]
Cathy Mengying Fang, Ryo Suzuki, and Daniel Leithinger. 2023. VR Haptics at Home: Repurposing Everyday Objects and Environment for Casual and On-Demand VR Haptic Experiences. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems(CHI EA ’23). Association for Computing Machinery, New York, NY, USA, 1–7. https://doi.org/10.1145/3544549.3585871
[12]
Markus Funk, Oliver Korn, and Albrecht Schmidt. 2014. An augmented workplace for enabling user-defined tangibles. In CHI ’14 Extended Abstracts on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI EA ’14). Association for Computing Machinery, New York, NY, USA, 1285–1290. https://doi.org/10.1145/2559206.2581142
[13]
William W. Gaver, Andrew Boucher, Sarah Pennington, and Brendan Walker. 2004. Cultural probes and the value of uncertainty. Interactions 11, 5 (sep 2004), 53–56. https://doi.org/10.1145/1015530.1015555
[14]
Mac Greenslade, Adrian J. Clark, and Stephan G. Lukosch. 2023. Using Everyday Objects as Props for Virtual Objects in First Person Augmented Reality Games: An Elicitation Study. Proc. ACM Hum. Comput. Interact. 7, CHI (2023), 856–875. https://doi.org/10.1145/3611052
[15]
Steven J. Henderson and Steven Feiner. 2008. Opportunistic Controls: Leveraging Natural Affordances as Tangible User Interfaces for Augmented Reality. In Proceedings of the 2008 ACM Symposium on Virtual Reality Software and Technology (Bordeaux, France) (VRST ’08). Association for Computing Machinery, New York, NY, USA, 211–218. https://doi.org/10.1145/1450579.1450625
[16]
Anuruddha Hettiarachchi and Daniel Wigdor. 2016. Annexing Reality: Enabling Opportunistic Use of Everyday Objects as Tangible Proxies in Augmented Reality. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 1957–1967. https://doi.org/10.1145/2858036.2858134
[17]
Steve Howard, Jennie Carroll, John Murphy, and Jane Peck. 2002. Using ’endowed props’ in scenario-based design. In Proceedings of the second Nordic conference on Human-computer interaction (New York, NY, USA, 2002-10-19) (NordiCHI ’02). Association for Computing Machinery, New York, NY, USA, 1–10. https://doi.org/10.1145/572020.572022
[18]
Rahul Jain, Jingyu Shi, Runlin Duan, Zhengzhe Zhu, Xun Qian, and Karthik Ramani. 2023. Ubi-TOUCH: Ubiquitous Tangible Object Utilization through Consistent Hand-object interaction in Augmented Reality. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (, San Francisco, CA, USA,) (UIST ’23). Association for Computing Machinery, New York, NY, USA, Article 12, 18 pages. https://doi.org/10.1145/3586183.3606793
[19]
Kari Kuutti, Giulio Iacucci, and Carlo Iacucci. 2002. Acting to know: improving creativity in the design of mobile services by using performances. In Proceedings of the 4th conference on Creativity & cognition (New York, NY, USA, 2002-10-13) (C&C ’02). Association for Computing Machinery, New York, NY, USA, 95–102. https://doi.org/10.1145/581710.581726
[20]
Akhmajon Makhsadov, Donald Degraen, André Zenner, Felix Kosmalla, Kamila Mushkina, and Antonio Krüger. 2022. VRySmart: a Framework for Embedding Smart Devices in Virtual Reality. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems(CHI EA ’22). Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/3491101.3519717
[21]
Kyzyl Monteiro, Ritik Vatsal, Neil Chulpongsatorn, Aman Parnami, and Ryo Suzuki. 2023. Teachable Reality: Prototyping Tangible Augmented Reality with Everyday Objects by Leveraging Interactive Machine Teaching. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems(CHI ’23). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3544548.3581449
[22]
Marco Moran-Ledesma, Oliver Schneider, and Mark Hancock. 2021. User-Defined Gestures with Physical Props in Virtual Reality. Proc. ACM Hum.-Comput. Interact. 5, ISS, Article 488 (nov 2021), 23 pages. https://doi.org/10.1145/3486954
[23]
Michael J. Muller and Sarah Kuhn. 1993. Participatory Design. Commun. ACM 36, 6 (jun 1993), 24–28. https://doi.org/10.1145/153571.255960
[24]
Steve Sato and Tony Salvador. 1999. Methods & tools: Playacting and focus troupes: theater techniques for creating quick, intense, immersive, and engaging focus group sessions. Interactions 6, 5 (1999), 35–41. https://doi.org/10.1145/312683.312715
[25]
Jesper Simonsen and Toni Robertson. 2013. Routledge International Handbook of Participatory Design - 1st Edition. Routledge, New York, New York, NY, USA.
[26]
Carolin Stellmacher, Florian Mathis, Yannick Weiss, Meagan B. Loerakker, Nadine Wagener, and Johannes Schöning. 2024. Exploring Mobile Devices as Haptic Interfaces for Mixed Reality. In Proceedings of the CHI Conference on Human Factors in Computing Systems(CHI ’24). Association for Computing Machinery, New York, NY, USA, 1–17. https://doi.org/10.1145/3613904.3642176
[27]
Dag Svanaes and Gry Seland. 2004. Putting the users center stage: role playing and low-fi prototyping enable end users to design mobile systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’04). Association for Computing Machinery, New York, NY, USA, 479–486. https://doi.org/10.1145/985692.985753
[28]
Radu-Daniel Vatavu. 2023. Leveraging Sensorimotor Realities for Assistive Technology Design Bridging Smart Environments and Virtual Worlds. In Proceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments(PETRA ’23). Association for Computing Machinery, New York, NY, USA, 247–253. https://doi.org/10.1145/3594806.3594834
[29]
Radu-Daniel Vatavu and Jacob O. Wobbrock. 2015. Formalizing Agreement Analysis for Elicitation Studies: New Measures, Significance Test, and Toolkit. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 1325–1334. https://doi.org/10.1145/2702123.2702223
[30]
James A. Walsh, Stewart von Itzstein, and Bruce H. Thomas. 2014. Ephemeral Interaction Using Everyday Objects. In Proceedings of the Fifteenth Australasian User Interface Conference - Volume 150 (Auckland, New Zealand) (AUIC ’14). Australian Computer Society, Inc., AUS, 29–37.
[31]
Qian Zhou, Sarah Sykes, Sidney Fels, and Kenrick Kin. 2020. Gripmarks: Using Hand Grips to Transform In-Hand Objects into Mixed Reality Input. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–11. https://doi.org/10.1145/3313831.3376313
Index Terms
- Becoming Q: Using Design Workshops to Explore Everyday Objects as Interaction Devices for an Augmented Reality Spy Game
Recommendations
Teachable Reality: Prototyping Tangible Augmented Reality with Everyday Objects by Leveraging Interactive Machine Teaching
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing SystemsThis paper introduces Teachable Reality, an augmented reality (AR) prototyping tool for creating interactive tangible AR applications with arbitrary everyday objects. Teachable Reality leverages vision-based interactive machine teaching (e.g., Teachable ...
Using Everyday Objects as Props for Virtual Objects in First Person Augmented Reality Games: An Elicitation Study
In this paper, we present an elicitation study which explores how people use common household objects as props to control virtual objects in augmented reality first-person perspective games. 24 participants were asked to select items from a range of ...
Purpose-Centric Appropriation of Everyday Objects as Game Controllers
CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing SystemsGeneric multi-button controllers are the most common input devices used for video games. In contrast, dedicated game controllers and gestural interactions increase immersion and playability. Room-sized gaming has opened up possibilities to further ...
Comments
Information & Contributors
Information
Published In
October 2024
396 pages
ISBN:9798400710889
DOI:10.1145/3677386
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 07 October 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
Acceptance Rates
Overall Acceptance Rate 86 of 279 submissions, 31%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 167Total Downloads
- Downloads (Last 12 months)167
- Downloads (Last 6 weeks)47
Reflects downloads up to 08 Feb 2025
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in