research-article

Open access

Democratizing Design and Fabrication Using Speech: Exploring co-design with a voice assistant

Authors:

David Goedicke,

J.D. Zamfirescu-PereiraAuthors Info & Claims

CUI '21: Proceedings of the 3rd Conference on Conversational User Interfaces

Article No.: 29, Pages 1 - 8

https://doi.org/10.1145/3469595.3469624

Published: 27 July 2021 Publication History

All formats PDF

Abstract

Recent advances in artificial intelligence (AI) and voice interfaces have made possible the digital reincarnation of the draftsperson and craftsperson, capable of designing and producing custom work “to spec” for a reasonable cost. We present findings from an experiment using a Wizard-of-Oz-backed recreation of a voice assistant-based designer; participants describe a holiday ornament of their own imagination to the voice assistant, which elicits details and offers design choices before ultimately “creating” the ornament for the participant. For 8 out of 16 participants, a video channel allows the participant to see the designed object as it is iteratively designed and refined. We offer observations about the nature of the interactions between participants and the voice assistant, as well as quantitative measures of participant-reported cognitive load and predicted and actual satisfaction and accuracy of reproduction. Participants report greater satisfaction with their ornaments and experience reduced cognitive load if they can see them being designed; their expectations are higher if they cannot. 15 of 16 participants would use a voice assistant again for a design task.

References

[1]

Kirsten Boehner, Janet Vertesi, Phoebe Sengers, and Paul Dourish. 2007. How HCI interprets the probes. In Proceedings of the SIGCHI conference on Human factors in computing systems. 1077–1086.

Digital Library

[2]

Herbert H Clark, Susan E Brennan, 1991. Grounding in communication. Perspectives on socially shared cognition 13, 1991 (1991), 127–149.

[3]

Lizabeth Cohen. 2004. A consumers’ republic: The politics of mass consumption in postwar America. Journal of Consumer Research 31, 1 (2004), 236–239.

[4]

Cathy Lynne Costin. 2001. Craft production systems. In Archaeology at the millennium. Springer, 273–327.

[5]

Tom Fisher and Julie Botticello. 2018. Machine-made lace, the spaces of skilled practices and the paradoxes of contemporary craft production. cultural geographies 25, 1 (2018), 49–69.

[6]

Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology. Vol. 52. Elsevier, 139–183.

[7]

John Atkinson Hobson. 1919. The evolution of modern capitalism: a study of machine production. Walter Scott Publishing Company.

[8]

Forrest Huang, Eldon Schoop, David Ha, and John Canny. 2020. Scones: towards conversational authoring of sketches. In Proceedings of the 25th International Conference on Intelligent User Interfaces. 313–323.

Digital Library

[9]

Robert E Kraut, Darren Gergle, and Susan R Fussell. 2002. The use of visual information in shared visual spaces: Informing the development of virtual co-presence. In Proceedings of the 2002 ACM conference on Computer supported cooperative work. ACM, 31–40.

Digital Library

[10]

Minae Kwon, Malte F Jung, and Ross A Knepper. 2016. Human expectations of social robots. In Human-Robot Interaction (HRI), 2016 11th ACM/IEEE International Conference on. IEEE, 463–464.

[11]

Gierad P Laput, Mira Dontcheva, Gregg Wilensky, Walter Chang, Aseem Agarwala, Jason Linder, and Eytan Adar. 2013. Pixeltone: A multimodal interface for image editing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2185–2194.

Digital Library

[12]

Min Kyung Lee, Sara Kiesler, and Jodi Forlizzi. 2010. Receptionist or information kiosk: how do people talk with a robot?. In Proceedings of the 2010 ACM conference on Computer supported cooperative work. ACM, 31–40.

Digital Library

[13]

Nikolas Martelaro and Wendy Ju. 2017. WoZ Way: Enabling real-time remote interaction prototyping & observation in on-road vehicles. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 169–182.

Digital Library

[14]

Moira McGregor and John C Tang. 2017. More to meetings: challenges in using speech-based technology to support meetings. In Proceedings of the 2017 ACM conference on computer supported cooperative work and social computing. 2208–2220.

Digital Library

[15]

Nicholas Negroponte. 1975. Soft architecture machines. MIT press Cambridge, MA.

[16]

Gary M Olson and Judith S Olson. 2000. Distance matters. Human–computer interaction 15, 2-3 (2000), 139–178.

[17]

Peter Pirolli and Stuart Card. 1995. Information foraging in information access environments. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM Press/Addison-Wesley Publishing Co., 51–58.

Digital Library

[18]

Ellis A Van Den Hende and Jan PL Schoormans. 2012. The story is as good as the real thing: Early customer input on product applications of radically new technologies. Journal of Product Innovation Management 29, 4 (2012), 655–666.

[19]

Julia Walter-Herrmann and Corinne Büching. 2014. FabLab: Of machines, makers and inventors. transcript Verlag.

[20]

Zhan Zhang, Aleksandra Sarcevic, and Claus Bossen. 2017. Constructing Common Information Spaces across Distributed Emergency Medical Teams. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 934–947.

Digital Library

Cited By

Seaborn KSawa YWatanabe M(2024)Coimagining the Future of Voice Assistants with Cultural SensitivityHuman Behavior and Emerging Technologies10.1155/2024/32387372024(1-21)Online publication date: 25-Mar-2024
https://doi.org/10.1155/2024/3238737
Woodward KKanjo EBrown DMcGinnity THarold G(2023)In the hands of users with intellectual disabilities: co-designing tangible user interfaces for mental wellbeingPersonal and Ubiquitous Computing10.1007/s00779-023-01752-x27:6(2171-2191)Online publication date: 3-Oct-2023
https://dl.acm.org/doi/10.1007/s00779-023-01752-x
Desolda GEsposito AMüller FFeger S(2023)Digital Modeling for Everyone: Exploring How Novices Approach Voice-Based 3D ModelingHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42293-5_11(133-155)Online publication date: 28-Aug-2023
https://dl.acm.org/doi/10.1007/978-3-031-42293-5_11

Recommendations

An Empirical Study of Older Adult’s Voice Assistant Use for Health Information Seeking
Although voice assistants are increasingly being adopted by older adults, we lack empirical research on how they interact with these devices for health information seeking. Also, prior work shows how voice assistant responses can provide misleading or ...
Older adults' perceptions and experiences of online social support

This paper reports an investigation of older adults' needs and preferences concerning online social support. We focused our analysis on seven different aspects of online support: Self disclosure, Deep support, Light support, Community building, ...
"Alexa is a Toy": Exploring Older Adults' Reasons for Using, Limiting, and Abandoning Echo
CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Intelligent voice assistants (IVAs) have the potential to support older adults' independent living. However, despite a growing body of research focusing on IVA use, we know little about why older adults become IVA non-users. This paper examines the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

CUI '21: Proceedings of the 3rd Conference on Conversational User Interfaces

July 2021

262 pages

ISBN:9781450389983

DOI:10.1145/3469595

Copyright © 2021 Owner/Author.

This work is licensed under a Creative Commons Attribution-ShareAlike International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 July 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

National Science Foundation

Conference

CUI '21

CUI '21: CUI 2021 - 3rd Conference on Conversational User Interfaces

July 27 - 29, 2021

Bilbao (online), Spain

Acceptance Rates

Overall Acceptance Rate 34 of 100 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
637
Total Downloads

Downloads (Last 12 months)215
Downloads (Last 6 weeks)48

Reflects downloads up to 18 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Seaborn KSawa YWatanabe M(2024)Coimagining the Future of Voice Assistants with Cultural SensitivityHuman Behavior and Emerging Technologies10.1155/2024/32387372024(1-21)Online publication date: 25-Mar-2024
https://doi.org/10.1155/2024/3238737
Woodward KKanjo EBrown DMcGinnity THarold G(2023)In the hands of users with intellectual disabilities: co-designing tangible user interfaces for mental wellbeingPersonal and Ubiquitous Computing10.1007/s00779-023-01752-x27:6(2171-2191)Online publication date: 3-Oct-2023
https://dl.acm.org/doi/10.1007/s00779-023-01752-x
Desolda GEsposito AMüller FFeger S(2023)Digital Modeling for Everyone: Exploring How Novices Approach Voice-Based 3D ModelingHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42293-5_11(133-155)Online publication date: 28-Aug-2023
https://dl.acm.org/doi/10.1007/978-3-031-42293-5_11

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten