research-article

WoZ Way: Enabling Real-time Remote Interaction Prototyping & Observation in On-road Vehicles

Authors:

Nikolas Martelaro,

Wendy JuAuthors Info & Claims

CSCW '17: Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing

Pages 169 - 182

https://doi.org/10.1145/2998181.2998293

Published: 25 February 2017 Publication History

Abstract

Interaction designers often have difficulty understanding people's real-world experiences with ubiquitous systems. The automobile is a great example of these challenges, where on-road testing is time-consuming and provides little ability for rapid prototyping of interface behavior. We introduce WoZ Way, a system to connect designers to remote drivers. We use live video, audio, car data, and Wizard of Oz speech and interfaces to enable remote observation and interaction prototyping on the road. Our implementation integrates environmental, system level, and social information to make the invisible visible. We tested across three example deployments highlighting usage in interaction prototyping and observational studies. Our findings illustrate how designers explored the situated experiences of people on the road, and how they experimented with different improvisational Wizard of Oz interactions. WoZ Way is both a design research and a design prototyping tool, which can support the work of interaction designers through naturalistic observations, contextual inquiry, and responsive interaction prototyping.

Supplementary Material

MP4 File (cscwp0461-file3.mp4)

Download
24.76 MB

References

[1]

1. Sonia Baltodano, Srinath Sibi, Nikolas Martelaro, Nikhil Gowda, and Wendy Ju. 2015. The RRADS Platform: A Real Road Autonomous Driving Simulator. In Proceedings of the 7th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '15). ACM, NY, NY, USA, 281--288.

Digital Library

[2]

2. Margot Brereton, Paul Roe, Ronald Schroeter, and Anita Lee Hong. 2014. Beyond ethnography: engagement and reciprocity as foundations for design research out here. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1183--1186. http://dl.acm.org/citation.cfm?id=2557374

Digital Library

[3]

3. Michael Bull. 2004. Automobility and the power of sound. Theory, Culture & Society 21, 4--5 (2004), 243--259.

[4]

4. Scott Carter, Jennifer Mankoff, and Jeffrey Heer. 2007. Momento: Support for Situated Ubicomp Experimentation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). ACM, NY, NY, USA, 125--134.

Digital Library

[5]

5. Scott Carter, Jennifer Mankoff, Scott R. Klemmer, and Tara Matthews. 2008. Exiting the Cleanroom: On Ecological Validity and Ubiquitous Computing. Human-Computer Interaction 23, 1 (Feb. 2008), 47--99.

[6]

6. Samuel G. Charlton. 2009. Driving while conversing: Cell phones that distract and passengers who react. Accident Analysis & Prevention 41, 1 (Jan. 2009), 160--173.

[7]

7. Kevin Chen and Haoqi Zhang. 2015. Remote Paper Prototype Testing. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, NY, NY, USA, 77--80.

Digital Library

[8]

8. Sunny Consolvo and Miriam Walker. 2003. Using the Experience Sampling Method to Evaluate Ubicomp Applications. IEEE Pervasive Computing 2, 2 (2003), 24--31.

Digital Library

[9]

9. Andy Crabtree, Steve Benford, Chris Greenhalgh, Paul Tennent, Matthew Chalmers, and Barry Brown. 2006. Supporting Ethnographic Studies of Ubiquitous Computing in the Wild. In Proceedings of the 6th Conference on Designing Interactive Systems (DIS '06). ACM, NY, NY, USA, 60--69.

Digital Library

[10]

10. Mihaly Csikszentmihalyi, Reed Larson, and Suzanne Prescott. 1977. The ecology of adolescent activity and experience. Journal of Youth and Adolescence 6, 3 (Sept. 1977), 281--294.

[11]

11. Nils Dahlbäck, Arne Jönsson, and Lars Ahrenberg. 1993. Wizard of Oz Studies: Why and How. In Proceedings of the 1st International Conference on Intelligent User Interfaces (IUI '93). ACM, NY, NY, USA, 193--200.

Digital Library

[12]

12. Steven Dow, Jaemin Lee, Christopher Oezbek, Blair MacIntyre, Jay David Bolter, and Maribeth Gandy. 2005a. Wizard of Oz Interfaces for Mixed Reality Applications. In CHI '05 Extended Abstracts on Human Factors in Computing Systems (CHI EA '05). ACM, NY, NY, USA, 1339--1342.

Digital Library

[13]

13. Steven Dow, Jaemin Lee, Christopher Oezbek, Blair Maclntyre, Jay David Bolter, and Maribeth Gandy. 2005b. Exploring Spatial Narratives and Mixed Reality Experiences in Oakland Cemetery. In Proceedings of the 2005 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology (ACE '05). ACM, NY, NY, USA, 51--60.

Digital Library

[14]

14. Mica R Endsley. 1995. Toward a theory of situation awareness in dynamic systems. Human Factors: The Journal of the Human Factors and Ergonomics Society 37, 1 (1995), 32--64.

[15]

15. Jodi Forlizzi, William C. Barley, and Thomas Seder. 2010. Where should I turn: moving from individual to collaborative navigation strategies to inform the interaction design of future navigation systems. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 1261--1270.

Digital Library

[16]

16. Jon Froehlich, Mike Y. Chen, Sunny Consolvo, Beverly Harrison, and James A. Landay. 2007. MyExperience: A System for in Situ Tracing and Capturing of User Feedback on Mobile Phones. In Proceedings of the 5th International Conference on Mobile Systems, Applications and Services (MobiSys '07). ACM, NY, NY, USA, 57--70.

Digital Library

[17]

17. John G. Gaspar, Whitney N. Street, Matthew B. Windsor, Ronald Carbonari, Henry Kaczmarski, Arthur F. Kramer, and Kyle E. Mathewson. 2014. Providing Views of the Driving Scene to Drivers' Conversation Partners Mitigates Cell-Phone-Related Distraction. Psychological Science 25, 12 (Dec. 2014), 2136--2146.

[18]

18. Petra Geutner, Frank Steffens, and Dietrich Manstetten. 2002. Design of the VICO Spoken Dialogue System: Evaluation of User Expectations by Wizard-of-Oz Experiments. In LREC. http://www.cs.cmu.edu/~dgroup/papers/geutner02.pdf

[19]

19. Paul Green. 1995. Human Factors and New Driver Interfaces: Lessons Learned from a Major Research Project. Proc., ITS America (1995), 1001--1011. http: //www.umich.edu/~driving/publications/ITS95ms.pdf

[20]

20. Paul Green, Eileen Hoekstra, and Marie Williams. 1993a. Further on-the-road tests of driver interfaces: examination of a route guidance system and a car phone. Final report. Technical Report. http://trid.trb.org/view.aspx?id=412281

[21]

21. Paul Green, Marie Williams, Eileen Hoekstra, Kellie George, and Cathy Wen. 1993b. Initial on-the-road tests of driver information system interfaces: route guidance, traffic information, IVSAWS, and vehicle monitoring. Final report. Technical Report. http://trid.trb.org/view.aspx?id=412283

[22]

22. Nicole Gridling, Alexander Meschtscherjakov, and Manfred Tscheligi. 2012. I Need Help!: Exploring Collaboration in the Car. In Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work Companion (CSCW '12). ACM, NY, NY, USA, 87--90.

Digital Library

[23]

23. Jeroen H. Hogema, Sjoerd C. De Vries, Jan BF Van Erp, and Raymond J. Kiefer. 2009. A tactile seat for direction coding in car driving: Field evaluation. Haptics, IEEE Transactions on 2, 4 (2009), 181--188. http://ieeexplore. ieee.org/xpls/abs_all.jsp?arnumber=5196671

Digital Library

[24]

24. Jim Hollan and Scott Stornetta. 1992. Beyond Being There. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '92). ACM, NY, NY, USA, 119--125.

Digital Library

[25]

25. Malte F. Jung, David Sirkin, Turgut M. Gür, and Martin Steinert. 2015. Displayed Uncertainty Improves Driving Experience and Behavior: The Case of Range Anxiety in an Electric Car. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, NY, NY, USA, 2201--2210.

Digital Library

[26]

26. John F. Kelley. 1983. An empirical methodology for writing user-friendly natural language computer applications. In CHI '83. ACM, 193--196. http://dl.acm.org/citation.cfm?id=801609

Digital Library

[27]

27. Dagmar Kern and Albrecht Schmidt. 2009. Design Space for Driver-based Automotive User Interfaces. In Proceedings of the 1st International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '09). ACM, NY, NY, USA, 3--10.

Digital Library

[28]

28. Scott R. Klemmer, Anoop K. Sinha, Jack Chen, James A. Landay, Nadeem Aboobaker, and Annie Wang. 2000. Suede: A Wizard of Oz Prototyping Tool for Speech User Interfaces. In Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology (UIST '00). ACM, NY, NY, USA, 1--10.

Digital Library

[29]

29. Brian Lathrop, Hua Cheng, Fuliang Weng, Rohit Mishra, Joyce Chen, Harry Bratt, Lawrence Cavedon, Carsten Bergmann, Tess Hand-Bender, Heather Pon-Barry, and others. 2004. A Wizard of Oz framework for collecting spoken human-computer dialogs: An experiment procedure for the design and testing of natural language in-vehicle technology systems. In Proc. ITS.

[30]

30. Gilly Leshed, Theresa Velden, Oya Rieger, Blazej Kot, and Phoebe Sengers. 2008. In-car Gps Navigation: Engagement with and Disengagement from the Environment. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, NY, NY, USA, 1675--1684.

Digital Library

[31]

31. Blair MacIntyre, Maribeth Gandy, Steven Dow, and Jay David Bolter. 2004. DART: A Toolkit for Rapid Design Exploration of Augmented Reality Experiences. In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology (UIST '04). ACM, NY, NY, USA, 197--206.

Digital Library

[32]

32. Alexander Meschtscherjakov, David Wilfinger, Nicole Gridling, Katja Neureiter, and Manfred Tscheligi. 2011. Capture the car!: qualitative in-situ methods to grasp the automotive context. In Proceedings of the 3rd International Conference on Automotive User Interfaces and Interactive Vehicular Applications. ACM, 105--112.

Digital Library

[33]

33. Charlie Miller and Chris Valasek. 2013. Adventures in automotive networks and control units. DEF CON 21 (2013), 260--264. http://can-newsletter.org/assets/files/ttmedia/raw/ c51e81bf7c09578c37e3f7a1f97c197b.pdf

[34]

34. Lennart Molin. 2004. Wizard-of-Oz Prototyping for Co-operative Interaction Design of Graphical User Interfaces. In Proceedings of the Third Nordic Conference on Human-computer Interaction (NordiCHI '04). ACM, NY, NY, USA, 425--428.

Digital Library

[35]

35. Nadia Mullen, Judith Charlton, Anna Devlin, and Michel Bedard. 2011. Simulator Validity: Behaviors Observed on the Simulator and on the Road. https://trid.trb.org/view.aspx?id=1114738

[36]

36. Donald A. Norman. 1993. Turn signals are the facial expressions of automobiles. Basic Books.

[37]

37. Nicole Perterer, Petra Sundström, Alexander Meschtscherjakov, David Wilfinger, and Manfred Tscheligi. 2013. Come Drive with Me: An Ethnographic Study of Driver-passenger Pairs to Inform Future In-car Assistance. In Proceedings of the 2013 Conference on Computer Supported Cooperative Work (CSCW '13). ACM, NY, NY, USA, 1539--1548.

Digital Library

[38]

38. Ingrid Pettersson and IC MariAnne Karlsson. 2015. Setting the stage for autonomous cars: a pilot study of future autonomous driving experiences. IET Intelligent Transport Systems 9, 7 (2015), 694--701.

[39]

39. G. Schmidt, M. Kiss, E. Babbel, and A. Galla. 2008. The Wizard on Wheels: Rapid Prototyping and User Testing of Future Driver Assistance Using Wizard of Oz Technique in a Vehicle. In Proceedings of the FISITA 2008 World Automotive Congress, Munich.

[40]

40. David Sirkin, Kerstin Fischer, Lars Jensen, and Wendy Ju. 2016. Eliciting Conversation in Robot Vehicle Interactions. In 2016 AAAI Spring Symposium Series. http://www.aaai.org/ocs/index.php/SSS/SSS16/paper/ view/12755

[41]

41. Alexandra Weilenmann. 2001. Negotiating Use: Making Sense of Mobile Technology. Personal Ubiquitous Comput. 5, 2 (Jan. 2001), 137--145.

Digital Library

[42]

42. Fuliang Weng, Sebastian Varges, Badri Raghunathan, Florin Ratiu, Heather Pon-Barry, Brian Lathrop, Qi Zhang, Harry Bratt, Tobias Scheideck, Kui Xu, and others. 2006. CHAT: a conversational helper for automotive tasks. In INTERSPEECH. http://www.eecs. qmul.ac.uk/~mpurver/papers/weng-et-al06icslp.pdf

Cited By

Kim GHwang SSeong MYeo DRus DKim S(2024)TimelyTale: A Multimodal Dataset Approach to Assessing Passengers' Explanation Demands in Highly Automated VehiclesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785448:3(1-60)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678544
Wu LLafreniere BGrossman TWhite TSantosa S(2024)Body Language for VUIs: Exploring Gestures to Enhance Interactions with Voice User InterfacesProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660691(133-150)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660691
Dey DGoedicke DYang CSirkin DCurrano RJu W(2024)GrokWalks: A Portable Virtual Reality Platform to Facilitate Studying Driver-Pedestrian InteractionsAdjunct Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3641308.3685013(284-288)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3641308.3685013
Show More Cited By

Index Terms

WoZ Way: Enabling Real-time Remote Interaction Prototyping & Observation in On-road Vehicles
1. Human-centered computing
  1. Interaction design
    1. Interaction design process and methods
      1. User centered design

Recommendations

WoZ Way: Enabling Real-time Remote Interaction Prototyping & Observation in On-road Vehicles
CSCW '17 Companion: Companion of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing

Interaction designers often have difficulty understanding people's real-world experiences with ubiquitous systems. The automobile is a great example of these challenges, where on-road testing is time-consuming and provides little ability for rapid ...
Wizard of Oz experiments for companions
BCS-HCI '09: Proceedings of the 23rd British HCI Group Annual Conference on People and Computers: Celebrating People and Technology

Wizard of Oz experiments allow designers and developers to see the reactions of people as they interact with to-be-developed technologies. At the Centre for Interaction Design at Edinburgh Napier University we are developing a Wizard of Oz system to ...
Multimodal theater: extending low fidelity paper prototyping to multimodal applications
CHI EA '02: CHI '02 Extended Abstracts on Human Factors in Computing Systems

Low-fidelity paper prototyping has proven to be a useful technique for designing graphical user interfaces [1]. Wizard of Oz prototyping for other input modalities, such as speech, also has a long history [2]. Yet to surface are guidelines for low-...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CSCW '17: Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing

February 2017

2556 pages

ISBN:9781450343350

DOI:10.1145/2998181

General Chairs:
Charlotte P. Lee
University of Washington
,
Steve Poltrock
Retired
,
Program Chairs:
Louise Barkhuus
Stockholm University and Cornell Tech
,
Marcos Borges
Universidade Federal do Rio de Janeiro
,
Wendy Kellogg
IBM T.J. Watson Research Center

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 February 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CSCW '17

Sponsor:

SIGCHI

CSCW '17: Computer Supported Cooperative Work and Social Computing

February 25 - March 1, 2017

Oregon, Portland, USA

Acceptance Rates

CSCW '17 Paper Acceptance Rate 183 of 530 submissions, 35%;

Overall Acceptance Rate 2,235 of 8,521 submissions, 26%

Upcoming Conference

CSCW '25

Sponsor:
sigchi

Computer-Supported Cooperative Work and Social Computing

October 18 - 22, 2025

Bergen , Norway

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

34
Total Citations
View Citations
877
Total Downloads

Downloads (Last 12 months)54
Downloads (Last 6 weeks)1

Reflects downloads up to 19 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kim GHwang SSeong MYeo DRus DKim S(2024)TimelyTale: A Multimodal Dataset Approach to Assessing Passengers' Explanation Demands in Highly Automated VehiclesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785448:3(1-60)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678544
Wu LLafreniere BGrossman TWhite TSantosa S(2024)Body Language for VUIs: Exploring Gestures to Enhance Interactions with Voice User InterfacesProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660691(133-150)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660691
Dey DGoedicke DYang CSirkin DCurrano RJu W(2024)GrokWalks: A Portable Virtual Reality Platform to Facilitate Studying Driver-Pedestrian InteractionsAdjunct Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3641308.3685013(284-288)Online publication date: 22-Sep-2024
https://dl.acm.org/doi/10.1145/3641308.3685013
Mackay WBattut ALeiva GBeaudouin-Lafon M(2024)VideoClipper: Rapid Prototyping with the "Editing-in-the-Camera" MethodProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642458(1-14)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642458
Ozmen Garibay OWinslow BAndolina SAntona MBodenschatz ACoursaris CFalco GFiore SGaribay IGrieman KHavens JJirotka MKacorri HKarwowski WKider JKonstan JKoon SLopez-Gonzalez MMaifeld-Carucci IMcGregor SSalvendy GShneiderman BStephanidis CStrobel CTen Holter CXu W(2023)Six Human-Centered Artificial Intelligence Grand ChallengesInternational Journal of Human–Computer Interaction10.1080/10447318.2022.215332039:3(391-437)Online publication date: 2-Jan-2023
https://doi.org/10.1080/10447318.2022.2153320
Grimme SKollakidou ASønderskov Zarp CHornecker EKrüger NGraf PMarchetti E(2023)Floor Cleaners as Helper Pets: Projecting Assistive Robots’ Agency on Zoomorphic AffordancesSN Computer Science10.1007/s42979-023-01769-24:4Online publication date: 29-Apr-2023
https://dl.acm.org/doi/10.1007/s42979-023-01769-2
Yan MRampino LCaruso G(2023)An Exploration of Barrier-Free Driving Education Assistance System Based on HCI Technology Under the Inclusive Design ConceptAdvanced Theory and Applications of Engineering Systems Under the Framework of Industry 4.010.1007/978-981-19-9825-6_8(97-111)Online publication date: 28-Mar-2023
https://doi.org/10.1007/978-981-19-9825-6_8
Yavo-Ayalon SGong CYu HMandel IJu W(2022)Walkie-Talkie Maps – A Novel Method to Conduct and Visualize Remote EthnographyInternational Journal of Qualitative Methods10.1177/1609406922111551921Online publication date: 30-Aug-2022
https://doi.org/10.1177/16094069221115519
Verma RPargal SDas DParbat TKambalapalli SMitra BChakraborty S(2022)Impact of Driving Behavior on Commuter’s Comfort During Cab Rides: Towards a New Perspective of Driver RatingACM Transactions on Intelligent Systems and Technology10.1145/352306313:6(1-25)Online publication date: 22-Sep-2022
https://dl.acm.org/doi/10.1145/3523063
Bertran FPometko AGupta MWilcox LBanerjee RIsbister K(2022)Designerly Tele-Experiences: A New Approach to Remote Yet Still Situated Co-DesignACM Transactions on Computer-Human Interaction10.1145/350669829:5(1-30)Online publication date: 20-Oct-2022
https://dl.acm.org/doi/10.1145/3506698
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten