Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
SpringerLink
Log in

How Do We Want to Interact with Robotic Environments? User Preferences for Embodied Interactions from Pushbuttons to AI

  • Chapter
  • First Online:
Disruptive Technologies: The Convergence of New Paradigms in Architecture

Part of the book series: Springer Series in Adaptive Environments ((SPSADENV))

  • 387 Accesses

Abstract

In this paper, the authors report on user preferences for different interaction modes from pushbuttons to AI when interacting with robot surfaces—malleable, adaptive, and physical surfaces that spatially reconfigure interior spaces within the built environment. With global mass urbanization, micro-homes and offices are proliferating; we envision the utility of robot surfaces in reconfiguring compact space into “many spaces” supporting and augmenting human activity. Users in a lab study (N = 12) were asked to consider robot surfaces of our design, used in conjunction with common design tasks performed in a micro-office—specifically, which interaction modes were preferred at five key instances (we call them “scenarios”) over the duration of the task. We found that, for the five scenarios, participants’ preferences were split between AI-controlled and user-controlled interactions because of the contexts of different scenarios and the complexity, accuracy, discreetness, and feedback speed of different interaction modes. Our research informs the design of increasingly architectural and spatial human-AI interactions in everyday life.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  • Alexander C, Ishikawa S, Silverstein M (1977) A pattern language: towns, buildings, construction. Oxford University Press

    Google Scholar 

  • Amershi S, Weld D, Vorvoreanu M, Fourney A, Nushi B, Collisson P, Suh J, Iqbal S, Bennett PN, Inkpen K, Teevan J, Kikin-Gil R, Horvitz E (2019) Guidelines for human-AI interaction. In: Proceedings of the 2019 CHI conference on human factors in computing systems (CHI ‘19), Paper 3, 13 p. https://doi.org/10.1145/3290605.3300233

  • Bekker MM, Olson JS, Olson GM (1995) Analysis of gestures in face-to-face design teams provides guidance for how to use groupware in design. In: Proceedings of the conference on designing interactive systems processes, practices, methods, & techniques (DIS ‘95)

    Google Scholar 

  • Billinghurst M, Billinghurst M, Kato H, Poupyrev I (2001) MagicBook: transitioning between reality and virtuality. In: CHI ‘01 extended abstracts on human factors in computing systems (CHI EA ‘01), pp 25–26

    Google Scholar 

  • Bosscher P, Ebert-Uphoff I (2003) Digital clay: architecture designs for shape-generating mechanisms. In: 2003 IEEE international conference on robotics and automation (Cat. No.03CH37422). https://doi.org/10.1109/robot.2003.1241697

  • Brauner P, van Heek J, Ziefle M, Hamdan NA-H, Borchers J (2017) Interactive FUrniTURE: evaluation of smart interactive textile interfaces for home environments. In: Proceedings of the 2017 ACM international conference on interactive surfaces and spaces (ISS ’17). Association for Computing Machinery, New York, NY, USA, pp 151–160. https://doi.org/10.1145/3132272.3134128

  • Caleb-Solly P, Dogramadzi S, Ellender D, Fear T, van den Heuvel H (2014) A mixed-method approach to evoke creative and holistic thinking about robots in a home environment. In: Proceedings of the 2014 ACM/IEEE international conference on human-robot interaction (HRI ‘14), pp 374–381. https://doi.org/10.1145/2559636.2559681

  • Campos P, Ferreira A, Lucero A (2013) Collaboration meets interactive surfaces: walls, tables, tablets, and phones. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces (ITS ’13). Association for Computing Machinery, New York, NY, USA, pp 481–482. https://doi.org/10.1145/2512349.2512350

  • Chibani A, Amirat Y, Mohammed S, Hagita N, Matson ET (2012) Future research challenges and applications of ubiquitous robotics. In: Proceedings of the 2012 ACM conference on ubiquitous computing (UbiComp ‘12), pp 883–891. https://doi.org/10.1145/2370216.2370415

  • Chibani A, Amirat Y, Mohammed S, Matson E, Hagita N (2013) Barreto M (2013) ubiquitous robotics: recent challenges and future trends. Robot Auton Syst 61(11):1162–1172

    Article  Google Scholar 

  • Cory KD, Breazeal C (2008) Robots at home: understanding long-term human-robot interaction. In: Proceedings of international conference on intelligent robots and systems (IEEE/RSJ ‘08), pp 3230–3235

    Google Scholar 

  • Domova V, Vartiainen E, Azhar S, Ralph M (2013) An interactive surface solution to support collaborative work onboard ships. In: Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces (ITS ’13). Association for Computing Machinery, New York, NY, USA, pp 265–272. https://doi.org/10.1145/2512349.2512804

  • Dow S, Lee J, Oezbek C, MacIntyre B, David Bolter J, Gandy M (2005) Wizard of Oz interfaces for mixed reality applications. In: CHI ‘05 extended abstracts on human factors in computing systems (CHI EA ‘05), pp 1339–1342. https://doi.org/10.1145/1056808.1056911

  • Fasola J, Mataric MJ (2012) Using socially assistive human–robot interaction to motivate physical exercise for older adults. In: Proceedings of the IEEE, 100, 8 (August 2012), pp 2512–2526

    Google Scholar 

  • Fender A, Müller J (2019) SpaceState: Ad-Hoc definition and recognition of hierarchical room states for smart environments. In: Proceedings of the 2019 ACM international conference on interactive surfaces and spaces (ISS ’19). Association for Computing Machinery, New York, NY, USA, pp 303–314. https://doi.org/10.1145/3343055.3359715

  • Fong T, Nourbakhsh I, Dautenhahn K (2003) A survey of socially interactive robots. Robot Auton Syst 42(3-4):143–166

    Google Scholar 

  • Forlizzi J, DiSalvo C (2006) Service robots in the domestic environment: a study of the roomba vacuum in the home. In: Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction (HRI ‘06), pp 258–265. https://doi.org/10.1145/1121241.1121286

  • Gamma E, Helm R, Johnson R, Vlissides J, Booch G (1995) Design patterns: elements of reusable object-oriented software. Addison-Wesley Longman Publishing Co. Inc.

    Google Scholar 

  • Gauglitz S, Nuernberger B, Turk M, Höllerer T (2014) World-stabilized annotations and virtual scene navigation for remote collaboration. In: Proceedings of the 27th annual ACM symposium on User interface software and technology (UIST ‘14), pp 449–459. https://doi.org/10.1145/2642918.2647372

  • Goodrich MA, Schultz AC (2008) Human–robot interaction: a survey. Found Trends Hum–Comput Interact 1(3):203–275

    Google Scholar 

  • Green KE (2016) Architectural robotics: ecosystems of bits, bytes, and biology. MIT Press

    Google Scholar 

  • Greenhalgh C, Benford S (1995) MASSIVE: a collaborative virtual environment for teleconferencing. ACM Trans Comput-Hum Interact 2(3):239–261. https://doi.org/10.1145/210079.210088

  • Gross MD, Green KE (2012) Architectural robotics, inevitably. Interactions 19(1):28–33. https://doi.org/10.1145/2065327.2065335

  • Hanaki S-I, Tansuriyavong S, Endo M (2002). Experiences in VILLA: a mixed reality space to support group activities. In: Proceedings of the 4th international conference on Collaborative virtual environments (CVE ‘02), pp 155–156. https://doi.org/10.1145/571878.571907

  • Hoffman G, Ju W (2014) Designing robots with movement in mind. J Hum-Robot Interact 3(1):91–122

    Article  Google Scholar 

  • Hoffman G, Zuckerman O, Hirschberger G, Luria M, Shani Sherman T (2015) Design and evaluation of a peripheral robotic conversation companion. In: Proceedings of the tenth annual ACM/IEEE international conference on human-robot interaction (HRI ‘15), pp 3–10. https://doi.org/10.1145/2696454.2696495

  • Höök K (2000) Steps to take before intelligent user interfaces become real. Interact Comput 12(4):409–426

    Google Scholar 

  • Horvitz E (1999) Principles of mixed-initiative user interfaces. In: Proceedings of CHI ’99. ACM, New York, NY, USA, pp 159–166

    Google Scholar 

  • Houben S, Vermeulen J, Klokmose C, Schöning J, Marquardt N, Reiterer H (2016) Cross-surface: challenges and opportunities of spatial and proxemic interaction. In: Proceedings of the 2016 ACM international conference on interactive surfaces and spaces (ISS ’16). Association for Computing Machinery, New York, NY, USA, pp 509–512. https://doi.org/10.1145/2992154.2996360

  • Jameson A (2008) Adaptive interfaces and agents. In: Sears A, Jacko JA (eds) The human-computer interaction handbook: fundamentals, evolving technologies and emerging applications (2nd ed) CRC Press, Boca Raton, FL, pp 433–458

    Google Scholar 

  • Ju W, Leila T (2009) Approachability: how people interpret automatic door movement as gesture. Int J Des 3(2):1–10

    Google Scholar 

  • Kahn PH, Freier NG, Kanda T, Ishiguro H, Ruckert JH, Severson RL, Kane SK (2008) Design patterns for sociality in human-robot interaction. In: Proceedings of the 3rd ACM/IEEE international conference on Human robot interaction (HRI ‘08), pp 97–104. https://doi.org/10.1145/1349822.1349836

  • Kazanzides P, Fichtinger G, Hager GD, Okamura AM, Whitcomb LL, Taylor RH (2008) Surgical and interventional robotics-core concepts, technology, and design. IEEE Robot Automat Mag 15(2):122–130

    Google Scholar 

  • Kidd CD, Breazeal C (2008) Robots at home: understanding long-term human-robot interaction. In: IEEE/RSJ international conference on intelligent robots and systems (ICRA ‘08), pp 3230–3235

    Google Scholar 

  • Kim J-H, Lee K-H, Kim Y-D, Suresh Kuppuswamy N, Jo J (2007) Ubiquitous robot: a new paradigm for integrated services. In: Proceedings of IEEE international conference on robotics and automation (ICRA ‘07), pp 2853–2858

    Google Scholar 

  • Lee CP, Paine D (2015) From the matrix to a model of Coordinated Action (MoCA): a conceptual framework of and for CSCW. In: Proceedings of the 18th ACM conference on computer supported cooperative work & social computing (CSCW ‘15), pp 179–194. https://doi.org/10.1145/2675133.2675161

  • McCullough M (2004) Digital ground: architecture, pervasive computing, and environmental knowing. MIT press

    Google Scholar 

  • McCullough M (2013) Ambient commons: Attention in the age of embodied information. MIT Press

    Google Scholar 

  • Nakagaki K, Fitzgerald D, (John) Ma Z, Vink L, Levine D, Ishii H (2019) inFORCE: Bi-directional `force’ shape display for haptic interaction. In: Proceedings of the thirteenth international conference on tangible, embedded, and embodied interaction (TEI ‘19). ACM, New York, NY, USA, pp 615–623. https://doi.org/10.1145/3294109.3295621

  • Negroponte N (1975) Soft architecture machines. MIT Press, Cambridge, Mass./London

    Google Scholar 

  • Nielsen J (1994) Executive summary. Usability engineering. Morgan Kaufmann, San Diego, CA, pp 11–12

    Google Scholar 

  • Norman DA (1994) How might people interact with agents. Commun ACM 37(7):68–71

    Google Scholar 

  • Odom W, Zimmerman J, Davidoff S, Forlizzi J, Dey AK, Kyung Lee M (2012) A fieldwork of the future with user enactments. In: Proceedings of the designing interactive systems conference (DIS ‘12), pp 338–347. https://doi.org/10.1145/2317956.2318008

  • Oosterhuis K, Bier H (2013) IA #5: robotics in architecture. Jap Sam Books, Prinsenbeek, Netherland

    Google Scholar 

  • Ortega M, Goguey A (2019) BEXHI: a mechanical structure for prototyping bendable and expandable handheld interfaces. In: Proceedings of the 2019 ACM international conference on interactive surfaces and spaces (ISS ’19). Association for Computing Machinery, New York, NY, USA, pp 269–273. https://doi.org/10.1145/3343055.3359703

  • Pask G (1969) The architectural relevance of cybernetics. Archit Des 39(9):494–496

    Google Scholar 

  • Prassler E, Kosuge K (2008) Domestic robotics. In: Siciliano B, Khatib O (eds) Springer handbook of robotics. Springer, pp 1253–1281

    Google Scholar 

  • Rasmussen MK, Pedersen EW, Petersen MG, Hornbæk K (2012) Shape-changing interfaces: a review of the design space and open research questions. In: Proceedings of the SIGCHI conference on human factors in computing systems (CHI ’12). Association for Computing Machinery, New York, NY, USA, pp 735–744. https://doi.org/10.1145/2207676.2207781

  • Rasmussen KM, Grönvall E, Kinch S, Graves Petersen M (2013) “It’s alive, it’s magic, it’s in love with you”: opportunities, challenges and open questions for actuated interfaces. In: Proceedings of the 25th Australian computer-human interaction conference: augmentation, application, innovation, collaboration (OzCHI ’13). Association for Computing Machinery, New York, NY, USA, pp 63–72. https://doi.org/10.1145/2541016.2541033

  • Rosen D, Nguyen A, Wang H (2003) On the geometry of low degree-of-freedom digital clay human-computer interface devices. In: Proceedings of 2003 international design engineering technical conferences and computers and information in engineering conference (ASME ‘03), pp 1135–1144

    Google Scholar 

  • Sauppé A, Mutlu B (2014) How social cues shape task coordination and communication. In: Proceedings of the 17th ACM conference on computer supported cooperative work & social computing (CSCW ‘14). https://doi.org/10.1145/2531602.2531610

  • Schafer G, Green K, Walker I, King Fullerton S, Lewis E (2014) An interactive, cyber-physical read-aloud environment: results and lessons from an evaluation activity with children and their teachers. In: Proceedings of the 2014 conference on Designing interactive systems (DIS ‘14), pp 865–874. https://doi.org/10.1145/2598510.2598562

  • Sellen AJ (1992) Speech patterns in video-mediated conversations. In: Bauersfeld P, Bennett J, Lynch G (eds) Proceedings of the SIGCHI conference on human factors in computing systems (CHI ‘92), pp 49–59. https://doi.org/10.1145/142750.142756

  • Severinson-Eklundh K, Green A, Hüttenrauch H (2003) Social and collaborative aspects of interaction with a service robot. Robot Autonom Syst 42(3-4):223–234

    Google Scholar 

  • Sirkin D, Mok B, Yang S, Ju W (2015) Mechanical ottoman: engaging and taking leave. In: Proceedings of the tenth annual ACM/IEEE international conference on human-robot interaction extended abstracts (HRI'15 Extended Abstracts), pp 275–275. https://doi.org/10.1145/2701973.2702096

  • Sirohi, R, Wang, Y., Hollenberg, S., Godage, I. S., Walker, I. D., and Green, K. E. 2019. Design and Characterization of a Novel, Continuum-Robot Surface for the Human Environment. In Proceedings of the 15th Conference on Automation Science and Engineering (IEEE CASE 2019), August 22-26, Vancouver, BC, pp. 1169–1174

    Google Scholar 

  • Spadafora M, Chahuneau V, Martelaro N, Sirkin D, Ju W (2016) Designing the behavior of interactive objects. In: Proceedings of the TEI ‘16: tenth international conference on tangible, embedded, and embodied interaction (TEI ‘16), pp 70–77. https://doi.org/10.1145/2839462.2839502

  • Stanley AA, Hata K, Okamura AM (2016) Closed-loop shape control of a haptic jamming deformable surface. In: 2016 IEEE international conference on robotics and automation (ICRA). https://doi.org/10.1109/icra.2016.7487433

  • Sturdee M, Alexander J (2018) Analysis and classification of shape-changing interfaces for design and application-based research. ACM Comput Surv 51(1):32. Article 2. https://doi.org/10.1145/3143559

  • Sturdee M, Hardy J, Dunn N, Alexander J (2015) A public ideation of shape-changing applications. In: Proceedings of the 2015 international conference on interactive tabletops & surfaces (ITS ’15). Association for Computing Machinery, New York, NY, USA, pp 219–228. https://doi.org/10.1145/2817721.2817734

  • Tanner P, Shah V (2010) Improving remote collaboration through side-by-side telepresence. In: CHI ‘10 extended abstracts on human factors in computing systems (CHI EA ‘10), pp 3493–3498. https://doi.org/10.1145/1753846.1754007

  • Tapus A, Maja M, Scassellatti B (2007) The grand challenges in socially assistive robotics. IEEE Robot Autom Mag, Institute of Electrical and Electronics Engineers 14(1)

    Google Scholar 

  • Verma S, Gonthina P, Hawks Z, Nahar D, Brooks JO, Walker ID, Wang Y, de Aguiar C, Green KE (2018) Design and evaluation of two robotic furnishings partnering with each other and their users to enable independent living. In: Proceedings of the 12th EAI international conference on pervasive computing technologies for healthcare (PervasiveHealth ‘18), pp 35–44. https://doi.org/10.1145/3240925.3240978

  • Wang Y, Frazelle C, Sirohi R, Li L, Walker ID, Green KE (2019) Design and characterization of a novel robotic surface for application to compressed physical environments. In: 2019 international conference on robotics and automation (ICRA ‘19), pp 102–108

    Google Scholar 

  • Wang Y, Green KE (2019) A pattern-based, design framework for designing collaborative environments. In: Proceedings of the thirteenth international conference on tangible, embedded, and embodied interaction (TEI ‘19), pp 595–604. https://doi.org/10.1145/3294109.3295652

  • Whittaker S, Frohlich D, Daly Jones O (1994) What is it like and how might we support it? In: Conference companion on human factors in computing systems (CHI ‘94). https://doi.org/10.1145/259963.260328

  • Zawieska K, Duffy BR (2015) The social construction of creativity in educational robotics. In: Progress in automation, robotics and measuring techniques. Springer International Publishing, pp 329–338

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Design and Artificial Intelligence (DAI), Singapore University of Technology and Design (SUTD), Singapore, Singapore

    Yixiao Wang

  2. Human Centered Design (HCD), Sibley School of Mechanical and Aerospace Engineering, Cornell University, Ithaca, NY, USA

    Keith Evan Green

Authors
  1. Yixiao Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Keith Evan Green
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yixiao Wang .

Editor information

Editors and Affiliations

  1. The Bartlett School of Architecture, University College London, London, UK

    Philippe Morel

  2. Delft University of Technology, Delft, Zuid-Holland, The Netherlands

    Henriette Bier

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Wang, Y., Green, K.E. (2023). How Do We Want to Interact with Robotic Environments? User Preferences for Embodied Interactions from Pushbuttons to AI. In: Morel, P., Bier, H. (eds) Disruptive Technologies: The Convergence of New Paradigms in Architecture. Springer Series in Adaptive Environments. Springer, Cham. https://doi.org/10.1007/978-3-031-14160-7_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-14160-7_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-14159-1

  • Online ISBN: 978-3-031-14160-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation