Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Designing Motion: Lessons for Self-driving and Robotic Motion from Human Traffic Interaction

Published: 29 December 2022 Publication History

Abstract

The advent of autonomous cars creates a range of new questions about road safety, as well as a new collaborative domain for CSCW to analyse. This paper uses video data collected from five countries - India, Spain, France, Chile, and the USA - to study how road users interact with each other. We use interactional video analysis to document how co-ordination is achieved in traffic not just through the use of formal rules, but through situated communicative action. Human movement is a rich implicit communication channel and this communication is essential for safe manoeuvring on the road, such as in the co-ordination between pedestrians and drivers. We discuss five basic movements elements: gaps, speed, position, indicating and stopping. Together these elements can be combined to make and accept offers, show urgency, make requests and display preferences. We build on these results to explore lessons for how we can design the implicit motion of self-driving cars so that these motions are understandable - in traffic - by other road users. In discussion, we explore the lessons from this for designing the movement of robotic systems more broadly.

References

[1]
Claudia Ackermann, Matthias Beggiato, Luka-Franziska Bluhm, and Josef Krems. 2018. Vehicle movement and its potential as implicit communication signal for pedestrians and automated vehicles. In Proceedings of the 6th Humanist Conference. 1--7.
[2]
Lucy Anderson-Bashan, Benny Megidish, Hadas Erel, Iddo Wald, Guy Hoffman, Oren Zuckerman, and Andrey Grishko. 2018. The greeting machine: an abstract robotic object for opening encounters. In 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN). IEEE, 595--602.
[3]
Mehmet Aydin Baytas, Damla Çay, Yuchong Zhang, Mohammad Obaid, Asim Evren Yantaç, and Morten Fjeld. 2019. The design of social drones: A review of studies on autonomous flyers in inhabited environments. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--13.
[4]
Mark Bergen. 2015. Meet the Companies Building Self-Driving Cars for Google and Tesla (And Maybe Apple). http://www.recode.net/2015/10/27/11620026/meet-the-companies-building-self-driving-cars-for-google-and-tesla
[5]
Mathias Broth, Jakob Cromdal, and Lena Levin. 2018. Showing where you're going. Instructing the accountable use of the indicator in live traffic. International Journal of Applied Linguistics, Vol. 28, 2 (2018), 248--264.
[6]
Barry Brown and Eric Laurier. 2017. The trouble with autopilots: Assisted and autonomous driving on the social road. In Proceedings of the 2017 CHI conference on human factors in computing systems. ACM Press, 416--429.
[7]
Barry Brown, Moira McGregor, and Eric Laurier. 2013. iPhone in vivo: video analysis of mobile device use. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1031--1040.
[8]
Cesar Cadena, Luca Carlone, Henry Carrillo, Yasir Latif, Davide Scaramuzza, Jose Neira, Ian D. Reid, and John J. Leonard. 2016. Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Age. IEEE Transactions on robotics, Vol. 32, 6 (June 2016), 1309--1332. https://arxiv.org/abs/1606.05830v2
[9]
Jessica R Cauchard, Kevin Y Zhai, Marco Spadafora, and James A Landay. 2016. Emotion encoding in human-drone interaction. In 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 263--270.
[10]
Mark Colley and Rukzio Rukzio. 2020. A Design Space for External Communication of Autonomous Vehicles. In Proceedings of the 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI'20). ACM Press, 212--222. https://doi.org/10.1145/3409120.3410646
[11]
Andrew Crabtree, Tom Rodden, Peter Tolmie, and Graham Button. 2009. Ethnography considered harmful. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 879--888. https://doi.org/10.1145/1518701.1518835
[12]
Elwys De Stefani. 2018. Formulating direction: Navigational instructions in driving lessons. International Journal of Applied Linguistics, Vol. 28, 2 (2018), 283--303.
[13]
Elwys De Stefani, Mathias Broth, and Arnulf Deppermann. 2018. On the road: Communicating traffic. Language & Communication 65 (2018), 1--6.
[14]
Arnulf Deppermann. 2018. Instruction practices in German driving lessons: Differential uses of declaratives and imperatives. International Journal of Applied Linguistics, Vol. 28, 2 (2018), 265--282.
[15]
Arnulf Deppermann, Eric Laurier, and Lorenza Mondada. 2018. Overtaking as an interactional achievement : Video analyses of participants' practices in traffic. Gesprächsforschung, Vol. 19 (2018), 1--131. http://urn.kb.se/resolve?urn=urn:nbn:se:liu:diva-149905
[16]
Ian Dersley and Anthony Wootton. 2000. Complaint sequences within antagonistic argument. Research on Language and Social Interaction, Vol. 33, 4 (2000), 375--406.
[17]
Hadas Erel, Tzachi Shem Tov, Yoav Kessler, and Oren Zuckerman. 2019. Robots are Always Social: Robotic Movements are Automatically Interpreted as Social Cues. In Extended abstracts of the 2019 CHI conference on human factors in computing systems. 1--6.
[18]
Joel E. Fischer, Stuart Reeves, Martin Porcheron, and Rein Ove Sikveland. 2019. Progressivity for voice interface design. In Proceedings of the 1st International Conference on Conversational User Interfaces - CUI '19. ACM Press, Dublin, Ireland, 1--8. https://doi.org/10.1145/3342775.3342788 tex.ids: fischer_progressivity_2019--1.
[19]
Grace de la Flor, Paul Luff, Marina Jirotka, John Pybus, Ruth Kirkham, and Annamaria Carusi. 2010. The Case of the Disappearing Ox: Seeing Through Digital Images to an Analysis of Ancient Texts. ACM, 1753397, 473--482. https://doi.org/10.1145/1753326.1753397
[20]
Harold Garfinkel. 1967. Studies in Ethnomethodology. Prentice Hall.
[21]
A. Geiger, P. Lenz, and R. Urtasun. 2012. Are we ready for autonomous driving? The KITTI vision benchmark suite. In 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 3354--3361. https://doi.org/10.1109/CVPR.2012.6248074
[22]
Lee Gomes. 2014. Google's Self-Driving Cars Still Face Many Obstacles. https://www.technologyreview.com/s/530276/hidden-obstacles-for-googles-self-driving-cars/
[23]
David González, Joshué Pérez, Vicente Milanés, and Fawzi Nashashibi. 2015. A review of motion planning techniques for automated vehicles. IEEE Transactions on Intelligent Transportation Systems, Vol. 17, 4 (2015), 1135--1145.
[24]
Charles Goodwin. 2000. Action and embodiment within situated human interaction. Journal of Pragmatics, Vol. 32 (2000), 1489--1522.
[25]
Charles Goodwin. 2018. Co-operative action. Cambridge University Press.
[26]
Marjorie Harness Goodwin and Charles Goodwin. 2012. Car talk: Integrating texts, bodies, and changing landscapes. Semiotica, Vol. 191 (2012), 257--286.
[27]
Azra Habibovic, Victor Malmsten Lundgren, Jonas Andersson, Maria Klingegård, Tobias Lagström, Anna Sirkka, Johan Fagerlönn, Claes Edgren, Rikard Fredriksson, Stas Krupenia, Dennis Saluäär, and Pontus Larsson. 2018. Communicating Intent of Automated Vehicles to Pedestrians. Frontiers in Psychology, Vol. 9 (Aug. 2018). https://doi.org/10.3389/fpsyg.2018.01336
[28]
Pentti Haddington. 2012. Movement in action: Initiating social navigation in cars. Semiotica, Vol. 2012, 191 (Jan. 2012), 137--167. https://doi.org/10.1515/sem-2012-0059
[29]
Pentti Haddington and Mirka Rauniomaa. 2014. Interaction between road users: offering space in traffic. Space and culture, Vol. 17, 2 (2014), 176--190.
[30]
Christian Heath, Jon Hindmarsh, and Paul Luff. 2010. Video in qualitative research: analysing social interaction in everyday life. Sage, London.
[31]
Christian Heath and Paul Luff. 2000. Technology in action. Cambridge university press.
[32]
Chien-Ming Huang and Bilge Mutlu. 2012. Robot behavior toolkit: generating effective social behaviors for robots. In 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 25--32. https://doi.org/10.1145/2157689.2157694
[33]
Walther Jensen, Simon Hansen, and Hendrik Knoche. 2018. Knowing you, seeing me: investigating user preferences in Drone-Human acknowledgement. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1--12.
[34]
Wendy Ju. 2015. The design of implicit interactions. Vol. 8. Morgan & Claypool Publishers. http://www.morganclaypool.com/doi/abs/10.2200/S00619ED1V01Y201412HCI028
[35]
Oskar Juhlin. 2010. Social Media on the Road. Vol. 50. Springer London. http://dx.doi.org/10.1007/978--1--84996--332--9_1
[36]
Hermann Kaindl, Jürgen Falb, and Cristian Bogdan. 2008. Multimodal communication involving movements of a robot. In CHI'08 Extended Abstracts on Human Factors in Computing Systems. ACM, 3213--3218.
[37]
Young Woo Kim, Jae Hyun Han, Yong Gu Ji, and Seul Chan Lee. 2020. Exploring the Effectiveness of External Human-Machine Interfaces on Pedestrians and Drivers. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 65--68.
[38]
Hideaki Kuzuoka, Shinya Oyama, Keiichi Yamazaki, Kenji Suzuki, and Mamoru Mitsuishi. 2000. GestureMan: a mobile robot that embodies a remote instructor's actions. In Proceedings of the 2000 ACM conference on Computer supported cooperative work. ACM Press, 155--162. http://doi.acm.org/10.1145/358916.358986
[39]
Eric Laurier and Hayden Lorimer. 2009. Other ways: landscapes of commuting. Landscape Research, Vol. 37, 2 (2009), 207--224.
[40]
Eric Laurier, Hayden Lorimer, Barry Brown, Owain Jones, Oskar Juhlin, Allyson Noble, Mark Perry, Daniele Pica, Philippe Sormani, Ignaz Strebel, and others. 2008. Driving and ?passengering': Notes on the ordinary organization of car travel. Mobilities, Vol. 3, 1 (2008), 1--23. http://www.tandfonline.com/doi/abs/10.1080/17450100701797273
[41]
Eric Laurier, Daniel Muñoz, Rebekah Miller, and Barry Brown. 2020. A bip, a beeeep, and a beep beep: How horns are sounded in chennai traffic. Research on Language and Social Interaction, Vol. 53, 3 (2020), 341--356. Publisher: Taylor & Francis.
[42]
Yee Mun Lee, Ruth Madigan, and Jorge Garcia. 2019. Understanding the Messages Conveyed by Automated Vehicles. In Proceedings of AutoUI 2019. 134--143. https://doi.org/10.1145/3342197.3344546
[43]
Iolanda Leite, Carlos Martinho, and Ana Paiva. 2013. Social robots for long-term interaction: a survey. International Journal of Social Robotics, Vol. 5, 2 (2013), 291--308. http://link.springer.com/article/10.1007/s12369-013-0178-y
[44]
Stephanie Lowry, Niko Sunderhauf, Paul Newman, John J. Leonard, David Cox, Peter Corke, and Michael J. Milford. 2016. Visual Place Recognition: A Survey. IEEE Transactions on Robotics, Vol. 32, 1 (Feb. 2016), 1--19. https://doi.org/10.1109/TRO.2015.2496823
[45]
Paul Luff and Christian Heath. 1998. Mobility in collaboration. In Proceedings of CSCW 1999. ACM, 305--314. http://portal.acm.org/citation.cfm?doid=289444.289505
[46]
Karthik Mahadevan, Sowmya Somanath, and Ehud Sharlin. 2018. Communicating Awareness and Intent in Autonomous Vehicle-Pedestrian Interaction. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, 429:1--429:12. https://doi.org/10.1145/3173574.3174003 event-place: Montreal QC, Canada.
[47]
Markus Maurer, J. Christian Gerdes, Barbara Lenz, and Hermann Winner. 2016. Autonomous driving: technical, legal and social aspects. Springer. http://dl.acm.org/citation.cfm?id=2965082
[48]
Paul McIlvenny, Mathias Broth, and Pentti Haddington. 2014. Moving together: Mobile formations in interaction. Space and Culture, Vol. 17, 2 (2014), 104--106.
[49]
Donald McMillan, Barry Brown, Ikkaku Kawaguchi, Razan Jaber, Jordi Solsona Belenguer, and Hideaki Kuzuoka. 2019. Designing with gaze: Tama--a gaze activated smart-speaker. Proceedings of the ACM on Human-Computer Interaction, Vol. 3, CSCW (2019), 1--26. Publisher: ACM New York, NY, USA.
[50]
Donald McMillan, Moira McGregor, and Barry Brown. 2015. From in the wild to in vivo: Video Analysis of Mobile Device Use. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, 494--503.
[51]
Natasha Merat, Yee Mun Lee, Gustav Markkula, Jim Uttley, Fanta Camara, Charles Fox, André Dietrich, Florian Weber, and Anna Schieben. 2019. How Do We Study Pedestrian Interaction with Automated Vehicles? Preliminary Findings from the European interACT Project. In Road Vehicle Automation 6 (Lecture Notes in Mobility ), Gereon Meyer and Sven Beiker (Eds.). Springer International Publishing, 21--33.
[52]
Sara Merlino and Lorenza Mondada. 2018. Crossing the street: How pedestrians interact with cars. Language & Communication, Vol. 65 (2018), 131--147.
[53]
Lorenza Mondada. 2018. Driving instruction at high speed on a race circuit: Issues in action formation and sequence organization. International Journal of Applied Linguistics, Vol. 28, 2 (2018), 304--325.
[54]
Lars Müller, Malte Risto, and Colleen Emmenegger. 2016. The Social Behavior of Autonomous Vehicles. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (UbiComp '16). ACM, New York, NY, USA, 686--689. https://doi.org/10.1145/2968219.2968561 event-place: Heidelberg, Germany.
[55]
Amir Rasouli and John K. Tsotsos. 2019. Autonomous vehicles that interact with pedestrians: A survey of theory and practice. IEEE Transactions on Intelligent Transportation Systems, Vol. 21, 3 (2019), 900--918.
[56]
Stuart Reeves. 2017. Some conversational challenges of talking with machines. (Feb. 2017). https://nottingham-repository.worktribe.com/output/844412
[57]
Malte Risto, Colleen Emmenegger, Erik Vinkhuyzen, Melissa Cefkin, and Jim Hollan. 2017. Human-Vehicle Interfaces: The Power of Vehicle Movement Gestures in Human Road User Coordination. In Driving Assesment Conference, Vol. 9. University of Iowa. tex.ids: risto_human-vehicle_2017.
[58]
A. Lincoln Ryave and James N. Schenkein. 1974. Notes on the art of walking. In Ethnomethodology, R. Turner (Ed.). Penguin, Harmondsworth, 265--74.
[59]
Selma Sabanovic, Marek P. Michalowski, and Reid Simmons. 2006. Robots in the wild: Observing human-robot social interaction outside the lab. In 9th IEEE International Workshop on Advanced Motion Control, 2006. IEEE, 596--601. http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=1631758
[60]
Harvey Sacks. 1995. Lectures on conversation: vol 1 & 2. Vol. I and II. Basil Blackwell, Oxford.
[61]
Dorsa Sadigh, Nick Landolfi, Shankar S. Sastry, Sanjit A. Seshia, and Anca D. Dragan. 2018. Planning for cars that coordinate with people: leveraging effects on human actions for planning and active information gathering over human internal state. Autonomous Robots, Vol. 42, 7 (Oct. 2018), 1405--1426. https://doi.org/10.1007/s10514-018--9746--1
[62]
Dorsa Sadigh, Shankar Sastry, Sanjit A. Seshia, and Anca D. Dragan. 2016. Planning for autonomous cars that leverages effects on human actions. In Proceedings of the Robotics: Science and Systems Conference (RSS). https://pdfs.semanticscholar.org/e3e1/a23e0096f8ca51b783812310d44673a3c89a.pdf
[63]
Emanuel A. Schegloff. 2007. Sequence Organization in Interaction: Volume 1: A Primer in Conversation Analysis. Cambridge University Press. googlebooksid: 5XbJRFQ4dhsC tex.ids= schegloffSequenceOrganizationInteraction2007a, schegloff_sequence_2007--2, schegloff_sequence_2007--3.
[64]
Albrecht Schmidt. 2000. Implicit human computer interaction through context. Personal technologies, Vol. 4, 2--3 (2000), 191--199.
[65]
David Sirkin, Brian Mok, Stephen Yang, and Wendy Ju. 2015. Mechanical Ottoman: How Robotic Furniture Offers and Withdraws Support. In Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction (HRI '15). Association for Computing Machinery, Portland, Oregon, USA, 11--18. https://doi.org/10.1145/2696454.2696461
[66]
Robin James Smith. 2017. The practical organisation of space, interaction, and communication in and as the work of crossing a shared space intersection. Sociologica, Vol. 11, 2 (2017).
[67]
Nick Statt. 2016. Tesla customers have driven 100 million miles with Autopilot active. The Verge (May 2016). http://www.theverge.com/2016/5/24/11761098/tesla-autopilot-self-driving-cars-100-million-miles tex.ids: nick_statt_tesla_2016, noauthor_tesla_nodate.
[68]
Tanya Stivers and Jeffrey D. Robinson. 2006. A preference for progressivity in interaction. Language in society, Vol. 35, 3 (2006), 367--392.
[69]
Dante Tezza and Marvin Andujar. 2019. The state-of-the-art of human--drone interaction: A survey. IEEE Access, Vol. 7 (2019), 167438--167454. Publisher: IEEE.
[70]
C. Thorpe, M. Herbert, T. Kanade, and S. Shafer. 1991. Toward autonomous driving: the Carnegie Mellon University Navlab. I. Perception. IEEE Expert, Vol. 6, 4 (Aug. 1991), 31--42. https://doi.org/10.1109/64.85919
[71]
Sebastian Thrun, Michael Montemerlo, and Andrei Aron. 2006. Probabilistic Terrain Analysis For High-Speed Desert Driving. In Robotics: Science and Systems. 16--19. http://robots.stanford.edu/papers/thrun.mapping-Stanley.pdf
[72]
Sylvaine Tuncer and Barry Brown. 2020. E-scooters on the Ground: Lessons for Redesigning Urban Micro-Mobility. In Proceedings of CHI 2020. ACM Press, Honolulu, USA. https://doi.org/10.1145/3313831.3376759
[73]
Chris Urmson, Joshua Anhalt, Drew Bagnell, Christopher Baker, Robert Bittner, M. N. Clark, John Dolan, Dave Duggins, Tugrul Galatali, Chris Geyer, and others. 2008. Autonomous driving in urban environments: Boss and the urban challenge. Journal of Field Robotics, Vol. 25, 8 (2008), 425--466. https://doi.org/10.15607/RSS.2006.II.021
[74]
Rod Watson. 1999. Driving in forests and mountains: A pure and applied ethnography. Ethnographic studies, Vol. 3 (1999), 50--60. https://doi.org/10.5449/idslu-001103654 io

Cited By

View all
  • (2024)Symbiotic - A Workshop on Transferability between Human-Robot Interaction (HRI) and Autonomous Vehicle Interaction ResearchAdjunct Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3641308.3677396(273-276)Online publication date: 22-Sep-2024
  • (2024)Honkable Gestalts: Why Autonomous Vehicles Get Honked AtProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675732(317-328)Online publication date: 22-Sep-2024
  • (2024)A model of dyadic merging interactions explains human drivers’ behavior from control inputs to decisionsPNAS Nexus10.1093/pnasnexus/pgae4203:10Online publication date: 24-Sep-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction
Proceedings of the ACM on Human-Computer Interaction  Volume 7, Issue GROUP
GROUP
January 2023
414 pages
EISSN:2573-0142
DOI:10.1145/3578937
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 December 2022
Published in PACMHCI Volume 7, Issue GROUP

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. autonomous vehicles
  2. ethnomethodology
  3. video analysis

Qualifiers

  • Research-article

Funding Sources

  • SSF

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)115
  • Downloads (Last 6 weeks)8
Reflects downloads up to 13 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Symbiotic - A Workshop on Transferability between Human-Robot Interaction (HRI) and Autonomous Vehicle Interaction ResearchAdjunct Proceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3641308.3677396(273-276)Online publication date: 22-Sep-2024
  • (2024)Honkable Gestalts: Why Autonomous Vehicles Get Honked AtProceedings of the 16th International Conference on Automotive User Interfaces and Interactive Vehicular Applications10.1145/3640792.3675732(317-328)Online publication date: 22-Sep-2024
  • (2024)A model of dyadic merging interactions explains human drivers’ behavior from control inputs to decisionsPNAS Nexus10.1093/pnasnexus/pgae4203:10Online publication date: 24-Sep-2024
  • (2023)AVs in HCI EducationProceedings of the 15th Biannual Conference of the Italian SIGCHI Chapter10.1145/3605390.3610833(1-4)Online publication date: 20-Sep-2023
  • (2023)To Cross or Not-to-Cross: A Robotic Object for Mediating Interactions Between Autonomous Vehicles and Pedestrians2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)10.1109/RO-MAN57019.2023.10309309(285-292)Online publication date: 28-Aug-2023
  • (2023)Multi-Camera 3D Object Detection for Autonomous Driving Using Deep Learning and Self-Attention MechanismIEEE Access10.1109/ACCESS.2023.328811211(64608-64620)Online publication date: 2023

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media