short-paper

Perception-Intention-Action Cycle as a Human Acceptable Way for Improving Human-Robot Collaborative Tasks

Authors:

J. E. Domínguez-Vidal,

Nicolás Rodríguez, and

Alberto SanfeliuAuthors Info & Claims

HRI '23: Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction

March 2023

Pages 567 - 571

https://doi.org/10.1145/3568294.3580149

Published: 13 March 2023 Publication History

Abstract

In Human-Robot Collaboration (HRC) tasks, the classical Perception-Action cycle can not fully explain the collaborative behaviour of the human-robot pair until it is extended to Perception-Intention-Action (PIA) cycle, giving to the human's intention a key role at the same level of the robot's perception and not as a subblock of this. Although part of the human's intention can be perceived or inferred by the other agent, this is prone to misunderstandings so the true intention has to be explicitly informed in some cases to fulfill the task. Here, we explore both types of intention and we combine them with the robot's perception through the concept of Situation Awareness (SA). We validate the PIA cycle and its acceptance by the user with a preliminary experiment in an object transportation task showing that its usage can increase trust in the robot.

References

[1]

James S. Albus. 1975. A New Approach to Manipulator Control: The Cerebellar Model Articulation Controller (CMAC). Transactions ASME (1975).

[2]

James S Albus et al. 1993. A Reference Model Architecture for Intelligent Systems Design. An Introduction to Intelligent and Autonomous Control (1993), 27--56.

[3]

Rodney Brooks. 1986. A robust layered control system for a mobile robot. IEEE journal on robotics and automation 2, 1 (1986), 14--23.

[4]

Antoine Bussy, Abderrahmane Kheddar, André Crosnier, and François Keith. 2012. Human-humanoid haptic joint object transportation case study. In 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 3633--3638.

[5]

Vassilis Cutsuridis and John G Taylor. 2013. A Cognitive Control Architecture for the Perception-Action Cycle in Robots and Agents. Cognitive Computation 5, 3 (2013), 383--395.

[6]

Marc Dalmasso, Anaís Garrell, J. E. Domínguez-Vidal, Pablo Jiménez, and Alberto Sanfeliu. 2021. Human-Robot Collaborative Multi-Agent Path Planning using Monte Carlo Tree Search and Social Reward Sources. In IEEE Int. Conf. on Robotics and Automation (ICRA).

Digital Library

[7]

J. E. Domínguez-Vidal, Iván J. Torres-Rodríguez, Anaís Garrell, and Alberto Sanfeliu. 2021. User-Friendly Smartphone Interface to Share Knowledge in Human-Robot Collaborative Search Tasks. In 30th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN). 913--918. https: //doi.org/10.1109/RO-MAN50785.2021.9515379

Digital Library

[8]

Anca D Dragan and Siddhartha S Srinivasa. 2013. A policy-blending formalism for shared control. The International Journal of Robotics Research 32, 7 (2013), 790--805.

Digital Library

[9]

Mica R Endsley. 2000. Direct measurement of situation awareness: Validity and use of SAGAT. Situation awareness analysis and measurement 10 (2000), 147--173.

[10]

Mica R. Endsley and Daniel J. Garland. 2000. Situation Awareness Analysis and Measurement. Vol. 609. New York, NY: CRC Press. https://doi.org/10.1201/b12461

[11]

Francesco Farina, Daniele Fontanelli, Andrea Garulli, Antonio Giannitrapani, and Domenico Prattichizzo. 2017. Walking ahead: The headed social force model. PloS one 12, 1 (2017), e0169734.

[12]

Gonzalo Ferrer and Alberto Sanfeliu. 2014. Proactive kinodynamic planning using the extended social force model and human motion prediction in urban environments. In 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 1730--1735.

[13]

Anais Garrell, Luis Garza-Elizondo, Michael Villamizar, Fernando Herrero, and Alberto Sanfeliu. 2017. Aerial social force model: A new framework to accompany people using autonomous flying robots. In 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 7011--7017.

Digital Library

[14]

Alex Goldhoorn, Anaís Garrell, René Alquézar, and Alberto Sanfeliu. 2017. Search- ing and tracking people in urban environments with static and dynamic obstacles. Robotics and Autonomous Systems 98 (2017), 147--157.

Digital Library

[15]

Dirk Helbing and Peter Molnar. 1995. Social Force Model for Pedestrian Dynamics. Physical review E 51, 5 (1995), 4282.

[16]

Chien-Ming Huang and Bilge Mutlu. 2016. Anticipatory robot control for efficient human-robot collaboration. In 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI). 83--90. https://doi.org/10.1109/HRI.2016.7451737

[17]

Siddarth Jain and Brenna Argall. 2018. Recursive bayesian human intent recog- nition in shared-control robotics. In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 3905--3912.

[18]

Nathanaël Jarrassé, Themistoklis Charalambous, and Etienne Burdet. 2012. A Framework to Describe, Analyze and Generate Interactive Motor Behaviors. PLOS ONE 7, 11 (11 2012), 1--13. https://doi.org/10.1371/journal.pone.0049945

[19]

Philip N. Johnson-Laird. 1989. Mental models. The MIT Press.

[20]

Jessica Lanini, Hamed Razavi, Julen Urain, and Auke Ijspeert. 2018. Human intention detection as a multiclass classification problem: Application in physical human-robot interaction while walking. IEEE Robotics and Automation Letters 3, 4 (2018), 4171--4178.

[21]

Javier Laplaza, Nicolás Rodríguez, J. E. Domínguez-Vidal, Fernando Herrero, Sergi Hernández, Alejandro López, Alberto Sanfeliu, and Anaís Garrell. 2022. IVO Robot: A New Social Robot for Human-Robot Collaboration. In Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction. 860--864.

[22]

Beom-Jin Lee et al. 2018. Perception-Action-Learning System for Mobile Social- Service Robots using Deep Learning. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 32.

[23]

Dylan P. Losey, Craig G. McDonald, Edoardo Battaglia, and Marcia K. O'Malley. 2018. A Review of Intent Detection, Arbitration, and Communication Aspects of Shared Control for Physical Human-Robot Interaction. Applied Mechanics Reviews 70, 1 (02 2018). https://doi.org/10.1115/1.4039145 arXiv:https://asmedigitalcollection.asme.org/appliedmechanicsreviews/article-pdf/70/1/010804/5964415/amr_070_01_010804.pdf 010804.

[24]

Ren C Luo and Licong Mai. 2019. Human Intention Inference and On-Line Human Hand Motion Prediction for Human-Robot Collaboration. In 2019 IEEE/RSJ Inter- national Conference on Intelligent Robots and Systems (IROS). IEEE, 5958--5964.

[25]

Mauricio Marcano, Sergio Díaz, Joshué Pérez, and Eloy Irigoyen. 2020. A review of shared control for automated vehicles: Theory and applications. IEEE Transactions on Human-Machine Systems 50, 6 (2020), 475--491.

[26]

Isabelle Maroger, Noelie Ramuzat, Olivier Stasse, and Bruno Watier. 2021. Human trajectory prediction model and its coupling with a walking pattern generator of a humanoid robot. IEEE Robotics and Automation Letters 6, 4 (2021), 6361--6369.

[27]

Alexander Mörtl, Martin Lawitzky, Ayse Kucukyilmaz, Metin Sezgin, Cagatay Basdogan, and Sandra Hirche. 2012. The role of roles: Physical cooperation between humans and robots. The International Journal of Robotics Research 31, 13 (2012), 1656--1674. https://doi.org/10.1177/0278364912455366

Digital Library

[28]

K. Nishiwaki, T. Sugihara, S. Kagami, F. Kanehiro, M. Inaba, and H. Inoue. 2000. Design and Development of Research Platform for Perception-Action Integration in Humanoid Robot: H6. In 2000 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS). 1559--1564. https://doi.org/10.1109/IROS.2000.895195

[29]

Samwel Opiyo, Jun Zhou, Emmy Mwangi, Wang Kai, and Idris Sunusi. 2021. A review on teleoperation of mobile ground robots: Architecture and situation awareness. International Journal of Control, Automation and Systems 19, 3 (2021), 1384--1407.

[30]

Johan Philips, José del R Millán, Gerolf Vanacker, Eileen Lew, Ferran Galán, Pierre W Ferrez, Hendrik Van Brussel, and Marnix Nuttin. 2007. Adaptive Shared Control of a Brain-Actuated Simulated Wheelchair. In 2007 IEEE 10th International Conference on Rehabilitation Robotics. IEEE, 408--414.

[31]

Jennifer M. Riley and Mica R. Endsley. 2004. The hunt for situation awareness: Human-robot interaction in search and rescue. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 48. 693--697.

[32]

Jennifer M. Riley, Laura D. Strater, Sheryl L. Chappell, Erik S. Connors, and Mica R. Endsley. 2010. Situation awareness in human-robot interaction: Challenges and user interface requirements. Human-Robot Interactions in Future Military Operations (2010), 171--192.

[33]

Jean Scholtz. 2002. Evaluation methods for human-system performance of in- telligent systems. Technical Report. NATIONAL INST OF STANDARDS AND TECHNOLOGY GAITHERSBURG MD MANUFACTURING ENGINEERING LAB.

[34]

Chun-Tang Yang, Tianshi Zhang, Li-Pu Chen, and Li-Chen Fu. 2019. Socially-aware navigation of omnidirectional mobile robot with extended social force model in multi-human environment. In 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC). IEEE, 1963--1968.

Digital Library

Cited By

Singamaneni PBachiller-Burgos PManso LGarrell ASanfeliu ASpalanzani AAlami R(2024)A survey on socially aware robot navigation: Taxonomy and future challengesThe International Journal of Robotics Research10.1177/02783649241230562Online publication date: 12-Feb-2024
https://doi.org/10.1177/02783649241230562
Domínguez-Vidal JSanfeliu AGrollman DBroadbent EJu WSoh HWilliams T(2024)Voice Command Recognition for Explicit Intent Elicitation in Collaborative Object Transportation Tasks: a ROS-based ImplementationCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610978.3640749(412-416)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610978.3640749
Domínguez-Vidal JRodríguez NSanfeliu A(2024)Perception–Intention–Action Cycle in Human–Robot Collaborative Tasks: The Collaborative Lightweight Object Transportation Use-CaseInternational Journal of Social Robotics10.1007/s12369-024-01103-7Online publication date: 25-Mar-2024
https://doi.org/10.1007/s12369-024-01103-7
Show More Cited By

Index Terms

Perception-Intention-Action Cycle as a Human Acceptable Way for Improving Human-Robot Collaborative Tasks
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI
    2. Interaction paradigms
      1. Collaborative interaction

Recommendations

Human Intention Prediction in Human-Robot Collaborative Tasks
HRI '18: Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction

Enabling the robot to predict human intentions in human-robot collaborative hand-over tasks is a challenging but important issue to address. We develop a novel and effective teaching-learning-prediction (TLP) model for the robot to online learn from ...
Read More
Human Understanding and Perception of Unanticipated Robot Action in the Context of Physical Interaction
Anticipating a future scenario where the robot initiates its own actions and behaves voluntarily when collaborating with humans, our research focuses on human understanding and perception of unanticipated robot actions during physical human-robot ...
Read More
Compact Real-time Avoidance on a Humanoid Robot for Human-robot Interaction
HRI '18: Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction

With robots leaving factories and entering less controlled domains, possibly sharing the space with humans, safety is paramount and multimodal awareness of the body surface and the surrounding environment is fundamental. Taking inspiration from ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

HRI '23: Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction

March 2023

612 pages

ISBN:9781450399708

DOI:10.1145/3568294

General Chairs:
Ginevra Castellano
Uppsala University, Sweden
,
Laurel Riek
University of California San Diego, USA
,
Program Chairs:
Maya Cakmak
University of Washington, USA
,
Iolanda Leite
KTH Royal Institute of Technology, Sweden

Copyright © 2023 ACM.

Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 March 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

CANOPIES
MINECO/AEI

Conference

HRI '23

Sponsor:

HRI '23: ACM/IEEE International Conference on Human-Robot Interaction

March 13 - 16, 2023

Stockholm, Sweden

Acceptance Rates

Overall Acceptance Rate 268 of 1,124 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
182
Total Downloads

Downloads (Last 12 months)73
Downloads (Last 6 weeks)3

Other Metrics

View Author Metrics

Citations

Cited By

Singamaneni PBachiller-Burgos PManso LGarrell ASanfeliu ASpalanzani AAlami R(2024)A survey on socially aware robot navigation: Taxonomy and future challengesThe International Journal of Robotics Research10.1177/02783649241230562Online publication date: 12-Feb-2024
https://doi.org/10.1177/02783649241230562
Domínguez-Vidal JSanfeliu AGrollman DBroadbent EJu WSoh HWilliams T(2024)Voice Command Recognition for Explicit Intent Elicitation in Collaborative Object Transportation Tasks: a ROS-based ImplementationCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610978.3640749(412-416)Online publication date: 11-Mar-2024
https://dl.acm.org/doi/10.1145/3610978.3640749
Domínguez-Vidal JRodríguez NSanfeliu A(2024)Perception–Intention–Action Cycle in Human–Robot Collaborative Tasks: The Collaborative Lightweight Object Transportation Use-CaseInternational Journal of Social Robotics10.1007/s12369-024-01103-7Online publication date: 25-Mar-2024
https://doi.org/10.1007/s12369-024-01103-7
Domínguez-Vidal JSanfeliu A(2023)Inference VS. Explicitness. Do We Really Need the Perfect Predictor? The Human-Robot Collaborative Object Transportation Case2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)10.1109/RO-MAN57019.2023.10309648(1866-1871)Online publication date: 28-Aug-2023
https://doi.org/10.1109/RO-MAN57019.2023.10309648
Domínguez-Vidal JSanfeliu A(2023)Improving Human-Robot Interaction Effectiveness in Human-Robot Collaborative Object Transportation Using Force Prediction2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)10.1109/IROS55552.2023.10342517(7839-7845)Online publication date: 1-Oct-2023
https://doi.org/10.1109/IROS55552.2023.10342517

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents