Abstract
Human-Robot Collaboration (HRC) is a form of direct interaction between humans and robots. The objective of this type of interaction is to perform a task by combining the skills of both humans and robots. HRC is characterized by several aspects, related both to robots and humans. Many works have focused on the study of specific aspects related to HRC, e.g., safety, task organization. However, a major issue is to find a general framework to evaluate the collaboration between humans and robots considering all the aspects of the interaction. The goals of this paper are the following: (i) highlighting the different latent dimensions that characterize the HRC problem and (ii) constructing a conceptual framework to evaluate and compare different HRC configuration profiles. The description of the methodology is supported by some practical examples.
Similar content being viewed by others
References
ABB: (2020). https://new.abb.com/
Ahmad M, Mubin O, Orlando J (2017) A systematic review of adaptivity in human-robot interaction. Multimodal Technologies and Interaction 1(3):14. https://doi.org/10.3390/mti1030014
Aliev K, Antonelli D (2019) Analysis of cooperative industrial task execution by mobile and manipulator robots. In: Trojanowska J, Ciszak O, Machado JM, Pavlenko I (eds) Advances in manufacturing II. Springer International Publishing, Cham, pp 248–260
Arai T, Kato R, Fujita M (2010) Assessment of operator stress induced by robot collaboration in assembly. CIRP Ann 59(1):5–8
Argall B, Chernova S, Veloso M, Browning B (2009) A survey of robot learning from demonstration. Robot Auton Syst 57(5):469–483. https://doi.org/10.1016/j.robot.2008.10.024
Astrom KJ, Wittenmark B (1994) Adaptive control, 2nd edn. Addison-Wesley Longman Publishing Co., Inc., Boston
Bandari YK, Williams SW, Ding J, Martina F (2015) Additive manufacture of large structures: robotic or cnc systems?. In: Proceedings of the 26th international solid freeform fabrication symposium, Austin, TX, USA, pp 12–14
Bangor A, Kortum PT, Miller JT (2008) An empirical evaluation of the system usability scale. International Journal of Human–Computer Interaction 24(6):574–594. https://doi.org/10.1080/10447310802205776
Bauer A, Wollherr D, Buss M (2008) Human–robot collaboration: a survey. International Journal of Humanoid Robotics 05:47–66. https://doi.org/10.1142/S0219843608001303
Beer JM, Fisk AD, Rogers WA (2014) Toward a framework for levels of robot autonomy in human-robot interaction. Journal of Human-Robot Interaction 3(2):74–99. https://doi.org/10.5898/JHRI.3.2.Beer
Biggs G, MacDonald B (2003) A survey of robot programming systems. In: Proceedings of the Australasian conference on robotics and automation, pp 1–3
Bluethmann W, Ambrose R, Diftler M, Askew S, Huber E, Goza M, Rehnmark F, Lovchik C, Magruder D (2003) Robonaut: a robot designed to work with humans in space. Auton Robot 14(2):179–197. https://doi.org/10.1023/A:1022231703061
Bradshaw JM, Feltovich PJ, Jung H, Kulkarni S, Taysom W, Uszok A (2004) Dimensions of adjustable autonomy and mixed-initiative interaction. In: Nickles M, Rovatsos M, Weiss G (eds) Agents and computational autonomy, lecture notes in computer science. Springer, Berlin , pp 17–39
Bröhl C, Nelles J, Brandl C, Mertens A, Schlick CM (2016) TAM reloaded: a technology acceptance model for human-robot cooperation in production systems. In: Stephanidis C (ed) HCI international 2016 – Posters’ Extended Abstracts, vol 617. Springer International Publishing, Cham, pp 97–103
Brooke J (1996) SUS - a quick and dirty usability scale. In: Jordan P, Thomas B, Weerdmeester B, McClelland I (eds) Usability evaluation in industry, chap. 21. CRC Press, London, pp 189–194
Bruno G, Antonelli D (2018) Dynamic task classification and assignment for the management of human-robot collaborative teams in workcells. Int J Adv Manufact Technol 98(9-12):2415–2427
BS 4778-3.1:1991: Quality vocabulary. availability, reliability and maintainability terms. Guide to concepts and related definitions. Standard BS 4778-3.1:1991, British Standards Institution, London, UK (1991)
BS 8611:2016: Robots and robotic devices. guide to the ethical design and application of robots and robotic systems. Standard BS 8611:2016, British Standards Institution, London, UK (2016)
Campana JR, Quaresma M (2017) The importance of specific usability guidelines for robot user interfaces. In: Marcus A, Wang W (eds) Design, user experience, and usability: designing pleasurable experiences, lecture notes in computer science. Springer International Publishing, Cham, pp 471–483. https://doi.org/10.1007/978-3-319-58637-3_37
Charalambous G, Fletcher S, Webb P (2015) Identifying the key organisational human factors for introducing human-robot collaboration in industry: an exploratory study. Int J Adv Manufact Technol 81(9-12):2143–2155
Charalambous G, Fletcher S, Webb P (2016) The development of a scale to evaluate trust in industrial human-robot collaboration. International Journal of Social Robotics 8(2):193–209
Charalambous G, Fletcher SR, Webb P (2017) The development of a human factors readiness level tool for implementing industrial human-robot collaboration. Int J Adv Manufact Technol 91(5-8):2465–2475
Colgate JE, Wannasuphoprasit W, Peshkin MA (1996) Cobots: robots for collaboration with human operators. In: Proceedings of the 1996 ASME dynamic systems and control division, DSC, 1996-8, vol 58. ASME, New York, pp 433–439
Corrales JA, Candelas FA, Torres F (2011) Safe human–robot interaction based on dynamic sphere-swept line bounding volumes. Robot Comput Integr Manuf 27(1):177–185. https://doi.org/10.1016/j.rcim.2010.07.005
Davis FD (1989) Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q 13(3):319–340. https://doi.org/10.2307/249008
De Santis A, Siciliano B, De Luca A, Bicchi A (2008) An atlas of physical human–robot interaction. Mech Mach Theory 43(3):253–270. https://doi.org/10.1016/j.mechmachtheory.2007.03.003
Dedeke A (2017) Cybersecurity framework adoption: using capability levels for implementation tiers and profiles. IEEE Security Privacy 15(5):47–54. https://doi.org/10.1109/MSP.2017.3681063
Dubowsky S, Genot F, Godding S, Kozono H, Skwersky A, Yu H, Yu LS (2000) PAMM- a robotic aid to the elderly for mobility assistance and monitoring: a helping-hand for the elderly. In: Proceedings 2000 ICRA. Millennium Conference. IEEE International conference on robotics and automation. Symposia Proceedings (Cat. No.00CH37065), vol 1. IEEE, pp 570–576. https://doi.org/10.1109/ROBOT.2000.844114
Eimontaite I, Gwilt I, Cameron D, Aitken JM, Rolph J, Mokaram S, Law J (2019) Language-free graphical signage improves human performance and reduces anxiety when working collaboratively with robots. Int J Adv Manufact Technol 100(1-4):55–73
Endsley MR, Kaber DB (1999) Level of automation effects on performance, situation awareness and workload in a dynamic control task. Ergonomics 42(3):462–492. https://doi.org/10.1080/001401399185595
Fondazione Ergo: EAWS website (2019). http://www.eaws.it
Franceschini F, Galetto M, Maisano D (2019) Designing performance measurement systems: theory and practice of key performance indicators. Management for professionals. Springer International Publishing, Cham. https://doi.org/10.1007/978-3-030-01192-5
Gervasi R, Mastrogiacomo L, Franceschini F (2019) Towards the definition of a human-robot collaboration scale. In: Bini M, Amenta P, D’Ambra A, Camminatiello I (eds) Statistical methods for service quality evaluation - book of short papers of IES 2019, Rome, Italy, July 4-5. Cuzzolin, Italy, pp 75–80
Goodrich MA, Schultz AC (2007) Human-robot interaction: a survey Foundations and trends in human-computer interaction, vol 1. Now, Boston
Hart SG, Staveland LE (1988) Development of NASA-TLX (task load index): results of empirical and theoretical research. In: Hancock PA, Meshkati N (eds) Advances in psychology, human mental workload, vol 52, pp 139–183, North-Holland. https://doi.org/10.1016/S0166-4115(08)62386-9
Huang HM, Messina E, Wade R, English R, Novak B, Albus J (2004) Autonomy measures for robots. In: Proceedings of the international mechanical engineering congress. ASME, Anaheim, pp 1241–1247. https://doi.org/10.1115/IMECE2004-61812
Ikuta K, Ishii H, Nokata M (2003) Safety evaluation method of design and control for human-care robots. The International Journal of Robotics Research 22(5):281–297. https://doi.org/10.1177/0278364903022005001
ISO 10218-2:2011: robots and robotic devices – safety requirements for industrial robots – Part 2: robot systems and integration. Standard ISO 10218-2:2011, International Organization for Standardization, Geneva, CH (2011). https://www.iso.org/standard/41571.html
ISO 12100:2010: Safety of machinery – general principles for design – risk assessment and risk reduction. Standard ISO 12100:2010, International Organization for Standardization, Geneva, CH (2010). https://www.iso.org/standard/51528.html
ISO 26800:2011: Ergonomics - general approach, principles and concepts. Standard ISO 26800:2011, International Organization for Standardization, Geneva, CH (2011). https://www.iso.org/standard/42885.html
ISO 9241-11:2018: Ergonomics of human-system interaction - part 11: usability: definitions and concepts. Standard ISO 9241-11:2018, International Organization for Standardization, Geneva, CH (2018). https://www.iso.org/standard/63500.html
ISO/TR 14121-2:2012: Safety of machinery – risk assessment – part 2: practical guidance and examples of methods. Standard ISO/TR 14121-2:2012, International Organization for Standardization, Geneva, CH (2012). https://www.iso.org/standard/57180.html
ISO/TS 15066:2016: Robots and robotic devices – collaborative robots. Standard ISO/TS 15066:2016, International Organization for Standardization, Geneva, CH (2016). https://www.iso.org/standard/62996.html
Kozar O (2010) Towards better group work: seeing the difference between cooperation and collaboration. In: English teaching forum. ERIC, vol 48, pp 16–23
Kragic D, Gustafson J, Karaoguz H, Jensfelt P, Krug R (2018) Interactive, collaborative robots: challenges and opportunities. In: Proceedings of the twenty-seventh international joint conference on artificial intelligence. International Joint Conferences on Artificial Intelligence Organization, Stockholm, pp 18–25
Krüger J, Lien TK, Verl A (2009) Cooperation of human and machines in assembly lines. CIRP Ann 58(2):628–646. https://doi.org/10.1016/j.cirp.2009.09.009
Krüger J, Nickolay B, Heyer P, Seliger G (2005) Image based 3d surveillance for flexible man-robot-cooperation. CIRP Ann 54(1):19–22. https://doi.org/10.1016/S0007-8506(07)60040-7
Krüger M, Wiebel CB, Wersing H (2017) From tools towards cooperative assistants. In: Proceedings of the 5th international conference on human agent interaction - HAI ’17. ACM Press, Bielefeld, pp 287–294. https://doi.org/10.1145/3125739.3125753
KUKA: (2020). https://www.kuka.com/
Kurose JF, Ross KW (2013) Computer networking: a top-down approach, 6th edn. Addison-Wesley, Upper Saddle River
Lindblom J, Wang W (2018) Towards an evaluation framework of safety, trust, and operator experience in different demonstrators of human-robot collaboration. In: Case K, Thorvald P (eds) Advances in manufacturing technology XXXII, No 8. IOS Press, pp 145–150. https://doi.org/10.3233/978-1-61499-902-7-145
Mastrogiacomo L, Barravecchia F, Franceschini F (2018) Definition of a conceptual scale of servitization: proposal and preliminary results CIRP. Journal of Manufacturing Science and Technology. https://doi.org/10.1016/j.cirpj.2018.11.003
Mateus JC, Claeys D, Limère V, Cottyn J, Aghezzaf EH (2019) A structured methodology for the design of a human-robot collaborative assembly workplace. The International Journal of Advanced Manufacturing Technology 102(5-8):2663–2681
Maurtua I, Ibarguren A, Kildal J, Susperregi L, Sierra B (2017) Human-robot collaboration in industrial applications: safety, interaction and trust. Int J Adv Robot Syst 14(4):1–10. 10.1177/1729881417716010
McInnerney JM, Roberts TS (2004) Collaborative or cooperative learning? In: Roberts TS (ed) Online collaborative learning: theory and practice, chap. 10. Information Science Publishing, Hershey, pp 203–214
Nelles J, Kwee-Meier ST, Mertens A (2019) Evaluation metrics regarding human well-being and system performance in human-robot interaction – a literature review. In: Bagnara S, Tartaglia R, Albolino S, Alexander T, Fujita Y (eds) Proceedings of the 20th congress of the international ergonomics association (IEA 2018), vol. 825. Springer International Publishing, Cham, pp 124–135
Neto P, Simão M, Mendes N, Safeea M (2019) Gesture-based human-robot interaction for human assistance in manufacturing. The International Journal of Advanced Manufacturing Technology 101(1-4):119–135
NIST: Framework for improving critical infrastructure cybersecurity. Tech. rep., National Institute of Standards and Technology, Gaithersburg, MD, USA (2018). https://doi.org/10.6028/NIST.CSWP.04162018
Papanastasiou S, Kousi N, Karagiannis P, Gkournelos C, Papavasileiou A, Dimoulas K, Baris K, Koukas S, Michalos G, Makris S (2019) Towards seamless human robot collaboration: integrating multimodal interaction. The International Journal of Advanced Manufacturing Technology
Pineau J, Montemerlo M, Pollack M, Roy N, Thrun S (2003) Towards robotic assistants in nursing homes: challenges and results. Robot Auton Syst 42(3):271–281. https://doi.org/10.1016/S0921-8890(02)00381-0
Priyadarshini I (2018) Cyber security risks in robotics. In: USA IRMA (ed) Cyber security and threats: concepts, methodologies, tools, and applications, chap. 61. Hershey, IGI Global, pp 1235–1250. https://doi.org/10.4018/978-1-5225-5634-3.ch061
Raibulet C (2008) Facets of Adaptivity. In: Morrison R., Balasubramaniam D., Falkner K. (eds) Software architecture, lecture notes in computer science. Springer, Berlin, pp 342–345. https://doi.org/10.1007/978-3-540-88030-1_33
Rethink Robotics: (2020). urlhttps://www.rethinkrobotics.com/
Roschelle J, Teasley SD (1995) The construction of shared knowledge in collaborative problem solving. In: O’Malley C (ed) Computer supported collaborative learning. Springer, Berlin, pp 69–97
Rozo L, Calinon S, Caldwell DG, Jimenez P, Torras C (2016) Learning physical collaborative robot behaviors from human demonstrations. IEEE Trans Robot 32(3):513–527
Sauppè A, Mutlu B (2015) The social impact of a robot co-worker in industrial settings. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems - CHI ’15. ACM Press, Seoul, pp 3613–3622
Schaub K, Caragnano G, Britzke B, Bruder R (2013) The European assembly worksheet. Theoretical Issues in Ergonomics Science 14(6):616–639. https://doi.org/10.1080/1463922X.2012.678283
Schmidtler J, Körber M, Bengler K (2016) A trouble shared is a trouble halved — usability measures for human-robot collaboration. In: 2016 IEEE international conference on systems, man, and cybernetics (SMC), pp 000217–000222. https://doi.org/10.1109/SMC.2016.7844244
Scholtz J (2003) Theory and evaluation of human robot interactions. In: Proceedings of the 36th annual Hawaii international conference on system sciences, 2003. https://doi.org/10.1109/HICSS.2003.1174284
Sheridan TB, Verplank WL (1978) Human and computer control of undersea teleoperators. Tech. rep. Massachusetts Institute of Technology Cambridge Man-Machine Systems Lab
Smith KA (1995) Cooperative learning: effective teamwork for engineering classrooms. In: Proceedings frontiers in education 1995 25th annual conference. Engineering Education for the 21st Century, vol 1. IEEE, pp 2b5.13–2b5.18
Spenko M, Yu H, Dubowsky S (2006) Robotic personal aids for mobility and monitoring for the elderly. IEEE Transactions on Neural Systems and Rehabilitation Engineering 14(3):344–351. https://doi.org/10.1109/TNSRE.2006.881534
Stanton NA (2006) Hierarchical task analysis: developments, applications, and extensions. Applied Ergonomics 37(1):55–79. https://doi.org/10.1016/j.apergo.2005.06.003
Tan JTC, Duan F, Zhang Y, Watanabe K, Kato R, Arai T (2009) Human-robot collaboration in cellular manufacturing: design and development. In: 2009 IEEE/RSJ international conference on intelligent robots and systems. IEEE, St. Louis, pp 29–34
Thrun S (2004) Toward a framework for human-robot interaction. Human-Computer Interaction 19(1):9–24. https://doi.org/10.1207/s15327051hci1901&2_2
Tsarouchi P, Makris S, Chryssolouris G (2016) Human-robot interaction review and challenges on task planning and programming. Int J Comput Integr Manuf 29(8):916–931
Universal Robots: Collaborative robotic automation | Cobots from Universal Robots (2020). https://www.universal-robots.com/
Venkatesh V, Bala H (2008) Technology acceptance model 3 and a research agenda on interventions. Decis Sci 39(2):273–315. https://doi.org/10.1111/j.1540-5915.2008.00192.x
Venkatesh V, Davis FD (2000) A theoretical extension of the technology acceptance model: four longitudinal field studies. Manag Sci 46(2):186–204. https://doi.org/10.1287/mnsc.46.2.186.11926
Veruggio G (2006) The EURON roboethics roadmap. In: 2006 6Th IEEE-RAS international conference on humanoid robots. IEEE, University of Genova, Genova, pp 612–617
Wang L (2015) Collaborative robot monitoring and control for enhanced sustainability. The International Journal of Advanced Manufacturing Technology 81(9):1433–1445. https://doi.org/10.1007/s00170-013-4864-6
Wang P, Zhang S, Bai X, Billinghurst M, He W, Sun M, Chen Y, Lv H, Ji H (2019) 2.5DHANDS: a gesture-based MR remote collaborative platform. The International Journal of Advanced Manufacturing Technology 102(5-8):1339–1353
Wang Y, Zhang F (eds) (2017) Trends in control and decision-making for human–robot collaboration systems. Springer International Publishing, Cham
Yanco HA, Drury J (2004) Classifying human-robot interaction: an updated taxonomy. In: 2004 IEEE international conference on systems, man and cybernetics, vol 3, pp 2841–2846. https://doi.org/10.1109/ICSMC.2004.1400763
Yu H, Spenko M, Dubowsky S (2003) An adaptive shared control system for an intelligent mobility aid for the elderly. Auton Robot 15(1):53–66. https://doi.org/10.1023/A:1024488717009
Funding
This work has been partially supported by “Ministero dell’Istruzione, dell’Università e della Ricerca” Award “TESUN-83486178370409 finanziamento dipartimenti di eccellenza CAP. 1694 TIT. 232 ART. 6”.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix: EAWS structure
Appendix: EAWS structure
In this section, the structure of EAWS [67], a tool for the evaluation of physical ergonomics, is reported in more detail. Moreover, the evaluation of physical ergonomics through EAWS for the assembly task example, introduced in Section 5.1, is shown in detail. EAWS is divided in two macro-sections: Whole body and Upper limbs. The whole body macro-section is composed of four sections:
-
Extra points (Fig. 7), which contains additional types physical work load
-
Body postures (Fig. 8), which addresses static working postures and high frequent movements
-
Action forces (Fig. 9), which concerns body forces and forces of the hand–finger system
-
Manual materials handling (Fig. 10), which addresses the handling of loads of more than 2–3 kg
The Upper limbs macro-section has only one section: Upper limb load in repetitive tasks (Fig. 11), which covers gripping modes, forces, postures of the upper limbs in repetitive task.
Moreover, Figs. 7, 8, 9, 10, and 11 contain the evaluation of each EAWS section for the assembly task example, introduced in Section 5.1. Manual materials handling section was not taken into account, due to the absence of handling of loads exceeding 2–3 kg. Adding up the scores, the whole body macro-section obtained 12 points, while the upper limbs macro-section 2.8 points (Fig. 7). Therefore, the final score of the EAWS is 12, as it is the maximum between the scores of the two macro-sections. The final EAWS evaluation is “Green”, since the final score is less than 25.
Rights and permissions
About this article
Cite this article
Gervasi, R., Mastrogiacomo, L. & Franceschini, F. A conceptual framework to evaluate human-robot collaboration. Int J Adv Manuf Technol 108, 841–865 (2020). https://doi.org/10.1007/s00170-020-05363-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00170-020-05363-1