Abstract
Cooperative human-robot interaction often requires successful handovers of objects between the two entities. However, the assumption that a human can reliably grasp an object from a robot is not always valid. To address this issue, we propose a vision-based tactile sensor for object handover framework that utilises a low-cost sensor with variable sensitivity and pressure. The sensor comprises a latex layer that makes contact with the object and a tracking marker that registers the resulting changes in position. By pre-processing this information, a robot can determine whether it is necessary to open the gripper. Our approach is validated through an exploratory user study involving ten participants who completed handover tasks involving eight objects of varying shapes and stiffness, including rigid and deformable objects like raspberries and dough. The study results demonstrate the effectiveness of our approach, with a success rate of 94%. Additionally, users reported less difficulty performing the handover tasks when the sensitivity value was decreased. Overall, our vision-based tactile sensor framework offers a promising solution for the challenging problem of human-robot handover in cooperative settings.
We would like to thank all the individuals who participated in our experiments. Your time and effort are greatly appreciated.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Ajoudani, A., Zanchettin, A.M., Ivaldi, S., Albu-Schäffer, A., Kosuge, K., Khatib, O.: Progress and prospects of the human-robot collaboration. Auton. Robots 42, 957–975 (2018)
Østergaard, E.H.: The role of cobots in industry 4.0. Universal Robots, white paper (2017)
Tavakoli, M., Carriere, J., Torabi, A.: Robotics, smart wearable technologies, and autonomous intelligent systems for healthcare during the COVID-19 pandemic: an analysis of the state of the art and future vision. Adv. Intell. Syst. 2(7), 2000071 (2020)
Pandey, A.K., Alami, R.: Towards human-level semantics understanding of human-centered object manipulation tasks for HRI: reasoning about effect, ability, effort and perspective taking. Int. J. Soc. Robot. 6, 593–620 (2014)
Nagata, K., Oosaki, Y., Kakikura, M., Tsukune, H.: Delivery by hand between human and robot based on fingertip force-torque information. In: Proceedings 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No. 98CH36190), vol. 2, pp. 750–757. IEEE (1998)
Edsinger, A., Kemp, C.C.: Human-robot interaction for cooperative manipulation: handing objects to one another. In: RO-MAN 2007-The 16th IEEE International Symposium on Robot and Human Interactive Communication, pp. 1167–1172. IEEE (2007)
Eguiluz, A.G., Rañó, I., Coleman, S.A., McGinnity, T.M.: Reliable object handover through tactile force sensing and effort control in the shadow robot hand. In: 2017 IEEE International Conference on Robotics and Automation (ICRA), pp. 372–377. IEEE (2017)
Yamaguchi, A., Atkeson, C.G.: Implementing tactile behaviors using FingerVision. In: 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids), pp. 241–248. IEEE (2017)
Ortenzi, V., Cosgun, A., Pardi, T., Chan, W.P., Croft, E., Kulić, D.: Object handovers: a review for robotics. IEEE Trans. Robot. 37(6), 1855–1873 (2021)
Newbury, R., Cosgun, A., Crowley-Davis, T., Chan, W.P., Drummond, T., Croft, E.A.: Visualizing robot intent for object handovers with augmented reality. In: 2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), pp. 1264–1270. IEEE (2022)
Yang, W., Paxton, C., Mousavian, A., Chao, Y.-W., Cakmak, M., Fox, D.: Reactive human-to-robot handovers of arbitrary objects. In: 2021 IEEE International Conference on Robotics and Automation (ICRA), pp. 3118–3124. IEEE (2021)
Rosenberger, P., et al.: Object-independent human-to-robot handovers using real time robotic vision. IEEE Robot. Autom. Lett. 6(1), 17–23 (2020)
Ardón, P., et al.: Affordance-aware handovers with human arm mobility constraints. IEEE Robot. Autom. Lett. 6(2), 3136–3143 (2021)
Li, Q., Kroemer, O., Su, Z., Veiga, F.F., Kaboli, M., Ritter, H.J.: A review of tactile information: perception and action through touch. IEEE Trans. Robot. 36(6), 1619–1634 (2020)
Westling, G., Johansson, R.S.: Factors influencing the force control during precision grip. Exp. Brain Res. 53, 277–284 (1984)
Yamaguchi, A., Atkeson, C.G.: Tactile behaviors with the vision-based tactile sensor FingerVision. Int. J. Humanoid Rob. 16(03), 1940002 (2019)
Lambeta, M., et al.: Digit: a novel design for a low-cost compact high-resolution tactile sensor with application to in-hand manipulation. IEEE Robot. Autom. Lett. 5(3), 3838–3845 (2020)
Taylor, I.H., Dong, S., Rodriguez, A.: Gelslim 3.0: high-resolution measurement of shape, force and slip in a compact tactile-sensing finger. In: 2022 International Conference on Robotics and Automation (ICRA), pp. 10781–10787. IEEE (2022)
Wettels, N., Popovic, D., Santos, V.J., Johansson, R.S., Loeb, G.E.: Biomimetic tactile sensor for control of grip. In: 2007 IEEE 10th International Conference on Rehabilitation Robotics, pp. 923–932. IEEE (2007)
Reinecke, J., Dietrich, A., Schmidt, F., Chalon, M.: Experimental comparison of slip detection strategies by tactile sensing with the biotac® on the DLR hand arm system. In: 2014 IEEE international Conference on Robotics and Automation (ICRA), pp. 2742–2748. IEEE (2014)
Su, Z., et al.: Force estimation and slip detection/classification for grip control using a biomimetic tactile sensor. In: 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids), pp. 297–303. IEEE (2015)
Gliem, J.A., Gliem, R.R.: Calculating, interpreting, and reporting cronbach’s alpha reliability coefficient for likert-type scales. In: Midwest Research-to-Practice Conference in Adult, Continuing, and Community (2003)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Rayamane, P., Munguia-Galeano, F., Tafrishi, S.A., Ji, Z. (2023). Towards Smooth Human-Robot Handover with a Vision-Based Tactile Sensor. In: Iida, F., Maiolino, P., Abdulali, A., Wang, M. (eds) Towards Autonomous Robotic Systems. TAROS 2023. Lecture Notes in Computer Science(), vol 14136. Springer, Cham. https://doi.org/10.1007/978-3-031-43360-3_35
Download citation
DOI: https://doi.org/10.1007/978-3-031-43360-3_35
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-43359-7
Online ISBN: 978-3-031-43360-3
eBook Packages: Computer ScienceComputer Science (R0)