Just Accepted
Assistance in Teleoperation of Redundant Robots through Predictive Joint Maneuvering
Accepted on 07 September 2023
Abstract
In teleoperation of redundant robotic manipulators, translating an operator’s end effector motion command to joint space can be a tool for maintaining feasible and precise robot motion. Through optimizing redundancy resolution, the control system can ensure the end effector maintains maneuverability by avoiding joint limits and kinematic singularities. In autonomous motion planning, this optimization can be done over an entire trajectory to improve performance over local optimization. However, teleoperation involves a human-in-the-loop who determines the trajectory to be executed through a dynamic sequence of motion commands. We present two systems, PrediKCT and PrediKCS, for utilizing a predictive model of operator commands in order to accomplish this redundancy resolution in a manner that considers future expected motion during teleoperation. Using a probabilistic model of operator commands allows optimization over an expected trajectory of future motion rather than consideration of local motion alone. Evaluation through a user study demonstrates improved control outcomes from this predictive redundancy resolution over minimum joint velocity solutions and inverse kinematics-based motion controllers.
References
[1]
Daniel Aarno, Staffan Ekvall, and Danica Kragic. 2005. Adaptive virtual fixtures for machine-assisted teleoperation tasks. In Proceedings of the 2005 IEEE international conference on robotics and automation. IEEE, 1139–1144.
[2]
Rajeev Agrawal. 1995. The continuum-armed bandit problem. SIAM journal on control and optimization 33, 6 (1995), 1926–1951.
[3]
Negin Amirshirzad, Asiye Kumru, and Erhan Oztop. 2019. Human Adaptation to Human–Robot Shared Control. IEEE Transactions on Human-Machine Systems 49, 2 (2019), 126–136.
[4]
Reuben M Aronson, Thiago Santini, Thomas C Kübler, Enkelejda Kasneci, Siddhartha Srinivasa, and Henny Admoni. 2018. Eye-hand behavior in human-robot shared manipulation. In Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction. ACM, 4–13.
[5]
John Baillieul. 1985. Kinematic programming alternatives for redundant manipulators. In Proceedings. 1985 IEEE International Conference on Robotics and Automation, Vol. 2. IEEE, 722–728.
[6]
Anthony Brohan, Noah Brown, Justice Carbajal, Yevgen Chebotar, Joseph Dabis, Chelsea Finn, Keerthana Gopalakrishnan, Karol Hausman, Alex Herzog, Jasmine Hsu, et al. 2022. Rt-1: Robotics transformer for real-world control at scale. arXiv preprint arXiv:2212.06817(2022).
[7]
Connor Brooks and Daniel Szafir. 2022. The Predictive Kinematic Control Tree: Enhancing Teleoperation of Redundant Robots through Probabilistic User Models. In 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE.
[8]
Sébastien Bubeck, Rémi Munos, and Gilles Stoltz. 2011. Pure exploration in finitely-armed and continuous-armed bandits. Theoretical Computer Science 412, 19 (2011), 1832–1852.
[9]
Emanuele Cavenaghi, Gabriele Sottocornola, Fabio Stella, and Markus Zanker. 2021. Non stationary multi-armed bandit: Empirical evaluation of a new concept drift-aware algorithm. Entropy 23, 3 (2021), 380.
[10]
Stefano Chiaverini. 1997. Singularity-robust task-priority redundancy resolution for real-time kinematic control of robot manipulators. IEEE Transactions on Robotics and Automation 13, 3(1997), 398–410.
[11]
Stefano Chiaverini, Giuseppe Oriolo, and Anthony A Maciejewski. 2016. Redundant robots. In Springer Handbook of Robotics. Springer, 221–242.
[12]
Rahul Chipalkatty, Greg Droge, and Magnus B Egerstedt. 2013. Less is more: Mixed-initiative model-predictive control with human inputs. IEEE Transactions on Robotics 29, 3 (2013), 695–703.
[13]
Anca D Dragan and Siddhartha S Srinivasa. 2013. A policy-blending formalism for shared control. The International Journal of Robotics Research 32, 7 (2013), 790–805.
[14]
Marco Faroni, Manuel Beschi, Nicola Pedrocchi, and Antonio Visioli. 2018. Predictive inverse kinematics for redundant manipulators with task scaling and kinematic constraints. IEEE Transactions on Robotics 35, 1 (2018), 278–285.
[15]
Marco Faroni, Manuel Beschi, Lorenzo Molinari Tosatti, and Antonio Visioli. 2017. A predictive approach to redundancy resolution for robot manipulators. IFAC-PapersOnLine 50, 1 (2017), 8975–8980.
[16]
Aurélien Garivier and Eric Moulines. 2008. On Upper-Confidence Bound Policies for Non-Stationary Bandit Problems. HAL 2008(2008).
[17]
William R Glaser. 2010. The impact of user-input devices on virtual desktop trainers. Ph. D. Dissertation. Monterey, California. Naval Postgraduate School.
[18]
Deepak Gopinath, Siddarth Jain, and Brenna D Argall. 2016. Human-in-the-loop optimization of shared autonomy in assistive robotics. IEEE robotics and automation letters 2, 1 (2016), 247–254.
[19]
Deepak Edakkattil Gopinath and Brenna Argall. 2017. Mode Switch Assistance To Maximize Human Intent Disambiguation.Robotics: Science and Systems(2017).
[20]
Kris Hauser. 2013. Recognition, prediction, and planning for assisted teleoperation of freeform tasks. Autonomous Robots 35, 4 (2013), 241–254.
[21]
Laura V Herlant, Rachel M Holladay, and Siddhartha S Srinivasa. 2016. Assistive teleoperation of robot arms via automatic time-optimal mode switching. In 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 35–42.
[22]
Siddarth Jain and Brenna Argall. 2018. Recursive Bayesian Human Intent Recognition in Shared-Control Robotics. In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 3905–3912.
[23]
Shervin Javdani, Henny Admoni, Stefania Pellegrinelli, Siddhartha S Srinivasa, and J Andrew Bagnell. 2018. Shared autonomy via hindsight optimization for teleoperation and teaming. The International Journal of Robotics Research (2018), 0278364918776060.
[24]
Shervin Javdani, Siddhartha S Srinivasa, and J Andrew Bagnell. 2015. Shared autonomy via hindsight optimization. Robotics science and systems: online proceedings 2015 (2015).
[25]
Ananth Jonnavittula and Dylan P Losey. 2021. Learning to share autonomy across repeated interaction. In 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 1851–1858.
[26]
Kapil D Katyal, Matthew S Johannes, Spencer Kellis, Tyson Aflalo, Christian Klaes, Timothy G McGee, Matthew P Para, Ying Shi, Brian Lee, Kelsie Pejsa, et al. 2014. A collaborative BCI approach to autonomous control of a prosthetic limb system. In 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC). IEEE, 1479–1482.
[27]
Beomjoon Kim, Kyungjae Lee, Sungbin Lim, Leslie Kaelbling, and Tomás Lozano-Pérez. 2020. Monte carlo tree search in continuous spaces using voronoi optimistic optimization with regret bounds. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 9916–9924.
[28]
Jonathan Kofman, Xianghai Wu, Timothy J Luu, and Siddharth Verma. 2005. Teleoperation of a robot manipulator using a vision-based human-robot interface. IEEE transactions on industrial electronics 52, 5 (2005), 1206–1219.
[29]
Danica Kragic, Panadda Marayong, Ming Li, Allison M Okamura, and Gregory D Hager. 2005. Human-machine collaborative systems for microsurgical applications. The International Journal of Robotics Research 24, 9 (2005), 731–741.
[30]
Alain Liegeois et al. 1977. Automatic supervisory control of the configuration and behavior of multibody mechanisms. IEEE transactions on systems, man, and cybernetics 7, 12(1977), 868–871.
[31]
Michael H. Lim, Claire J. Tomlin, and Zachary N. Sunberg. 2021. Voronoi Progressive Widening: Efficient Online Solvers for Continuous State, Action, and Observation POMDPs. In 2021 60th IEEE Conference on Decision and Control (CDC). 4493–4500. https://doi.org/10.1109/CDC45484.2021.9683490
[32]
Yen-Chen Liu and Nikhil Chopra. 2011. Semi-autonomous teleoperation in task space with redundant slave robot under communication delays. In 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 679–684.
[33]
Jing Luo, Darong Huang, Yanan Li, and Chenguang Yang. 2021. Trajectory Online Adaption Based on Human Motion Prediction for Teleoperation. IEEE Transactions on Automation Science and Engineering (2021), 1–8. https://doi.org/10.1109/TASE.2021.3111678
[34]
Anthony A Maciejewski and Charles A Klein. 1985. Obstacle avoidance for kinematically redundant manipulators in dynamically varying environments. The international journal of robotics research 4, 3 (1985), 109–117.
[35]
Negar Mehr, Roberto Horowitz, and Anca D Dragan. 2016. Inferring and assisting with constraints in shared autonomy. In 2016 IEEE 55th Conference on Decision and Control (CDC). IEEE, 6689–6696.
[36]
Katharina Muelling, Arun Venkatraman, Jean-Sebastien Valois, John E Downey, Jeffrey Weiss, Shervin Javdani, Martial Hebert, Andrew B Schwartz, Jennifer L Collinger, and J Andrew Bagnell. 2017. Autonomy infused teleoperation with application to brain computer interface controlled manipulation. Autonomous Robots 41, 6 (2017), 1401–1422.
[37]
Nitendra Nath, Enver Tatlicioglu, and Darren M Dawson. 2009. Teleoperation with kinematically redundant robot manipulators with sub-task objectives. Robotica 27, 7 (2009), 1027–1038.
[38]
Aaron Powers. 2008. What robotics can learn from HCI. Interactions 15, 2 (2008), 67–69.
[39]
Daniel Rakita, Bilge Mutlu, and Michael Gleicher. 2017. A motion retargeting method for effective mimicry-based teleoperation of robot arms. In Proceedings of the 2017 ACM/IEEE International Conference on Human-Robot Interaction. 361–370.
[40]
Daniel Rakita, Bilge Mutlu, and Michael Gleicher. 2018. RelaxedIK: Real-time Synthesis of Accurate and Feasible Robot Arm Motion. In Robotics: Science and Systems. Pittsburgh, PA, 26–30.
[41]
Daniel J Rea and Stela H Seo. 2022. Still Not Solved: A Call for Renewed Focus on User-Centered Teleoperation Interfaces. Frontiers in Robotics and AI 9 (2022).
[42]
Matteo Rubagotti, Tasbolat Taunyazov, Bukeikhan Omarali, and Almas Shintemirov. 2019. Semi-autonomous robot teleoperation with obstacle avoidance via model predictive control. IEEE Robotics and Automation Letters 4, 3 (2019), 2746–2753.
[43]
Mario Selvaggio, P Robuffo Giordano, Fanny Ficuciello, and Bruno Siciliano. 2019. Passive task-prioritized shared-control teleoperation with haptic guidance. In 2019 international conference on robotics and automation (ICRA). IEEE, 430–436.
[44]
Bruno Siciliano. 1990. Kinematic control of redundant robot manipulators: A tutorial. Journal of intelligent and robotic systems 3, 3 (1990), 201–212.
[45]
Justin G. Storms and Dawn M. Tilbury. 2014. Blending of human and obstacle avoidance control for a high speed mobile robot. In 2014 American Control Conference. 3488–3493. https://doi.org/10.1109/ACC.2014.6859352
[46]
Hang Su, Chenguang Yang, Giancarlo Ferrigno, and Elena De Momi. 2019. Improved human–robot collaborative control of redundant robot for teleoperated minimally invasive surgery. IEEE Robotics and Automation Letters 4, 2 (2019), 1447–1453.
[47]
Francesco Trovo, Stefano Paladino, Marcello Restelli, and Nicola Gatti. 2020. Sliding-window thompson sampling for non-stationary settings. Journal of Artificial Intelligence Research 68 (2020), 311–364.
[48]
Miomir Vukobratovic and Manja Kirćanski. 1984. A dynamic approach to nominal trajectory synthesis for redundant manipulators. IEEE transactions on systems, man, and cybernetics4 (1984), 580–586.
[49]
Yizao Wang, Jean-Yves Audibert, and Rémi Munos. 2008. Algorithms for infinitely many-armed bandits. Advances in Neural Information Processing Systems 21 (2008).
[50]
Daniel E Whitney. 1969. Resolved motion rate control of manipulators and human prostheses. IEEE Transactions on man-machine systems 10, 2 (1969), 47–53.
[51]
Tsuneo Yoshikawa. 1985. Manipulability of robotic mechanisms. The international journal of Robotics Research 4, 2 (1985), 3–9.
[52]
Wentao Yu, Redwan Alqasemi, Rajiv Dubey, and Norali Pernalete. 2005. Telemanipulation assistance based on motion intention recognition. In Robotics and Automation, 2005. ICRA 2005. Proceedings of the 2005 IEEE International Conference on. IEEE, 1121–1126.
Index Terms
- Assistance in Teleoperation of Redundant Robots through Predictive Joint Maneuvering
Recommendations
Trilateral teleoperation control of kinematically redundant robotic manipulators
Teleoperation control of kinematically redundant robots requires a strategy for resolving their redundancy. A trilateral two-master/one-slave control approach is proposed for delay-free applications in which the first master controls a primary task ...
An Optimization Based Inverse Kinematics of Redundant Robots Avoiding Obstacles and Singularities
AIR '17: Proceedings of the 2017 3rd International Conference on Advances in RoboticsRedundant manipulators are characterized by a high number of degrees of freedom (DOF) than the required number to perform a given task. This additional DOF of the robot enhances it to work in the cluttered environment by avoiding obstacles and provides ...
Self-motion utilization for reducing vibration of a structurally flexible redundant robot manipulator system
This paper focuses on overcoming the problem of tracking control in structurally flexible redundant manipulators by utilizing their self-motion capabilities. In the proposed algorithm, the self-motion is evaluated in order to nullify the dominant modal ...
Comments
Information & Contributors
Information
Published In
EISSN:2573-9522
Table of ContentsCopyright © 2023 Copyright held by the owner/author(s). Publication rights licensed to ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Online AM: 03 November 2023
Accepted: 07 September 2023
Revised: 16 April 2023
Received: 14 July 2022
Check for updates
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 202Total Downloads
- Downloads (Last 12 months)202
- Downloads (Last 6 weeks)26
Reflects downloads up to
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in