Abstract
This article proposes a control framework for cooperative robot manipulation based on distributed optimisation. Besides transporting a jointly grasped rigid object, whole-body avoidance of dynamic obstacles for the entire multi-robot system in uncertain environments is also part of the task. Since the physical connection through grasping can significantly reduce the operation capability of the system, internal performance of individual robots should be optimised during task execution. For this purpose, a framework for the characterisation of robot joint-space constraints and their inclusion into a highly multi-goal optimisation problem for the aforementioned reactive manipulation is designed. A computationally and communicationally efficient distributed optimal control algorithm based on primal decomposition is then developed for the multi-robot system to reach the optimum without generating internal conflicting forces in spite of different fields of view. Experiments on a multi-arm platform are conducted for validation. Results not only show effective coordinated avoidance of moving obstacles, but also demonstrate the benefit of optimising internal performance during cooperation.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Darmanin, R.N., Bugeja, M.K.: A Review on Multi-Robot Systems Categorised by Application Domain. IEEE, Malta (2017)
Jackson, B.E., Howell, T.A., Shah, K., Schwager, M., Manchester, Z.: Scalable cooperative transport of cable-suspended loads with UAVs using distributed trajectory optimization. IEEE Robot. Autom. Lett. 5(2), 3368–3374 (2020). https://doi.org/10.1109/lra.2020.2975956
Culbertson, P., Slotine, J.-J., Schwager, M.: Decentralized adaptive control for collaborative manipulation of rigid bodies. IEEE Trans. Robot. 37(6), 1906–1920 (2021). https://doi.org/10.1109/tro.2021.3072021
Koung, D., Kermorgant, O., Fantoni, I., Belouaer, L.: Cooperative multi-robot object transportation system based on hierarchical quadratic programming. IEEE Robot. Autom. Lett. 6(4), 6466–6472 (2021). https://doi.org/10.1109/lra.2021.3092305
Bicchi, A., Prattichizzo, D.: Manipulability of cooperating robots with unactuated joints and closed-chain mechanisms. IEEE Trans. Robot. Autom. 16(4), 336–345 (2000). https://doi.org/10.1109/70.864226
Liu, Q., Chen, C.-Y., Wang, C., Wang, W.: Common Workspace Analysis for a Dual-Arm Robot Based on Reachability. IEEE, China (2017)
He, Y., Wu, M., Liu, S.: Decentralised Cooperative Mobile Manipulation with Adaptive Control Parameters. Denmark, IEEE (2018)
Alonso-Mora, J., Baker, S., Rus, D.: Multi-robot formation control and object transport in dynamic environments via constrained optimization. Int. J. Robot. Res. 36(9), 1000–1021 (2017). https://doi.org/10.1177/0278364917719333
Erhart, S., Hirche, S.: Internal force analysis and load distribution for cooperative multi-robot manipulation. IEEE Trans. Robot. 31(5), 1238–1243 (2015). https://doi.org/10.1109/tro.2015.2459412
Wei, K., Ren, B.: A method on dynamic path planning for robotic manipulator autonomous obstacle avoidance based on an improved RRT algorithm. Sensors, 18(2), 571 (2018). https://doi.org/10.3390/s18020571
Shahab, M.T., Elshafei, M.: Distributed optimization of multi-robot motion with time-energy criterion. In: Hamid, U.Z.A., Sezer, V., Li, B., Huang, Y., Zakaria, M.A. (eds.) Path Planning for Autonomous Vehicle Ch 8. IntechOpen, Rijeka (2019), https://doi.org/10.5772/intechopen.85668
Luis, C.E., Vukosavljev, M., Schoellig, A.P.: Online trajectory generation with distributed model predictive control for multi-robot motion planning. IEEE Robot. Autom. Lett. 5(2), 604–611 (2020). https://doi.org/10.1109/lra.2020.2964159
Aladele, V., Hutchinson, S.: Collision Reaction Through Internal Stress Loading in Cooperative Manipulation. IEEE, Piscataway (2020)
Salehian, S.S.M., Figueroa, N., Billard, A.: A unified framework for coordinated multi-arm motion planning. Int. J. Robot. Res. 37(10), 1205–1232 (2018). https://doi.org/10.1177/0278364918765952
Dehio, N., et al: Modeling and Control of Multi-Arm And Multi-Leg Robots: Compensating for Object Dynamics During Grasping. IEEE Brisbane QLD, Australia (2018)
Wang, Z., Schwager, M.: Multi-robot manipulation without communication. In: Chong, N.-Y., Cho, Y.-J. (eds.) Distributed Autonomous Robotic Systems, pp 135–149. Springer, Tokyo (2016)
Xu, H, et al: Cooperative Manipulation in Unknown Environment with Distributed Control. IEEE, Piscataway (2021)
Chiacchio, P., Chiaverini, S. (eds.): Chapter 3 Kinematic control of dual-arm systems. Springer, Berlin (1998)
Erhart, S., Sieber, D., Hirche, S.: An Impedance-Based Control Architecture for Multi-Robot Cooperative Dual-Arm Mobile Manipulation. IEEE, Japan (2013)
Hu, J., et al: Convergent multiagent formation control with collision avoidance. IEEE Trans. Robot. 36(6), 1805–1818 (2020). https://doi.org/10.1109/tro.2020.2998766
Ren, Y., Sosnowski, S., Hirche, S.: Fully distributed cooperation for networked uncertain mobile manipulators. IEEE Trans. Robot. 36(4), 984–1003 (2020). https://doi.org/10.1109/tro.2020.2971416
Gen. Dohmann, P.B., Hirche, S.: Distributed control for cooperative manipulation with event-triggered communication. IEEE Trans. Robot. 36(4), 1038–1052 (2020). https://doi.org/10.1109/tro.2020.2973096
Ding, G., et al: Distributed reinforcement learning for cooperative multi-robot object manipulation. In: Proceedings of the 19th International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2020. arXiv:2003.09540 [cs.RO] (2020)
Dai, G.-B., Liu, Y.-C.: Distributed coordination and cooperation control for networked mobile manipulators. IEEE Trans. Ind. Electron. 64(6), 5065–5074 (2017). https://doi.org/10.1109/tie.2016.2642880
Shorinwa, O., Schwager, M.: Scalable Collaborative Manipulation with Distributed Trajectory Planning. IEEE, Piscataway (2020)
Tika, A., Bajcinca, N.: Synchronous Minimum-Time Cooperative Manipulation Using Distributed Model Predictive Control. IEEE, Piscataway (2020)
Williams, D., Khatib, O.: The Virtual Linkage: a Model for Internal Forces in Multi-Grasp Manipulation, vol. 1, pp 1025–1030. IEEE Comput Soc Press, Atlanta (1993)
Ortenzi, D., Muthusamy, R., Freddi, A., Monteriú, A., Kyrki, V.: Dual-arm cooperative manipulation under joint limit constraints. Robot. Auton. Syst. 99, 110–120 (2018). https://doi.org/10.1016/j.robot.2017.10.005
Markley, F.L., Cheng, Y., Crassidis, J.L., Oshman, Y.: Averaging quaternions. J. Guid. Control Dynam. 30(4), 1193–1197 (2007). https://doi.org/10.2514/1.28949
Sadeghian, H., Villani, L., Keshmiri, M., Siciliano, B.: Dynamic multi-priority control in redundant robotic systems. Robotica 31(7), 1155–1167 (2013). https://doi.org/10.1017/s0263574713000416
He, Y., Liu, S.: Analytical Inverse Kinematics for Franka Emika Panda – A Geometrical Solver for 7-DOF Manipulators With Unconventional Design. IEEE, Piscataway (2021)
Funding
This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.
Author information
Authors and Affiliations
Contributions
Yanhao He: Conceptualization, Methodology, Software, Validation, Investigation, Data Curation, Writing - Original Draft, Writing - Review & Editing, Visualization; Min Wu: Conceptualization, Resources, Writing - Review & Editing; Steven Liu: Conceptualization, Methodology, Resources, Writing - Original Draft, Writing - Review & Editing, Supervision, Funding acquisition.
Corresponding author
Ethics declarations
Ethics Approval
Not applicable (No human/animal participant)
Consent for Publication
Not applicable (No human/animal participant)
Conflict of Interests
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Additional information
Availability of Data and Material
The authors confirm that the data supporting the findings of this study are available within this article.
Consent To Participate
Not applicable (No human/animal participant)
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Min Wu and Steven Liu These authors contributed equally to this work.
Rights and permissions
About this article
Cite this article
He, Y., Wu, M. & Liu, S. A Distributed Optimal Control Framework for Multi-Robot Cooperative Manipulation in Dynamic Environments. J Intell Robot Syst 105, 8 (2022). https://doi.org/10.1007/s10846-022-01621-4
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10846-022-01621-4