Abstract
In this paper, we develop a monocular vision system for online pose measurement of a 3-RRR planar parallel manipulator (PPM). By combining with a camera with global shutter, an active marker array, an industrial personal computer, and a degenerated perspective-n-points (DPnP) algorithm, a monocular vision measurement system (MVMS) is established. To improve measuring accuracy of the MVMS, factors that cause inaccuracy including the lens distortion, non-perpendicular angle, and input parameters’ uncertainty are analyzed and modeled in detail. In the simulation, effects of these error factors on the accuracy of the MVMS are quantitatively displayed, and comparisons between the DPnP algorithms and other state-of-art PnP algorithms are conducted. Experimental tests on the constructed MVMS demonstrate that it not only can accurately and efficiently measure pose of the 3RRR PPM, but possesses a higher operability and stability compared to the laser tracker.
Similar content being viewed by others
References
Bourbonnais, F., Bigras, P., Bonev, I.A.: Minimum-time trajectory planning and control of a pick-and-place five-bar parallel robot. IEEE/ASME Trans. Mechatron. 20(2), 740 (2015)
Merlet, J.P.: Parallel Robots, vol. 74. Springer Science & Business Media (2012)
Mishra, S., Coaplen, J., Tomizuka, M.: Precision positioning of wafer scanners segmented iterative learning control for nonrepetitive disturbances [applications of control]. IEEE Control. Syst. 27(4), 20 (2007)
Du, G., Zhang, P.: Online robot calibration based on vision measurement. Robot. Comput. Integr. Manuf. 29(6), 484 (2013)
Chen, Q., Chen, W., Yang, G., Liu, R.: An integrated two-level self-calibration method for a cable-driven humanoid arm. IEEE Trans. Autom. Sci. Eng. 10(2), 380 (2013)
Wu, L., Yang, X., Chen, K., Ren, H.: A minimal POE-based model for robotic kinematic calibration with only position measurements. IEEE Trans. Autom. Sci. Eng. 12(2), 758 (2015)
Ouyang, P., Zhang, W., Gupta, M.M., Zhao, W.: Overview of the development of a visual based automated bio-micromanipulation system. Mechatronics 17(10), 578 (2007)
Korayem, M., Tourajizadeh, H., Taherifar, M., Khayatzadeh, S., Maddah, M., Imanian, A., Tajik, A.: A novel method for recording the position and orientation of the end effector of a spatial cable-suspended robot and using for closed-loop control. Int. J. Adv. Manuf. Technol. 72(5-8), 739 (2014)
Xu, Q., Li, Y., Xi, N.: Design, fabrication, and visual servo control of an XY parallel micromanipulator with piezo-actuation. IEEE Trans. Autom. Sci. Eng. 6(4), 710 (2009)
Cui, G., Zhang, H., Zhang, D., Xu, F.: Analysis of the kinematic accuracy reliability of a 3-DOF parallel robot manipulator. Int. J. Adv. Robot. Syst. 12(2), 15 (2015)
Zhang, X., Zhang, X., Chen, Z.: Dynamic analysis of a 3-RRR parallel mechanism with multiple clearance joints. Mech. Mach. Theory 78, 105 (2014)
Joubair, A., Slamani, M., Bonev, I.A.: Kinematic calibration of a 3-DOF planar parallel robot. Industrial Robot: An International Journal 39(4), 392 (2012)
Meng, G., Tiemin, L., Wensheng, Y.: Calibration method and experiment of Stewart platform using a laser tracker. In: IEEE International Conference on Systems, Man and Cybernetics, 2003, vol. 3, pp. 2797–2802 (2003). https://doi.org/10.1109/ICSMC.2003.1244309
Joubair, A., Slamani, M., Bonev, I.A.: A novel XY-theta precision table and a geometric procedure for its kinematic calibration. Robot. Comput. Integr. Manuf. 28(1), 57 (2012)
Joubair, A., Slamani, M., Bonev, I.A.: Kinematic calibration of a five-bar planar parallel robot using all working modes. Robot. Comput. Integr. Manuf. 29(4), 15 (2013)
Liu, Y., Yuan, M., Cao, J., Cui, J., Tan, J.: Use of two planar gratings to measure 3-DOF displacements of planar moving stage. IEEE Trans. Instrum. Meas. 64(1), 163 (2015)
Meng, Y., Zhuang, H.: Autonomous robot calibration using vision technology. Robot. Comput. Integr. Manuf. 23(4), 436 (2007)
Daney, D., Andreff, N., Chabert, G., Papegay, Y.: Interval method for calibration of parallel robots: Vision-based experiments. Mech. Mach. Theory 41(8), 929 (2006)
Renaud, P., Andreff, N., Lavest, J.M., Dhome, M.: Simplifying the kinematic calibration of parallel mechanisms using vision-based metrology. IEEE Trans. Robot. 22(1), 12 (2006)
Dehghani, M., Ahmadi, M., Khayatian, A., Eghtesad, M., Yazdi, M.: Vision-based calibration of a Hexa parallel robot. Industrial Robot: An International Journal 41(3), 296 (2014). https://doi.org/10.1108/IR-07-2013-376
Ma, H., Wei, S., Lin, T., Chen, S., Li, L.: Binocular vision system for both weld pool and root gap in robot welding process. Sens. Rev. 30(2), 116 (2010)
Li, H., Chen, Y.L., Chang, T., Wu, X.: Binocular vision positioning for robot grasping. In: IEEE International Conference on Robotics and Biomimetics, pp. 1522–1527 (2011)
Wang, C., Chen, W., Tomizuka, M.: Robot end-effector sensing with position sensitive detector and inertial sensors. In: IEEE International Conference on Robotics and Automation (ICRA), 2012, IEEE, pp. 5252–5257 (2012)
Kelly, J., Sukhatme, G.S.: Visual-inertial Sensor Fusion: Localization, Mapping and Sensor-to-Sensor Self-calibration. Sage Publications Inc. (2011)
Du, G., Zhang, P.: Online serial manipulator calibration based on multisensory process via extended Kalman and particle filters. IEEE Trans. Ind. Electron. 61(12), 6852 (2014)
Ma, J., Bajracharya, M., Susca, S., Matthies, L., Malchano, M.: Real-time pose estimation of a dynamic quadruped in GPS-denied environments for 24-hour operation. Int. J. Robot. Res. 35(6), 631 (2016)
Assa, A., Janabi-Sharifi, F.: Virtual visual servoing for multicamera pose estimation. IEEE/ASME Trans. Mechatron. 20(2), 789 (2015)
Furgale, P., Rehder, J., Siegwart, R.: Unified temporal and spatial calibration for multi-sensor systems. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1280–1286 (2014)
Lu, C.P., Hager, G.D., Mjolsness, E.: Fast and globally convergent pose estimation from video images. IEEE Trans. Pattern Anal. Mach. Intell. 22(6), 610 (2000)
Lepetit, V., Moreno-Noguer, F., Fua, P.: EPNp: an accurate O(n) solution to the PnP problem. Int. J. Comput. Vis. 81(2), 155 (2009)
Hesch, J.A., Roumeliotis, S.I.: A direct least-squares (DLS) method for Pnp. In: IEEE International Conference on Computer Vision, pp. 383–390 (2011)
Hartley, R.: A. Multiple View Geometry in Computer Vision. Cambridge University Press, Zisserman (2003)
Hall, D.L., Garga, A.K.: Pitfalls in data fusion (and how to avoid them). In: International Conference on Information Fusion (Fusion’99), pp. 429–436 (1999)
Gao, M.W., Zhang, X.M., Wu, Z.W.: Optimum design of a 3-RRR planar parallel manipulator with a singularity-free workspace. In: Applied Mechanics and Materials, vol. 86, pp. 606–610. Trans Tech Publications (2011)
Zhang, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22(11), 1330 (2000)
Hartley, R., Kang, S.B.: Parameter-free radial distortion correction with center of distortion estimation. IEEE Trans. Pattern Anal. Mach. Intell. 29(8), 1309 (2007)
Heikkilä, J.: Geometric camera calibration using circular control points. IEEE Trans. Pattern Anal. Mach. Intell. 22(10), 1066 (2000)
Gouet, V., Boujemaa, N.: Object-based queries using color points of interest. In: IEEE Workshop on Content-Based Access of Image and Video Libraries, p. 30 (2001)
Acknowledgements
This work was supported by the National Natural Science Foundation of China (U1501247, 51605166, 1609206); the Scientific and Technological Research Project of Guangdong Province (2015B020239001, 2014B090917001); the Science and Technology Program of Guangzhou, China (201604010100); the State Key Laboratory of Pulp and Paper Engineering (2017ZD06).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Li, H., Zhang, Xm., Zeng, L. et al. A monocular vision system for online pose measurement of a 3RRR planar parallel manipulator. J Intell Robot Syst 92, 3–17 (2018). https://doi.org/10.1007/s10846-017-0720-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10846-017-0720-5