Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3475851.3475860acmotherconferencesArticle/Chapter ViewAbstractPublication PagesrsaeConference Proceedingsconference-collections
research-article

Fast and Accurate Pose Estimation for Industrial Workpieces Robotic Picking

Published: 15 October 2021 Publication History

Abstract

6DoF Pose estimation plays an important role in industrial robotic picking applications, and it is particularly challenging when dealing with complex-shaped workpieces, often with little texture. This paper proposes a complete approach to customize a fast and accurate workpiece picking system, based on dense reconstruction, object detection and point cloud registration schemes. For any target object, the required input is its CAD model. First, we use a depth camera and an eye-in-hand robot to capture the scene in RGB-D image form. Then, we align the CAD models to some reconstructed point clouds, and automatically generate datasets of annotated images with the help of projective rendering. The data is used to train a neural network object detector, in order to detect a region of interest in color images. Next, as the detected 2D region is projected into a 3D space, the depth information inside this space is extracted to conduct point cloud registration with the object's model for pose estimation, and its result guides the system to carry out an optical picking action. Moreover, our method is accelerated with the parallelized computation in GPU to raise the efficiency of the system.

References

[1]
Atul Adya, Paramvir Bahl, Jitendra Padhye, Alec Wolman, and Lidong Zhou. 2004. A multi-radio unification protocol for IEEE 802.11 wireless networks. In Proceedings of the IEEE 1st International Conference on Broadnets Networks (BroadNets’04) . IEEE, Los Alamitos, CA, 210–217. https://doi.org/10.1109/BROADNETS.2004.8
[2]
Sam Anzaroot and Andrew McCallum. 2013. UMass Citation Field Extraction Dataset. Retrieved May 27, 2019 from http://www.iesl.cs.umass.edu/data/data-umasscitationfield
[3]
Hinterstoisser, S., Lepetit, V., Rajkumar, N., & Konolige, K. 2016. Going Further with Point Pair Features. ECCV.
[4]
R. B. Rusu, N. Blodow, and M. Beetz. 2009. Fast point feature histograms (FPFH) for 3D registration. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Kobe, Japan.
[5]
N. Gelfand, N. J. Mitra, L. J. Guibas, and H. Pottmann. 2005. Robust global registration. In Proceedings of the third Eurographics symposium on Geometry processing, page 197. Eurographics Association.
[6]
Y. Xiang, T. Schmidt, V. Narayanan, and D. Fox. 2017. PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenes. arXiv preprint arXiv:1711.00199.
[7]
Sida Peng, Yuan Liu, Qixing Huang, Xiaowei Zhou, and Hujun Bao. 2019. Pvnet: Pixel-wise voting network for 6dof pose estimation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 4561–4570.
[8]
S. Hinterstoisser 2012. "Gradient Response Maps for RealTime Detection of Textureless Objects," in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 34, no. 5, pp. 876-888.
[9]
T. Whelan, S. Leutenegger, R. F. Salas-Moreno, B. Glocker and A. J. Davison. 2015. ElasticFusion: Dense SLAM Without A Pose Graph. Robotics: Science and Systems Conference 2015, Rome, Italy.
[10]
Marion, Pat and Florence, Peter R and Manuelli, Lucas and Tedrake, Russ. 2018. Label Fusion: A Pipeline for Generating Ground Truth Labels for Real RGBD Data of Cluttered Scenes. 2018 IEEE International Conference on Robotics and Automation (ICRA).
[11]
Nicolas Avrutin. 2016. Spatial Hashing for Pose Clustering in GPU Point Pair Feature Registration. Albert Nerken School of Engineering, New York.
[12]
Martin A. Fischler and Robert C. Bolles. Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography. Comm. Of the ACM, vol. 24,‎ June 1981, p. 381–395 (DOI 10.1145/358669.358692)
[13]
Redmon, J., Divvala, S., Girshick, R., Farhadi, A. 2016. You only look once: unified, real-time object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 779-788.
[14]
Bertram Drost 2010. Model globally, match locally: Efficient and robust 3D object recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2010, pp. 998–1005.
[15]
Paul J. Besl and Neil D. McKay. 1992. A method for Registration of 3-D Shapes. Robotics-DL tentative. International Society for Optics and Photonics, 1992, pp. 586–606.
[16]
S. Rusinkiewicz and M. Levoy. 2001. Efficient Variants of the ICP Algorithm. Proc. Int'l Conf. 3D Digital Imaging and Modeling, pp. 145-152.
[17]
A. S. Mian, M. Bennamoun, and R. Owens. 2006. Threedimensional model-based object recognition and segmentation in cluttered scenes. IEEE transactions on pattern analysis and machine intelligence, 28(10):1584–1601.
[18]
Itseez. 2015. Open Source Computer Vision Library. https://github.com/itseez/opencv

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
RSAE '21: Proceedings of the 2021 3rd International Conference on Robotics Systems and Automation Engineering
May 2021
76 pages
ISBN:9781450388467
DOI:10.1145/3475851
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 October 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. 6DoF pose estimation
  2. object detection
  3. point cloud registration

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

Conference

RSAE 2021

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 65
    Total Downloads
  • Downloads (Last 12 months)16
  • Downloads (Last 6 weeks)1
Reflects downloads up to 12 Nov 2024

Other Metrics

Citations

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media