Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1109/IROS.2018.8593810guideproceedingsArticle/Chapter ViewAbstractPublication PagesConference Proceedingsacm-pubtype
research-article

Incremental Learning-Based Adaptive Object Recognition for Mobile Robots

Published: 01 October 2018 Publication History

Abstract

3D visual understanding of the surrounding environment is vital for successful mobile robotic tasks such as autonomous navigation or general object interaction. However, current systems have limited perceptual capabilities in the sense that they are not very well adaptable to unknown environments. Human operators, on the other hand, are experts in adapting to previously unknown information. Hence, human-robot teaming in which the human helps the robot to adapt to new environments and the robot assists in automated object recognition to efficiently feed the control environment of the operator is advantageous. In this work, we propose an object recognition and localization system for mobile robots, based on deep learning, and we study the adaptation of the resulting robotic perception to a new environment. We propose two methods to teach the robot a new object category: using prior knowledge and using limited operator input. We conducted several experiments to show the feasibility of proposed methods.

References

[1]
Elliot, Linda R., Jansen, Chris, Redden, Elizabeth S., Pettitt, Rodger A. “Robotic Telepresence: Perception, Performance and User Experience”. Army Research Laboratory Technical Report, ARL-TR-5928. February, 2012.
[2]
Qi, Charles R., et al. “Pointnet: Deep learning on point sets for 3d classification and segmentation.” arXiv preprint arXiv: (2016).
[3]
I. Armeni, A. Sax, A. R. Zamir, and S. Savarese. “Joint 2D-3DSemantic Data for Indoor Scene Understanding.” ArXiv e-prints, 2017.
[4]
Yosinski, Jason et al., “How transferable are features in deep neural networks?” Advances in neural information processing systems. 2014.
[5]
Song, Shuran, and Jianxiong Xiao. “Deep sliding shapes for amodal 3D object detection in RGB-D images” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2016.
[6]
Blum, Avrim, and Tom Mitchell. “Combining labeled and unlabeled data with co-training” Proceedings of the eleventh annual conference on Computational learning theory. ACM, 1998.
[7]
Ester, Martin et al., “A density-based algorithm for discovering clusters in large spatial databases with noise” Kdd. Vol. 96. No. 34. 1996.
[8]
Wu, Zhirong et al., “3d shapenets: A deep representation for volumetric shapes” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2015.
[9]
Maturana, Daniel, et al. “Real-Time Semantic Mapping for Autonomous Off-Road Navigation.” Field and Service Robotics. Springer, Cham, 2018.
[10]
Garcia-Garcia, Alberto, et al. “A Review on Deep Learning Techniques Applied to Semantic Segmentation.” arXiv preprint arXiv: (2017).
[11]
Girshick, Ross “Fast r-cnn” Proceedings of the IEEE international conference on computer vision. 2015.
[12]
Liu, Wei, et al. “Ssd: Single shot multibox detector” European conference on computer vision. Springer, Cham, 2016.
[13]
Redmon, Joseph et al., “You only look once: Unified, real-time object detection” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2016.
[14]
Long, Jonathan, Evan Shelhamer, and Trevor Darrell. “Fully convolutional networks for semantic segmentation” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2015.
[15]
Pinheiro, Pedro O., Ronan Collobert, and Piotr Dollr. “Learning to segment object candidates.” Advances in Neural Information Processing Systems. 2015.
[16]
Chen, Liang-Chieh, et al. “Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs.” arXiv preprint arXiv: (2016).
[17]
Socher, Richard et al., “Zero-shot learning through cross-modal transfer.” Advances in neural information processing systems. 2013.
[18]
Snell, Jake, Kevin Swersky, and Richard S. Zemel. “Prototypical Networks for Few-shot Learning.” arXiv preprint arXiv: (2017).

Index Terms

  1. Incremental Learning-Based Adaptive Object Recognition for Mobile Robots
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image Guide Proceedings
        2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
        Oct 2018
        7818 pages

        Publisher

        IEEE Press

        Publication History

        Published: 01 October 2018

        Qualifiers

        • Research-article

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • 0
          Total Citations
        • 0
          Total Downloads
        • Downloads (Last 12 months)0
        • Downloads (Last 6 weeks)0
        Reflects downloads up to 10 Nov 2024

        Other Metrics

        Citations

        View Options

        View options

        Get Access

        Login options

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media