Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Low Resolution Lidar-Based Multi-Object Tracking for Driving Applications

  • Conference paper
  • First Online:
ROBOT 2017: Third Iberian Robotics Conference (ROBOT 2017)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 693))

Included in the following conference series:

  • 2915 Accesses

Abstract

Vehicle detection and tracking in real scenarios are key components to develop assisted and autonomous driving systems. Lidar sensors are specially suitable for this task, as they bring robustness to harsh weather conditions while providing accurate spatial information. However, the resolution provided by point cloud data is very scarce in comparison to camera images. In this work we explore the possibilities of Deep Learning (DL) methodologies applied to low resolution 3D lidar sensors such as the Velodyne VLP-16 (PUCK), in the context of vehicle detection and tracking. For this purpose we developed a lidar-based system that uses a Convolutional Neural Network (CNN), to perform point-wise vehicle detection using PUCK data, and Multi-Hypothesis Extended Kalman Filters (MH-EKF), to estimate the actual position and velocities of the detected vehicles. Comparative studies between the proposed lower resolution (VLP-16) tracking system and a high-end system, using Velodyne HDL-64, were carried out on the Kitti Tracking Benchmark dataset. Moreover, to analyze the influence of the CNN-based vehicle detection approach, comparisons were also performed with respect to the geometric-only detector. The results demonstrate that the proposed low resolution Deep Learning architecture is able to successfully accomplish the vehicle detection task, outperforming the geometric baseline approach. Moreover, it has been observed that our system achieves a similar tracking performance to the high-end HDL-64 sensor at close range. On the other hand, at long range, detection is limited to half the distance of the higher-end sensor.

I. del Pino and V. Vaquero contributed equally. This work has been supported by the Spanish Ministry of Economy and Competitiveness projects ROBINSTRUCT (TIN2014-58178-R) and COLROBTRANSP (DPI2016-78957-R), by the Spanish Ministry of Education FPU grant (FPU15/04446), the Spanish State Research Agency through the María de Maeztu Seal of Excellence to IRI (MDM-2016-0656) and by the EU H2020 project LOGIMATIC (H2020-Galileo-2015-1-687534). The authors also thank Nvidia for hardware donation under the GPU grant program.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Abualhoul, M.Y., Merdrignac, P., Shagdar, O., Nashashibi, F.: Study and evaluation of laser-based perception and light communication for a platoon of autonomous vehicles. In: 19th Intelligent Transportation Systems Conference, pp. 1798–1804. IEEE (2016)

    Google Scholar 

  2. Arras, K.O., Mozos, O.M., Burgard, W.: Using boosted features for the detection of people in 2D range data. In: 2007 IEEE International Conference on Robotics and Automation, pp. 3402–3407. IEEE (2007)

    Google Scholar 

  3. Behley, J., Steinhage, V., Cremers, A.B.: Performance of histogram descriptors for the classification of 3D laser range data in urban environments. In: 2012 IEEE International Conference on Robotics and Automation, pp. 4391–4398. IEEE (2012)

    Google Scholar 

  4. Bernardin, K., Stiefelhagen, R.: Evaluating multiple object tracking performance: the clear MOT metrics. EURASIP J. Image Video Proc. 2008(1), 246309 (2008)

    Google Scholar 

  5. Chen, X., Ma, H., Wan, J., Li, B., Xia, T.: Multi-view 3D object detection network for autonomous driving. arXiv preprint arXiv:1611.07759 [cs.CV] (2016)

  6. Douillard, B., Underwood, J., Kuntz, N., Vlaskine, V., Quadros, A., Morton, P., Frenkel, A.: On the segmentation of 3D lidar point clouds. In: 2011 IEEE International Conference on Robotics and Automation, pp. 2798–2805. IEEE (2011)

    Google Scholar 

  7. Eidehall, A., Pohl, J., Gustafsson, F., Ekmark, J.: Toward autonomous collision avoidance by steering. IEEE Trans. Intell. Transp. Syst. 8(1), 84–94 (2007)

    Article  Google Scholar 

  8. Engelcke, M., Rao, D., Wang, D.Z., Tong, C.H., Posner, I.: Vote3deep: fast object detection in 3D point clouds using efficient convolutional neural networks. In: 2017 IEEE International Conference on Robotics and Automation, pp. 1355–1361. IEEE (2017)

    Google Scholar 

  9. Geiger, A., Lenz, P., Urtasun, R.: Are we ready for autonomous driving? the Kitti vision benchmark suite. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 3354–3361. IEEE (2012)

    Google Scholar 

  10. Graham, B.: Sparse 3D convolutional neural networks. arXiv preprint arXiv:1505.02890 [cs.CV] (2015)

  11. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778. IEEE (2016)

    Google Scholar 

  12. Kohlhaas, R., Schamm, T., Lenk, D., Zöllner, J.M.: Towards driving autonomously: autonomous cruise control in urban environments. In: 2013 IEEE Intelligent Vehicles Symposium, pp. 116–121. IEEE (2013)

    Google Scholar 

  13. Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems 25, pp. 1097–1105. NIPS Foundation (2012)

    Google Scholar 

  14. Li, B.: 3D fully convolutional network for vehicle detection in point cloud. arXiv preprint arXiv:1611.08069 [cs.CV] (2016)

  15. Li, B., Zhang, T., Xia, T.: Vehicle detection from 3D lidar using fully convolutional network. arXiv preprint arXiv:1608.07916 [cs.CV] (2016)

  16. Li, Y., Huang, C., Nevatia, R.: Learning to associate: hybrid boosted multi-target tracker for crowded scene. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 2953–2960. IEEE (2009)

    Google Scholar 

  17. Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440. IEEE (2015)

    Google Scholar 

  18. Mertz, C., Navarro-Serment, L.E., MacLachlan, R., Rybski, P., Steinfeld, A., Suppe, A., Urmson, C., Vandapel, N., Hebert, M., Thorpe, C., et al.: Moving object detection with laser scanners. J. Field Robot. 30(1), 17–43 (2013)

    Article  Google Scholar 

  19. Papon, J., Abramov, A., Schoeler, M., Worgotter, F.: Voxel cloud connectivity segmentation-supervoxels for point clouds. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition, pp. 2027–2034. IEEE (2013)

    Google Scholar 

  20. Petrovskaya, A., Thrun, S.: Model based vehicle detection and tracking for autonomous urban driving. Autonom. Robots 26(2–3), 123–139 (2009)

    Article  Google Scholar 

  21. Rekleitis, I., Bedwani, J.L., Dupuis, E.: Autonomous planetary exploration using lidar data. In: IEEE 2009 International Conference on Robotics and Automation, pp. 3025–3030. IEEE (2009)

    Google Scholar 

  22. Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Advances in Neural Information Processing Systems 28, pp. 91–99. NIPS Foundation (2015)

    Google Scholar 

  23. Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., LeCun, Y.: Overfeat: integrated recognition, localization and detection using convolutional networks. arXiv preprint arXiv:1312.6229 [cs.CV] (2013)

  24. Teichman, A., Levinson, J., Thrun, S.: Towards 3D object recognition via classification of arbitrary object tracks. In: 2011 IEEE International Conference on Robotics and Automation, pp. 4034–4041. IEEE (2011)

    Google Scholar 

  25. Triebel, R., Shin, J., Siegwart, R.: Segmentation and unsupervised part-based discovery of repetitive objects. In: Robotics: Science and Systems VI, pp. 1–8. RSS Foundation (2010)

    Google Scholar 

  26. Vaquero, V., del Pino, I., Moreno-Noguer, F., Solà, J., Sanfeliu, A., Andrade-Cetto, J.: Deconvolutional networks for point-cloud vehicle detection and tracking in driving scenarios. In: 2017 European Conference on Mobile Robotics. IEEE (2017)

    Google Scholar 

  27. Vaquero, V., Repiso, E., Sanfeliu, A., Vissers, J., Kwakkernaat, M.: Low cost, robust and real time system for detecting and tracking moving objects to automate cargo handling in port terminals. In: Robot 2015: 2nd Iberian Robotics Conference, pp. 491–502. Springer (2016)

    Google Scholar 

  28. Wan, L., Raksincharoensak, P., Maeda, K., Nagai, M.: Lane change behavior modeling for autonomous vehicles based on surroundings recognition. Int. J. Automot. Eng. 2(2), 7–12 (2011)

    Google Scholar 

  29. Wang, D.Z., Posner, I.: Voting for voting in online point cloud object detection. In: Robotics: Science and Systems XI, pp. 1–8. RSS Foundation (2015)

    Google Scholar 

  30. Wang, D.Z., Posner, I., Newman, P.: What could move? finding cars, pedestrians and bicyclists in 3D laser data. In: 2012 IEEE International Conference on Robotics and Automation, pp. 4038–4044. IEEE (2012)

    Google Scholar 

  31. Wang, Z., Kulik, L., Ramamohanarao, K.: Proactive traffic merging strategies for sensor-enabled cars. In: 4th ACM International Workshop on Vehicular Ad Hoc Networks, pp. 39–48. ACM (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Iván del Pino .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

del Pino, I. et al. (2018). Low Resolution Lidar-Based Multi-Object Tracking for Driving Applications. In: Ollero, A., Sanfeliu, A., Montano, L., Lau, N., Cardeira, C. (eds) ROBOT 2017: Third Iberian Robotics Conference. ROBOT 2017. Advances in Intelligent Systems and Computing, vol 693. Springer, Cham. https://doi.org/10.1007/978-3-319-70833-1_24

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-70833-1_24

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-70832-4

  • Online ISBN: 978-3-319-70833-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics