Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3341105.3373918acmconferencesArticle/Chapter ViewAbstractPublication PagessacConference Proceedingsconference-collections
research-article

IntPred: flexible, fast, and accurate object detection for autonomous driving systems

Published: 30 March 2020 Publication History

Abstract

Deep Neural-Network (DNN) based Object Detection is one of the most important and time-consuming stages of Autonomous Driving software in cars. In non-critical domains, the performance and energy requirements of object detection can be reduced at the cost of accuracy in the detected objects. This is not the case in a critical domain like automotive, for which a delicate balance between performance/energy overheads and accuracy of object detection must be found. We propose IntPred to achieve such a balance by leveraging on the fact that, with high frame rates, objects do not move significantly across frames. IntPred tailors object interpolation for the case of object detection in autonomous driving frameworks, in line with approaches devised for other domains, thus heavily reducing the performance requirements of full-fledged DNN-based object prediction. IntPred results in comparable accuracy to the original object detection, while saving more than 70% of the computations. The latter allows using lower-performance and cheaper platforms resulting in saving energy and reducing heat dissipation: for instance, in an NVIDIA Jetson TX2 platform, specific for autonomous driving systems, our technique increases the frame processing rate by 4.6x. IntPred also allows consolidating additional applications onto the same platform.

References

[1]
2016. Autoware. An open autonomous driving platform. https://github.com/CPFL/Autoware/.
[2]
2017. Mobileye, Mobileye C2-270 Essentials.
[3]
2017. NVIDIA GeForce GTX 1080 Ti. https://www.nvidia.com/en-us/geforce/products/10series/geforce-gtx-1080-ti/.
[4]
2017. NVIDIA Jetson TX2. https://www.nvidia.com/en-us/autonomous-machines/embedded-systems-dev-kits-modules/.
[5]
2018. Apollo, an open autonomous driving platform. http://apollo.auto/.
[6]
2018. Apollo Hardware Configurations. http://apollo.auto/platform/hardware.html.
[7]
2018. NVIDIA drive platforms. https://www.nvidia.com/en-us/self-driving-cars/drive-platform/.
[8]
Sergi Alcaide, Leonidas Kosmidis, Hamid Tabani, Carles Hernandez, Jaume Abella, and Francisco J Cazorla. 2018. Safety-Related Challenges and Opportunities for GPUs in the Automotive Domain. IEEE Micro 38, 6 (2018), 46--55.
[9]
ARM. 2015. ARM Expects Vehicle Compute Performance to Increase 100x in Next Decade. https://www.arm.com/about/newsroom/arm-expects-vehicle-compute-performance-to-increase-100x-in-next-decade.php.
[10]
Chenyi Chen, Ari Seff, Alain Kornhauser, and Jianxiong Xiao. 2015. Deepdriving: Learning affordance for direct perception in autonomous driving. In Proceedings of the IEEE International Conference on Computer Vision. 2722--2730.
[11]
Mike Demler. June 2017. Xavier Simplifies Self-Driving Cars. In Microprocessors Report, The Linly Group.
[12]
J. Huang et al. 2017. Speed/accuracy trade-offs for modern convolutional object detectors. In CVPR.
[13]
Brody Huval, Tao Wang, Sameep Tandon, Jeff Kiske, Will Song, Joel Pazhayampallil, Mykhaylo Andriluka, Pranav Rajpurkar, Toki Migimatsu, Royce Cheng-Yue, et al. 2015. An empirical evaluation of deep learning on highway driving. arXiv preprint arXiv:1504.01716 (2015).
[14]
R. Jain et al. 2011. Interpolation Based Tracking for Fast Object Detection in Videos. In CVPR.
[15]
Shih-Chieh Lin et al. 2018. The Architectural Implications of Autonomous Driving: Constraints and Acceleration. In ASPLOS.
[16]
Fabio Mazzocchetti, Pedro Benedicte, Hamid Tabani, Leonidas Kosmidis, Jaume Abella, and Francisco J Cazorla. 2019. Performance Analysis and Optimization of Automotive GPUs. In Proceedings of the 31st International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD) 2019. IEEE.
[17]
Massachusetts Institute of Technology-MIT. [n. d.]. Annotated Driving Dataset. https://github.com/udacity/self-driving-car/tree/master/annotations.
[18]
Roger Pujol, Hamid Tabani, Leonidas Kosmidis, Enrico Mezzetti, Jaume Abella, and Francisco J Cazorla. 2019. Generating and Exploiting Deep Learning Variants to Increase Heterogeneous Resource Utilization in the NVIDIA Xavier. In 31st Euromicro Conference on Real-Time Systems (ECRTS 2019). Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik.
[19]
A. Lewis R. Haslehurst. 2019. Mapping the Road to Autonomous Vehicles. In Insights Work, Vol. XIX.
[20]
Joseph Redmon and Ali Farhadi. 2017. YOLO9000: better, faster, stronger. arXiv preprint (2017).
[21]
Joseph Redmon and Ali Farhadi. 2018. Yolov3: An incremental improvement. arXiv preprint arXiv:1804.02767 (2018).
[22]
J. Redmon et al. 2016. You only look once: Unified, real-time object detection. In CVPR.
[23]
M. Shafiee et al. 2017. Fast YOLO: A Fast You Only Look Once System for Real-time Embedded Object Detection in Video. arXiv preprint arXiv:1709.05943 (2017).
[24]
Hamid Tabani, Leonidas Kosmidis, Jaume Abella, Francisco J Cazorla, and Guillem Bernat. 2019. Assessing the Adherence of an Industrial Autonomous Driving Framework to ISO 26262 Software Guidelines. In Proceedings of the 56th Annual Design Automation Conference 2019. ACM, 9.
[25]
TESLA. [n. d.]. Full Self-Driving Hardware on All Cars. https://www.tesla.com/autopilot.
[26]
T. Ujiie et al. 2018. Interpolation-Based Object Detection Using Motion Vectors for Embedded Real-time Tracking Systems. In CVPR Workshops.
[27]
X. Zhu et al. 2017. Deep feature flow for video recognition. In CVPR.
[28]
X. Zhu et al. 2017. Flow-guided feature aggregation for video object detection. In CVPR.
[29]
X. Zhu et al. 2018. Towards High Performance Video Object Detection. In CVPR.

Cited By

View all
  • (2023)A Survey on Approximate Edge AI for Energy Efficient Autonomous Driving ServicesIEEE Communications Surveys & Tutorials10.1109/COMST.2023.330247425:4(2714-2754)Online publication date: Dec-2024

Index Terms

  1. IntPred: flexible, fast, and accurate object detection for autonomous driving systems

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      SAC '20: Proceedings of the 35th Annual ACM Symposium on Applied Computing
      March 2020
      2348 pages
      ISBN:9781450368667
      DOI:10.1145/3341105
      © 2020 Association for Computing Machinery. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 30 March 2020

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. autonomous driving systems
      2. object detection
      3. safety-critical systems

      Qualifiers

      • Research-article

      Funding Sources

      • Juan de la Cierva-Formación postdoctoral fellowship
      • SuPerCom European Research Council (ERC) project under the European Union?s Horizon 2020 research and innovation programme
      • HiPEAC Network of Excellence
      • Juan de la-Cierva-Incorporacion postdoctoral fellowship
      • Spanish Ministry of Economy and Competitiveness (MINECO)
      • Ramon y Cajal postdoctoral fellowship

      Conference

      SAC '20
      Sponsor:
      SAC '20: The 35th ACM/SIGAPP Symposium on Applied Computing
      March 30 - April 3, 2020
      Brno, Czech Republic

      Acceptance Rates

      Overall Acceptance Rate 1,650 of 6,669 submissions, 25%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)10
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 09 Nov 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2023)A Survey on Approximate Edge AI for Energy Efficient Autonomous Driving ServicesIEEE Communications Surveys & Tutorials10.1109/COMST.2023.330247425:4(2714-2754)Online publication date: Dec-2024

      View Options

      Get Access

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media