Drone-Based Bug Detection in Orchards with Nets: A Novel Orienteering Approach
Authors: 
Francesco Betti Sorbelli, Federico Coró, Sajal K. Das, Lorenzo Palazzetti, Cristina M. PinottiAuthors Info & Claims
Francesco Betti Sorbelli, Federico Coró, Sajal K. Das, Lorenzo Palazzetti, Cristina M. PinottiAuthors Info & ClaimsArticle No.: 68, Pages 1 - 28
Abstract
The use of drones for collecting information and detecting bugs in orchards covered by nets is a challenging problem. The nets help in reducing pest damage, but they also constrain the drone’s flight path, making it longer and more complex. To address this issue, we model the orchard as an aisle-graph, a regular data structure that represents consecutive aisles where trees are arranged in straight lines. The drone flies close to the trees and takes pictures at specific positions for monitoring the presence of bugs, but its energy is limited, so it can only visit a subset of positions. To tackle this challenge, we introduce the Single-drone Orienteering Aisle-graph Problem (SOAP), a variant of the orienteering problem, where likely infested locations are prioritized by assigning them a larger profit. Additionally, the drone’s movements have a cost in terms of energy, and the objective is to plan a drone’s route in the most profitable locations under a given drone’s battery. We show that SOAP can be optimally solved in polynomial time, but for larger orchards/instances, we propose faster approximation and heuristic algorithms. Finally, we evaluate the algorithms on synthetic and real datasets to demonstrate their effectiveness and efficiency.
References
[1]
S. Ahirwar, R. Swarnkar, S. Bhukya, and G. Namwade. 2019. Application of drone in agriculture. International Journal of Current Microbiology and Applied Sciences 8, 1 (2019), 2500–2505.
[2]
Boaz Arad, Jos Balendonck, Ruud Barth, Ohad Ben-Shahar, Yael Edan, Thomas Hellström, Jochen Hemming, Polina Kurtser, Ola Ringdahl, Toon Tielen, and Bart van Tuijl. 2020. Development of a sweet pepper harvesting robot. Journal of Field Robotics 37, 6 (2020), 1027–1039.
[3]
Kaveh Azadeh, Debjit Roy, and René De Koster. 2019. Design, modeling, and analysis of vertical robotic storage and retrieval systems. Transportation Science 53, 5 (2019), 1213–1234.
[4]
Rabeya Basri, Fahmida Islam, Sumaita Binte Shorif, and Mohammad Shorif Uddin. 2021. Robots and drones in agriculture-a survey. In Computer Vision and Machine Learning in Agriculture. Springer, Singapore, 9–29.
[5]
James Christopher Bergh, William R. Morrison III, Jon W. Stallrich, Brent D. Short, John P. Cullum, and Tracy C. Leskey. 2021. Border habitat effects on captures of Halyomorpha halys (hemiptera: Pentatomidae) in pheromone traps and fruit injury at harvest in apple and peach orchards in the mid-atlantic, USA. Insects 12, 5 (2021), 419.
[6]
Graeme Best and Geoffrey A. Hollinger. 2019. Decentralised self-organising maps for the online orienteering problem with neighbourhoods. In 2019 International Symposium on Multi-Robot and Multi-Agent Systems (MRS). IEEE, IEEE, New Brunswick, NJ, USA, 139–141.
[7]
Francesco Betti Sorbelli, Stefano Carpin, Federico Corò, Sajal K. Das, Alfredo Navarra, and Cristina M. Pinotti. 2022. Speeding up routing schedules on aisle graphs with single access. IEEE Transactions on Robotics 38, 1 (2022), 433–447. DOI:
[8]
Francesco Betti Sorbelli, Stefano Carpin, Federico Corò, Alfredo Navarra, and Cristina M. Pinotti. 2020. Optimal routing schedules for robots operating in aisle-structures. In 2020 IEEE International Conference on Robotics and Automation (ICRA). IEEE, Paris, 4927–4933. DOI:
[9]
Francesco Betti Sorbelli, Federico Corò, Sajal K Das, Alfredo Navarra, and Cristina M Pinotti. 2020. Speeding-up routing schedules on aisle-graphs. In 16th Intl. Conf. on Distributed Computing in Sensor Systems (DCOSS). IEEE, IEEE, Marina del Rey, 69–76.
[10]
Francesco Betti Sorbelli, Federico Corò, Sajal K. Das, Lorenzo Palazzetti, and Cristina M Pinotti. 2022. Drone-based optimal and heuristic orienteering algorithms towards bug detection in orchards. In 18th Intl. Conf. on Distributed Computing in Sensor Systems (DCOSS). IEEE, IEEE, Marina del Rey.
[11]
Francesco Betti Sorbelli, Federico Corò, Sajal K. Das, Emanuele Di Bella, Lara Maistrello, Lorenzo Palazzetti, and Cristina M. Pinotti. 2022. A drone-based application for scouting halyomorpha halys bugs in orchards with multifunctional nets. In 2022 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops). IEEE, Pisa, 127–129. DOI:
[12]
Avrim Blum, Shuchi Chawla, David R Karger, Terran Lane, Adam Meyerson, and Maria Minkoff. 2007. Approximation algorithms for orienteering and discounted-reward TSP. SIAM Journal on Comp. 37, 2 (2007), 653–670.
[13]
Stefano Carpin and Thomas C. Thayer. 2022. Solving stochastic orienteering problems with chance constraints using monte carlo tree search. In 2022 IEEE 18th International Conference on Automation Science and Engineering (CASE). IEEE, IEEE, Chengdu, 1170–1177.
[14]
Ke Chen and Sariel Har-Peled. 2006. The orienteering problem in the plane revisited. In Proceedings of the Twenty-Second Annual Symposium on Computational Geometry. ACM, Sedona, 247–254.
[15]
Surendra K. Dara. 2019. The new integrated pest management paradigm for the modern age. Journal of Integrated Pest Management 10, 1 (2019), 12.
[16]
Erdi Dasdemir, Rajan Batta, Murat Köksalan, and Diclehan Tezcaner Öztürk. 2022. UAV routing for reconnaissance mission: A multi-objective orienteering problem with time-dependent prizes and multiple connections. Computers & Operations Research 145, September 2022 (2022), 105882. DOI:
[17]
Sayantan Datta and Srinivas Akella. 2023. Prioritized robotic exploration with deadlines: A comparison of greedy, orienteering, and profitable tour approaches. In 2023 IEEE International Conference on Robotics and Automation (ICRA). IEEE, London, 5737–5743. DOI:
[18]
M. Erdelj, E. Natalizio, K. R. Chowdhury, and I. F. Akyildiz. 2017. Help from the sky: Leveraging UAVs for disaster management. IEEE Pervasive Computing 16, 1 (Jan2017), 24–32.
[19]
Mario Arturo Ruiz Estrada and Abrahim Ndoma. 2019. The uses of unmanned aerial vehicles UAVs- (or drones) in social logistic: Natural disasters response and humanitarian relief aid. Procedia Computer Science 149 (2019), 375–383. ICTE in Transportation and Logistics 2018 (ICTE 2018).
[20]
Tianshuang Gao, Yan Tian, and Sourabh Bhattacharya. 2021. Refuel scheduling for multirobot charging-on-demand. In 2021 IEEE/RSJ Intl. Conf. on Intelligent Robots and Systems (IROS). IEEE, IEEE, Prague, 5825–5830.
[21]
Sabbatini Peverieri Giuseppino, Bortolotti Pier Paolo, Nannini Roberta, Marianelli Leonardo, and Roversi Pio Federico. 2018. Efficacy of long lasting insecticide nets in killing Halyomorpha halys in pear orchards. Outlooks on Pest Management 29, 2 (2018), 70–74.
[22]
Bruce L Golden, Larry Levy, and Rakesh Vohra. 1987. The orienteering problem. Naval Research Logistics (NRL) 34, 3 (1987), 307–318.
[23]
Lee-Ad Gottlieb, Robert Krauthgamer, and Havana Rika. 2022. Faster algorithms for orienteering and k-TSP. Theoretical Computer Science 914 (2022), 73–83. DOI:
[24]
Aldy Gunawan, Hoong Chuin Lau, and Pieter Vansteenwegen. 2016. Orienteering problem: A survey of recent variants, solution approaches and applications. European Journal of Op. Res. 255, 2 (2016), 315–332.
[25]
HALY.ID. 2022. Project. Retrieved from https://www.haly-id.eu. (2022).
[26]
Geoffrey A. Hollinger and Gaurav S. Sukhatme. 2014. Sampling-based robotic information gathering algorithms. The International Journal of Robotics Research 33, 9 (2014), 1271–1287. DOI:
[27]
Fernando H. Iost Filho, Wieke B. Heldens, Zhaodan Kong, and Elvira S. de Lange. 2020. Drones: Innovative technology for use in precision pest management. Journal of Economic Entomology 113, 1 (2020), 1–25.
[28]
Stefan Jorgensen, Robert H. Chen, Mark B. Milam, and Marco Pavone. 2018. The team surviving orienteers problem: Routing teams of robots in uncertain environments with survival constraints. Autonomous Robots 42, 4 (2018), 927–952.
[29]
Xinyue Kan, Thomas C. Thayer, Stefano Carpin, and Konstantinos Karydis. 2021. Task planning on stochastic aisle graphs for precision agriculture. IEEE Robotics and Automation Letters 6, 2 (2021), 3287–3294.
[30]
Andreas Krause and Carlos Guestrin. 2005. A Note on the Budgeted Maximization of Submodular Functions. Carnegie Mellon University. Center for Automated Learning and Discovery,.
[31]
Douglas G. Macharet, Armando Alves Neto, and Daigo Shishika. 2021. Minimal exposure dubins orienteering problem. IEEE Robotics and Automation Letters 6, 2 (2021), 2280–2287. DOI:
[32]
Moshe Mann, Boaz Zion, Dror Rubinstein, Rafi Linker, and Itzhak Shmulevich. 2016. The orienteering problem with time windows applied to robotic melon harvesting. Journal of Optimization Theory and Applications 168, 1 (2016), 246–267.
[33]
UM Rao Mogili and BBVL Deepak. 2018. Review on application of drone systems in precision agriculture. Procedia Computer Science 133, 2018 (2018), 502–509.
[34]
Chase C. Murray and Amanda G. Chu. 2015. The flying sidekick traveling salesman problem: Optimization of drone-assisted parcel delivery. Transportation Research Part C: Emerging Technologies 54, May 2015 (2015), 86–109.
[35]
Chase C. Murray and Ritwik Raj. 2020. The multiple flying sidekicks traveling salesman problem: Parcel delivery with multiple drones. Transportation Research Part C: Emerging Technologies 110, January 2020 (2020), 368–398.
[36]
George L. Nemhauser, Laurence A. Wolsey, and Marshall L. Fisher. 1978. An analysis of approximations for maximizing submodular set functions-I. Mathematical Programming 14, 1 (1978), 265–294.
[37]
Robert Pěnička, Jan Faigl, Petr Váňa, and Martin Saska. 2017. Dubins orienteering problem. IEEE Robotics and Automation Letters 2, 2 (2017), 1210–1217. DOI:
[38]
Andre Rabello, Robison Cris Brito, Fabio Favarim, Alfredo Weitzenfeld, and Eduardo Todt. 2020. Mobile system for optimized planning to drone flight applied to the precision agriculture. In 2020 3rd Intl. Conf. on Information and Computer Technologies (ICICT). IEEE, IEEE, San Jose, 12–16.
[39]
Jibin Rajan, Sachin Shriwastav, Abhishek Kashyap, Ashwini Ratnoo, and Debasish Ghose. 2021. Chapter 6—disaster management using unmanned aerial vehicles. In Unmanned Aerial Systems. Anis Koubaa and Ahmad Taher Azar (Eds.). Academic Press, USA, 129–155.
[40]
Alka Rani, Amresh Chaudhary, N. Sinha, M. Mohanty, and R. Chaudhary. 2019. Drone: The green technology for future agriculture. Harit Dhara 2, 1 (2019), 3–6.
[41]
Mike Roberts, Debadeepta Dey, Anh Truong, Sudipta Sinha, Shital Shah, Ashish Kapoor, Pat Hanrahan, and Neel Joshi. 2017. Submodular trajectory optimization for aerial 3d scanning. In Proceedings of the IEEE Intl. Conf. on Computer Vision. IEEE, Venice, 5324–5333.
[42]
Ina Schlathölter, Anna Dalbosco, Michael Meissle, Andrea Knauf, Alex Dallemulle, Beat Keller, Jörg Romeis, Giovanni A Broggini, and Andrea Patocchi. 2021. Low outcrossing from an apple field trial protected with nets. Agronomy 11, 9 (2021), 1754.
[43]
Guangyao Shi, Lifeng Zhou, and Pratap Tokekar. 2023. Robust multiple-path orienteering problem: Securing against adversarial attacks. IEEE Transactions on Robotics 39, 3 (2023), 2060–2077. DOI:
[44]
Paula M Shrewsbury and Michael J Raupp. 2000. Evaluation of components of vegetational texture for predicting azalea lace bug, Stephanitis pyrioides (heteroptera: Tingidae), abundance in managed landscapes. Environmental Entomology 29, 5 (2000), 919–926.
[45]
G. K. Sujayanand, S. Sheelamary, and G. Prabhu. 2021. Recent innovations and approaches for insect pest management in agriculture. Biotica Research Today 3, 2 (2021), 100–102.
[46]
Dinesh Thakur, Maxim Likhachev, James Keller, Vladimir Dobrokhodov, Kevin Jones, Jeff Wurz, and Isaac Kaminer. 2013. Planning for opportunistic surveillance with multiple robots. In Proceedings of the IEEE/RSJ Intl. Conf. on Intelligent Robots and Systems.IEEE, Tokyo, 5750–5757.
[47]
Thomas C. Thayer and Stefano Carpin. 2021. An adaptive method for the stochastic orienteering problem. IEEE Robotics and Automation Letters 6, 2 (2021), 4185–4192.
[48]
Thomas C. Thayer, Stavros Vougioukas, Ken Goldberg, and Stefano Carpin. 2018. Multi-robot routing algorithms for robots operating in vineyards. In 2018 IEEE 14th Intl. Conf. on Automation Science and Engineering (CASE). IEEE, IEEE, Munich, 14–21.
[49]
Thomas C. Thayer, Stavros Vougioukas, Ken Goldberg, and Stefano Carpin. 2018. Routing algorithms for robot assisted precision irrigation. In Intl. Conf. on Robotics and Automation (ICRA). IEEE, IEEE, Brisbane, 2221–2228.
[50]
Richard Weinzierl and Tess Henn. 2020. Botanical insecticides and insecticidal soaps. In Handbook of Integrated Pest Management for Turf and Ornamentals. CRC Press, USA, 541–555.
[51]
Wenzheng Xu, Weifa Liang, Zichuan Xu, Jian Peng, Dezhong Peng, Tang Liu, Xiaohua Jia, and Sajal K. Das. 2021. Approximation algorithms for the generalized team orienteering problem and its applications. IEEE/ACM Transactions on Networking 29, 1 (2021), 176–189. DOI:
[52]
Wenzheng Xu, Zichuan Xu, Jian Peng, Weifa Liang, Tang Liu, Xiaohua Jia, and Sajal K. Das. 2020. Approximation algorithms for the team orienteering problem. In IEEE INFOCOM 2020 —IEEE Conference on Computer Communications. IEEE, Virtual, 1389–1398.
[53]
Yue Yang and Jianwen Zhu. 2016. Write skew and zipf distribution: Evidence and implications. ACM Transactions on Storage (TOS) 12, 4 (2016), 1–19.
[54]
Jingjin Yu, Mac Schwager, and Daniela Rus. 2016. Correlated orienteering problem and its application to persistent monitoring tasks. IEEE Transactions on Robotics 32, 5 (2016), 1106–1118.
Index Terms
- Drone-Based Bug Detection in Orchards with Nets: A Novel Orienteering Approach
Recommendations
Ethical issues with use of drone aircraft
ETHICS '14: Proceedings of the IEEE 2014 International Symposium on Ethics in Engineering, Science, and TechnologyThis analysis is aimed at identifying the ethical issues related to a variety of types of Drone aircraft as they are currently deployed in recreational, civilian/commercial and military arenas. A series of examples will be examined in order to attempt ...
Reference architecture specification for drone systems
Highlights- Reference architecture specification for future drone systems.
- Requirements/...
AbstractUnmanned Aerial Systems (UASs) are useful for performing missions ranging from simple to tedious/dangerous ones. In recent years, UAS architectures have been introduced by different groups with different viewpoints. However, these ...
Impact of Spatial Proximity on Drone Services
UbiComp '24: Companion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous ComputingWe demonstrate the peer-to-peer impact of drones flying in close proximity. Understanding these impacts is crucial for planning efficient drone delivery services. In this regard, we conducted a set of experiments using drones at varying positions in a 3D ...
Comments
Information & Contributors
Information
Published In
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Journal Family
Publication History
Published: 23 April 2024
Online AM: 22 March 2024
Accepted: 20 March 2024
Revised: 21 February 2024
Received: 28 September 2023
Published in TOSN Volume 20, Issue 3
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
- NSF SIRAC
- European Union’s Horizon 2020
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 173Total Downloads
- Downloads (Last 12 months)173
- Downloads (Last 6 weeks)23
Reflects downloads up to 31 Dec 2024
Other Metrics
Citations
Cited By
View allView Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in