Abstract
We consider the following search problem: an autonomous robot (the searcher) needs to locate and reach a target moving in a field scattered with Unattended Ground Sensors (UGS). The searcher has very limited information about the target: (i) it has an initial distribution (the prior) describing the probability of the target being at a given location at the initial time, and (ii) it can interrogate nearby sensors; each sensor records a binary measurement, describing whether or not the target passed in the proximity of the sensor at some point in time. Then the goal for the searcher is to estimate the trajectory of the target, and plan a maneuver that allows reducing the uncertainty about the current target state. We refer to this problem as aided optimal search, in that the search process is aided by an external infrastructure (the ground sensors). The paper adopts a Dynamic Data-Driven Appplications Systems (DDDAS) paradigm, in which the data collected by the searcher is used to update the belief on the trajectory of the target, and the searcher actively steers the measurement process to improve its knowledge about the location of the target. In particular, we make two main contributions. The first regards the target trajectory estimation. We show how to perform optimal Bayesian inference from binary measurements using a Gaussian Mixture Model (GMM). One of the main insights is that parameterizing the GMM in the information filter (inverse covariance) form allows huge computational savings: the information matrix of each mixture component is a very sparse (block-tridiagonal) matrix, which allows us to deal with a GMM with thousands of components in a fraction of a second. The second contribution regards planning: we propose a Mixed-Integer Programming (MIP) approach to plan the optimal searcher path, which minimizes the uncertainty about the position of the target. The key idea here is the use of sampling to decouple the complexity of the MIP from the length of the trajectory of the target. We demonstrate the proposed strategy in extensive simulations, reporting statistics about success rate and computational time for different scenarios and target motion models. The proposed search strategy largely outperforms greedy strategies (e.g., visiting the most likely target position).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
In practice, the most challenging part of the problem is indeed the initial phase of the search in which the uncertainty about the target is large and most of the interrogated sensors are far from the actual trajectory of the target.
- 2.
When b iτ = 1, the weight update is \(v^{(k)}_{\tau +1} = v^{(k)}_{\tau } + \log p^{(k)}_{i\tau } \leq v^{(k)}_{\tau }\) (recall: \(p^{(k)}_{i\tau } \leq 1\) hence \(\log p^{(k)}_{i\tau }\) is negative), leading to a smaller objective.
- 3.
Think about the extreme case in which the target and the searcher have the same speed: then if the target moves in the opposite direction with respect to the searcher position, no search strategy can make the searcher reach the target before it escapes the region \(\mathcal {R}\).
References
M. Adler, H. Räcke, N. Sivadasan, C. Sohler, B. Vöcking, Randomized pursuit-evasion in graphs. Comb. Probab. Comput. 12(3), 225–244, (2003)
N. Ahmed, D. Casbeer, Y. Cao, D. Kingston, Bayesian hidden markov models for UAV-enabled target localization on road networks with soft-hard data. in SPIE Defense and Security Symposium, 2015
M. Aigner, M. Fromme, A game of cops and robbers. Discret. Appl. Math. 8(1), 1–12 (1984)
G. Allen, Building a dynamic data driven application system for hurricane forecasting, in Computational Science – ICCS 2007 (Springer, Berlin/Heidelberg, 2007), pp. 1034–1041
L. Alonso, A.S. Goldstein, E.M. Reingold, Lion and man: upper and lower bounds. INFORMS J. Comput. 4(4), 447–452 (1992)
D. Alspach, H. Sorenson, Nonlinear bayesian estimation using gaussian sum approximations. IEEE Trans. Autom. Control 17(4), 439–448 (1972)
D. Assaf, S. Zamir, Optimal sequential search: a bayesian approach. Ann. Stat. 13(3), 1213–1221 (1985)
H. Bai, H. David, W.S. Lee, Integrated perception and planning in the continuous space: a POMDP approach, in Robotics: Science and Systems (RSS), 2013
T. Basar, G.J. Olsder, Dynamic Noncooperative Game Theory. Classics in Applied Mathematics, 2nd edn. (SIAM, Philadelphia, 1999)
E. Blasch, P. Maupin, A. Jousselme, Sensor-based allocation for path planning and area coverage using ugss, in IEEE National Aerospace and Electronics Conference (NAECON), 2010, pp. 361–368
E. Blasch, J. Dezert, P. Valin, DSmt applied to seismic and acoustic sensor fusion, in IEEE National Aerospace and Electronics Conference (NAECON), 2011, pp. 79–86
E.P. Blasch, K. Pham, D. Shen, Chen G, Orbital satellite pursuit-evasion game-theoretical control, in IEEE International Conference on Information Science, Signal Processing and Application (ISSPA), 2012
A. Blum, M.L. Furst, Approximation algorithms for orienteering and discounted-reward TSP, in Symposium on Foundations of Computer Science, 2003, pp. 46–55
S.D. Bopardikar, F. Bullo, J.P. Hespanha, Sensing limitations in the lion and man problem, in American Control Conference, 2007, pp. 5958–5963
F. Bourgault, T. Furukawa, H.F. Durrant-Whyte, Coordinated decentralized search for a lost target in a Bayesian world, in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2003, pp. 48–53
F. Bourgault, T. Furukawa, H.F. Durrant-Whyte, Optimal search for a lost target in a Bayesian world, in International Conference on Field and Service Robotics, Springer Tracts in Advanced Robotics (STAR), 2006, pp. 209–222
D. Casbeer, K Meier, Y Cao, Estimating the state of an intruder with a UAV and unattended ground sensors, in AIAA Infotech Aerospace Conference, 2013, pp. 4269–4275
D. Casbeer, K. Krishnamoorthy, P. Chandler, M. Pachter, Moving ground target isolation by a UAV using predicted observations, in IEEE Conference on Decision and Control, 2014, pp. 4284–4289
C. Chekuri, N. Korula, M. Pál, Improved algorithms for orienteering and related problems. ACM Trans. Algorithms 8(3), 1–27 (2012)
H. Chen, K. Krishnamoorthy, W. Zhang, D. Casbeer, Continuous-time intruder isolation using unattended ground sensors on graphs, in American Control Conference, 2014, pp. 5270–5275
H. Chen, K. Krishnamoorthy, W. Zhang, D. Casbeer, Intruder isolation on a general road network under partial information. IEEE Trans. Control Syst. Technol. 25(1), 222–234 (2017)
H.L. Choi, J.P. How, J.A. Hansen, Ensemble-based adaptive targeting of mobile sensor networks, in 2007 American Control Conference, 2007, pp. 2393–2398
H.L. Choi, J.P. How, Efficient targeting of sensor networks for large-scale systems. IEEE Trans. Control Syst. Technol. 19(6), 1569–1577 (2011)
C.-Y. Chong, S.P. Kumar, Sensor networks: evolution, opportunities, and challenges, in Proceedings of the IEEE, 2003, pp. 1247–1256
T. Chung, G. Hollinger, V. Isler, Search and pursuit-evasion in mobile robotics: a survey. Auton. Robot. 31(4), 299–316 (2011)
D. Crouse, P. Willett, K. Pattipati, L. Svensson, A look at gaussian mixture reduction algorithms, in 14th International Conference on Information Fusion, 2011, pp. 1–8
F. Darema, Dynamic data driven applications systems: a new paradigm for application simulations and measurements, in Computational Science – ICCS 2004: 4th International Conference, Krakow, Poland, 6–9 June 2004, Proceedings, Part III, eds. M. Bubak, G.D. van Albada, P.M.A. Sloot, J.J. Dongarra. Lecture Notes in Computer Science, vol. 3038 (Springer, Heidelberg, 2004), pp. 662–669
F. Darema, Grid computing and beyond: the context of dynamic data driven applications systems. Proc. IEEE 93(3), 692–697 (2005)
C.C. Douglas, M.J. Cole, P. Dostert, Y. Efendiev, R.E. Ewing, G. Haase, J. Hatcher, M. Iskandarani, C.R. Johnson, R.A. Lodder, Dynamically identifying and tracking contaminants in water bodies, in Computational Science – ICCS 2007: 7th International Conference, Beijing, 7th International Conference, 27–30 May 2007, Proceedings, Part I, eds. Y. Shi, G.D. van Albada, J.J. Dongarra, P.M.A. Sloot. Lecture Notes in Computer Science, vol. 4487 (Springer, Heidelberg, 2007), pp. 1002–1009
M.F. Duarte, Y.H. Hu, Vehicle classification in distributed sensor networks. J. Parallel Distrib. Comput. 64(7), 826–838 (2004)
J.N. Eagle, The optimal search for a moving target when the search path is constrained. Oper. Res. 32, 1105–1115 (1984)
J.N. Eagle, J.R. Yee, An optimal branch-and-bound procedure for the constrained path, moving target search problem. Oper. Res. 32(1), 110–114 (1990)
T. Erez, W.D. Smart, A scalable method for solving high-dimensional continuous POMDPs using local approximation, in Conference in Uncertainty in Artificial Intelligence (UAI), 2010
R. Fujimoto, A. Guin, M. Hunter, H. Park, R. Kannan, G. Kanitkar, M. Milholen, S. Neal, P. Pecher, A dynamic data driven application system for vehicle tracking. Proc. Comput. Sci. 29, 1203–1215 (2014)
L. Guibas, J. Latombe, S. LaValle, D. Lin, R. Motwani, Visibility-based pursuit-evasion in a polygonal environment. Int. J. Comput. Geom. Appl. 9(5), 471–494 (1999)
T. Hastie, R. Tibshirani, J.H. Friedman, The Elements of Statistical Learning (Springer, New York, 2001)
G. Hollinger, G. Sukhatme, Stochastic motion planning for robotic information gathering, in Robotics: Science and Systems (RSS), 2013
G. Hollinger, S. Singh, J. Djugash, A. Kehagias, Efficient multi-robot search for a moving target. Int. J. Robot. Res. 28(2), 201–219 (2009)
V. Indelman, L. Carlone, F. Dellaert, Planning in the continuous domain: a generalized belief space approach for autonomous navigation in unknown environments. Int. J. Robot. Res. 34(7), 849–882 (2015)
V. Isler, S. Kannan, S. Khanna, Randomized pursuit-evasion with local visibility. SIAM J. Discret. Math. 1(20), 26–41 (2006)
V. Isler, N. Karnad, The role of information in the cop-robber game. Theor. Comput. Sci. Spec. Issue Graph Search. 3(399), 179–190 (2008)
R. Ivanov, N. Atanasov, M. Pajic, G. Pappas, I. Lee, Robust estimation using context-aware filtering, in Allerton Conference on Communication, Control, and Computing, 2015
B. Jia, K.D. Pham, E. Blasch, D. Shen, Z. Wang, G. Chen, Cooperative space object tracking using space-based optical sensors via consensus-based filters. IEEE Trans. Aerosp. Electron. Syst. 52(3), 1908–1936 (2016)
S. Joshi, S. Boyd, Sensor selection via convex optimization. IEEE Trans. Signal Process. 57, 451–462 (2009)
J. Kadane, Optimal whereabouts search. Oper. Res. 19(4), 894–904 (1971)
L.P. Kaelbling, M.L. Littman, A.R. Cassandra, Planning and acting in partially observable stochastic domains. Artif. Intell. 101(1), 99–134 (1998)
S. Karaman, E. Frazzoli, Sampling-based algorithms for optimal motion planning. Int. J. Robot. Res. 30(7), 846–894 (2011)
B.O. Koopman, The theory of search. Part III: the optimum distribution of searching effort. Oper. Res. 5(5), 613–626 (1957)
K. Krishnamoorthy, D. Casbeer, P. Chandler, M. Pachter, S. Darbha, UAV search & capture of a moving ground target under delayed information, in IEEE Conference on Decision and Control, 2012, pp. 3092–3097
K. Krishnamoorthy, S. Darbha, P.P. Khargonekar, D. Casbeer, P. Chandler, M. Pachter, Optimal minimax pursuit evasion on a manhattan grid, in IEEE Conference on Decision and Control, 2013, pp. 3421–3428
K. Krishnamoorthy, D. Casbeer, P. Chandler, M. Pachter, Pursuit on a graph using partial information, in American Control Conference, 2015, pp. 4269–4275
H. Lau, S. Huang, G. Dissanayake, Optimal search for multiple targets in a built environment, in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2005, pp. 3740–3745
H. Lau, S. Huang, G. Dissanayake, Probabilistic search for a moving target in an indoor environment, in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2006, pp. 3393–3398
J.J. Lim, H. Pirsiavash, A. Torralba, Parsing IKEA objects: fine pose estimation, in International Conference on Computer Vision (ICCV), 2013, pp. 2992–2999
J. Mandel, L.S. Bennethum, J.L. Coen M. Chen, C.C. Douglas, L.P. Franca, Towards a dynamic data driven application system for wildfire simulation, in Computational Science – ICCS 2005 (Springer, Berlin/Heidelberg, 2005)
R. Niu, P.K. Varshney, Target location estimation in sensor networks with quantized data. IEEE Trans. Signal Process. 54(12), 4519–4528 (2006)
S.C.W. Ong, S.W. Png, D. Hsu, W.S. Lee, Planning under uncertainty for robotic tasks with mixed observability. Int. J. Robot. Res. 29(8), 1053–1068 (2010)
R. Platt Jr., R. Tedrake, L.P. Kaelbling, T. Lozano-Pérez, Belief space planning assuming maximum likelihood observations, in Robotics: Science and Systems (RSS), 2010, pp. 587–593
S. Rasmussen, D. Kingston, Development and flight test of an area monitoring system using unmanned aerial vehicles and unattended ground sensors, in International Conference on Unmanned Aircraft Systems (ICUAS), 2015
N. Roy, G. Gordon, S. Thrun, Finding approximate POMDP solutions through belief compression. J. Artif. Intell. Res. 23, 1–40 (2005)
A.R. Runnalls, Kullback-Leibler approach to gaussian mixture reduction. IEEE Trans. Aerosp. Electron. Syst. 43(3), 989–999 (2007)
H. Sato, J.O. Royset, Path optimization for the resource-constrained searcher. Nav. Res. Logist. 57(5), 422–440 (2010)
D. Shen, G. Chen, H. Ling, K.D. Pham, E. Blasch, Methods and devices for demonstrating three-player pursuit-evasion game. U.S. Patent application Publication 2016/0121204 A1, 5 May 2016
D. Silver, J. Veness, Monte-Carlo planning in large POMDPs, in Advances in Neural Information Processing Systems (NIPS), 2010, pp. 2164–2172
H.W. Sorenson, D.L. Alspach, Recursive bayesian estimation using gaussian sums. Automatica 7, 465–479 (1971)
C. Stachniss, G. Grisetti, W. Burgard, Recovering particle diversity in a Rao-Blackwellized particle filter for SLAM after actively closing loops, in IEEE International Conference on Robotics and Automation (ICRA), 2005, pp. 667–672
L.D. Stone. Theory of Optimal Search, 2nd edn. (Academic, San Diego, 1989)
S. Thrun, W. Burgard, D. Fox, Probabilistic Robotics (The MIT Press, Cambridge, 2005)
K.E. Trummel, J.R. Weisinger, The complexity of the optimal searcher path problem. Oper. Res. 34(2), 324–327 (1986)
J. Van Den Berg, S. Patil, R. Alterovitz, Motion planning under uncertainty using iterative local optimization in belief space. Int. J. Robot. Res. 31(11), 1263–1278 (2012)
P. Vansteenwegen, W. Souffriau, D.V. Oudheusden, The orienteering problem: a survey. Eur. J. Oper. Res. 209, 1–10 (2011)
A.R. Washburn, Search for a moving target: the FAB algorithm. Oper. Res. 31(4), 739–751 (1983)
J. Yu, J. Aslam, S. Karaman, D. Rus, Optimal tourist problem and anytime planning of trip itineraries. arXiv: 1409.8536 (2015)
B. Zhang, C. Zhang, Finite mixture models with negative components, in International Conference on Machine Learning and Data Mining in Pattern Recognition, 2005, pp. 31–41
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Prediction Equations
Prediction Equations
In this section we derive the equations for the prediction phase of our incremental smoother. We start with a lemma, which will be useful to simplify the derivation later on.
Lemma 1 (From measurement to state space)
Given a multivariate Gaussian \(\mathcal {N}(A x; \eta , \Omega )\) , with \(A \in { {\mathbb R}^{d \times d} } \) and full rank, then the multivariate Gaussian can be written equivalently as:
Proof. We prove the claim by inspection. We write explicitly the right-hand side of (14.52) as:
From the fact that A is square and full rank (hence invertible), the previous simplifies to:
which proves the claim. □
We can now focus on the derivation of the prediction equations. Let us start from the general prediction Eq. (14.14):
Substituting our choice of prior probability (14.15) and transition probability (14.7), we get:
Now we use the definition of S 1:t and S t:t+1, given in (14.18), which we substitute in (14.56):
We can develop each summand as follows:
Noting that the matrix \(\left [\begin {array}{c} S_{1:t} \\ S_{t:t+1} \end {array}\right ]\) is square and full rank, we apply Lemma 1 and simplify the previous expression as:
Substituting (14.59) back into (14.57), we obtain:
which coincides with Eqs. (14.16) and (14.17).
14.1.1 B Update Equations
In this section we derive the equations for the update phase of our incremental smoother. We start with a lemma, which will be useful to simplify the derivation later on.
Lemma 2 (Update in Information Form)
Given two multivariate Gaussians \(\mathcal {N}(x; \bar {\eta }, \bar {\Omega })\) and \(\mathcal {N}(A x; \eta _a, \Omega _a)\) , with \(x \in { {\mathbb R}^{d} } \) and \(A \in { {\mathbb R}^{d_a \times d} } \) (full row rank, d a ≤ d), then the following equality holds:
where κ is a constant independent on x.
Proof. We prove the claim by inspection. We write explicitly the left-hand side of (14.61) as:
A simple way to explicitly compute the constant κ is to observe that:
Hence κ is the result of a convolution of two Gaussian distributions, which can be computed as [68, page 209]
and this concludes the proof. □
Detection (b it = 1)
Let us start from the general update Eq. (14.19):
Let us focus on the term \({\mathbb P}\left (z_{t+1} | y_{1:t+1} \right ) {\mathbb P}\left (y_{1:t+1} | Z_{1:t}\right )\). First of all, we rewrite the measurement likelihood as:
which stresses the fact that the measurement likelihood can be seen as a “scaled” multivariate Gaussian, with γ being the normalization factor (the expression of this term is irrelevant for the subsequent derivation). Let us now substitute the prior probability (14.16) and the measurement likelihood (14.67) in (14.66):
which, using Lemma 2, becomes:
where η t+1,j and Ωt+1,j are defined as in (14.25). Observing that the integral of each Gaussian at the denominator of (14.68) is one, the previous simplifies to
which matches the expression of (14.25).
No detection (b it = 0)
In this case, the measurement likelihood is:
where γ = 2πr 2 (this is the inverse of the normalization factor of the Gaussian).
Let us now substitute the prior probability (14.16) and the measurement likelihood (14.70) in (14.66):
which coincides with (14.25).
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Carlone, L., Axelrod, A., Karaman, S., Chowdhary, G. (2018). Aided Optimal Search: Data-Driven Target Pursuit from On-Demand Delayed Binary Observations. In: Blasch, E., Ravela, S., Aved, A. (eds) Handbook of Dynamic Data Driven Applications Systems. Springer, Cham. https://doi.org/10.1007/978-3-319-95504-9_14
Download citation
DOI: https://doi.org/10.1007/978-3-319-95504-9_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-95503-2
Online ISBN: 978-3-319-95504-9
eBook Packages: Computer ScienceComputer Science (R0)