AsaPy: A Python Library for Aerospace Simulation Analysis
Authors: 
Joao P. A. Dantas, Samara R. Silva, Vitor C. F. Gomes, Andre N. Costa, Adrisson R. Samersla, Diego Geraldo, Marcos R. O. A. Maximo, and Takashi YoneyamaAuthors Info & Claims
Joao P. A. Dantas, Samara R. Silva, Vitor C. F. Gomes, Andre N. Costa, Adrisson R. Samersla, Diego Geraldo, Marcos R. O. A. Maximo, and Takashi YoneyamaAuthors Info & ClaimsJune 2024
Pages 15 - 24
Abstract
AsaPy is a custom-made Python library designed to simplify and optimize the analysis of aerospace simulation data. Instead of introducing new methodologies, it excels in combining various established techniques, creating a unified, specialized platform. It offers a range of features, including the design of experiment methods, statistical analysis techniques, machine learning algorithms, and data visualization tools. AsaPy’s flexibility and customizability make it a viable solution for engineers and researchers who need to quickly gain insights into aerospace simulations. AsaPy is built on top of popular scientific computing libraries, ensuring high performance and scalability. In this work, we provide an overview of the key features and capabilities of AsaPy, followed by an exposition of its architecture and demonstrations of its effectiveness through some use cases applied in military operational simulations. We also evaluate how other simulation tools deal with data science, highlighting AsaPy’s strengths and advantages. Finally, we discuss potential use cases and applications of AsaPy and outline future directions for the development and improvement of the library.
References
[1]
Mart’ın Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, 2016. TensorFlow: A system for large-scale machine learning. In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16). 265–283.
[2]
Nacer Abdellaoui, Adrian Taylor, and Glen Parkinson. 2009. Comparative analysis of computer generated forces’ artificial intelligence. Technical Report. Defence Research and Development Canada Ottawa (Ontario).
[3]
Davide Anghinolfi, Alberto Capogrosso, Massimo Paolucci, and Francesco Perra. 2013. An agent-based simulator for the evaluation of the measurement of effectiveness in the military naval tasks. In 2013 17th International Conference on System Theory, Control and Computing (ICSTCC). IEEE, 733–738.
[4]
Sylvain Arlot and Alain Celisse. 2010. A survey of cross-validation procedures for model selection. Statistics Surveys 4 (2010), 40–79.
[5]
James Bergstra, R’emi Bardenet, Yoshua Bengio, and Bal’azs K’egl. 2011. Algorithms for hyper-parameter optimization. In Advances in Neural Information Processing Systems. 2546–2554.
[6]
George EP Box, William G Hunter, and JS Hunter. 2005. Statistics for experimenters: design, innovation, and discovery. Wiley-Interscience.
[7]
Nitesh V Chawla, Kevin W Bowyer, Lawrence O Hall, and W Philip Kegelmeyer. 2002. SMOTE: synthetic minority over-sampling technique. Journal of artificial intelligence research 16 (2002), 321–357.
[8]
T. M. Cioppa and T. W. Lucas. 2007. Efficient Nearly Orthogonal and Space-Filling Latin Hypercubes. Technometrics 49, 1 (2007), 45–55. https://doi.org/10.1198/004017006000000453
[9]
Peter D Clive, Jeffrey A Johnson, Michael J Moss, James M Zeh, Brian M Birkmire, and Douglas D Hodson. 2015. Advanced framework for simulation, integration and modeling (AFSIM)(Case Number: 88ABW-2015-2258). In Proceedings of the International Conference on Scientific Computing (CSC). The Steering Committee of The World Congress in Computer Science, Computer Engineering and Applied Computing (WorldComp), 73.
[10]
Andre N. Costa, Felipe L. L. Medeiros, Joao P. A. Dantas, Diego Geraldo, and Nei Y. Soma. 2022. Formation Control Method Based on Artificial Potential Fields for Aircraft Flight Simulation. SIMULATION 98, 7 (2022), 575–595. https://doi.org/10.1177/00375497211063380 arXiv:https://doi.org/10.1177/00375497211063380
[11]
Joao P. A. Dantas. 2018. Apoio à Decisão para o Combate Aéreo Além do Alcance Visual: Uma Abordagem por Redes Neurais Artificiais. Master’s Thesis. Instituto Tecnológico de Aeronáutica, São José dos Campos, SP, Brazil.
[12]
Joao P. A. Dantas, Andre N. Costa, Diego Geraldo, Marcos R. O. A. Maximo, and Takashi Yoneyama. 2021. Engagement Decision Support for Beyond Visual Range Air Combat. In Proceedings of the 2021 Latin American Robotics Symposium, 2021 Brazilian Symposium on Robotics, and 2021 Workshop on Robotics in Education. October 11th–15th, 96–101.
[13]
Joao P. A. Dantas, Andre N. Costa, Diego Geraldo, Marcos R. O. A. Maximo, and Takashi Yoneyama. 2021. Weapon Engagement Zone Maximum Launch Range Estimation Using a Deep Neural Network. In Intelligent Systems, André Britto and Karina Valdivia Delgado (Eds.). Springer, Cham, 193–207.
[14]
Joao P. A. Dantas, Andre N. Costa, Vitor C. F. Gomes, Andre R. Kuroswiski, Felipe L. L. Medeiros, and Diego Geraldo. 2022. ASA: A Simulation Environment for Evaluating Military Operational Scenarios. arxiv:2207.12084 [cs.DC]
[15]
Joao P. A. Dantas, Andre N. Costa, Felipe L. L. Medeiros, Diego Geraldo, Marcos R. O. A. Maximo, and Takashi Yoneyama. 2022. Supervised Machine Learning for Effective Missile Launch Based on Beyond Visual Range Air Combat Simulations. In Proceedings of the Winter Simulation Conference (Singapore) (WSC ’22).
[16]
Joao P. A. Dantas, Diego Geraldo, Andre N. Costa, Marcos Ricardo Omena Albuquerque Máximo, and Takashi Yoneyama. 2023. ASA-SimaaS: Advancing Digital Transformation through Simulation Services in the Brazilian Air Force. In Simpósio de Aplicações Operacionais em Áreas de Defesa (SIGE2023) (2023-09-26). 6. https://www.sige.ita.br/edicoes-anteriores/2023/st/235455_1.pdf
[17]
Joao P. A. Dantas, Diego Geraldo, Felipe L. L. Medeiros, Marcos R. O. A. Maximo, and Takashi Yoneyama. 2023. Real-Time Surface-to-Air Missile Engagement Zone Prediction Using Simulation and Machine Learning. In Interservice/Industry Training, Simulation and Education Conference (I/ITSEC). Orlando, FL, USA.
[18]
Joao P. A. Dantas, Marcos R. O. A. Maximo, Andre N. Costa, Diego Geraldo, and Takashi Yoneyama. 2022. Machine Learning to Improve Situational Awareness in Beyond Visual Range Air Combat. IEEE Latin America Transactions 20, 8 (2022). https://latamt.ieeer9.org/index.php/transactions/article/view/6530
[19]
Joao P. A. Dantas, Marcos R. O. A. Maximo, and Takashi Yoneyama. 2023. Autonomous Agent for Beyond Visual Range Air Combat: A Deep Reinforcement Learning Approach. In Proceedings of the 2023 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation (Orlando, FL, USA) (SIGSIM-PADS ’23). Association for Computing Machinery, Orlando, FL, USA. https://doi.org/10.1145/3573900.3593631
[20]
Paul K Davis and Amy E Henninger. 2007. Analysis, analysis practices, and implications for modeling and simulation. Vol. 176. Rand Corporation.
[21]
Kalyanmoy Deb, Samir Agrawal, Amrit Pratab, and T Meyarivan. 2002. A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE transactions on evolutionary computation 6, 2 (2002), 182–197.
[22]
Diginext. 2023. DirectCGF. https://www.directcgf.com/. Last accessed 15 April 2023.
[23]
Jan Drozd, Luděk Rak, Pavel Zahradníček, Petr Stodola, and Jan Hodickỳ. 2023. Effectiveness evaluation of aerial reconnaissance in battalion force protection operation using the constructive simulation. The Journal of Defense Modeling and Simulation 20, 2 (2023), 181–196.
[24]
eSim Games. 2023. Steel Beasts Pro. https://www.esimgames.com/. Last accessed 15 April 2023.
[25]
Per-Idar Evensen. 2017. Modelling and implementation of a generic active protection system for entities in Virtual Battlespace (VBS). (2017).
[26]
Niclas Feldkamp, Soeren Bergmann, and Steffen Strassburger. 2020. Knowledge discovery in simulation data. ACM Transactions on Modeling and Computer Simulation (TOMACS) 30, 4 (2020), 1–25.
[27]
VK Gupta and Amar Nath Gupta. 2018. Theory and applications of stochastic processes: An analytical approach. John Wiley & Sons.
[28]
Charles R. Harris, K. Jarrod Millman, Stéfan J. van der Walt, Ralf Gommers, Pauli Virtanen, David Cournapeau, Eric Wieser, Julian Taylor, Sebastian Berg, Nathaniel J. Smith, Robert Kern, Matti Picus, Stephan Hoyer, Marten H. van Kerkwijk, Matthew Brett, Allan Haldane, Jaime Fernández del Río, Mark Wiebe, Pearu Peterson, Pierre Gérard-Marchant, Kevin Sheppard, Tyler Reddy, Warren Weckesser, Hameer Abbasi, Christoph Gohlke, and Travis E. Oliphant. 2020. Array programming with NumPy. Nature 585, 7825 (Sept. 2020), 357–362. https://doi.org/10.1038/s41586-020-2649-2
[29]
Gary Horne and Stephan Seichter. 2014. Data Farming in support of NATO operations-methodology and proof-of-concept. In Proceedings of the Winter Simulation Conference 2014. IEEE, 2355–2363.
[30]
Bohemia Interactive. 2023. VBS4. https://vbs4.com/. Last accessed 15 April 2023.
[31]
Ian T Jolliffe and Jorge Cadima. 2016. Principal component analysis. John Wiley & Sons.
[32]
JPC Kleijnen 2005. A user’s guide to the brave new world of designing simulation experiments: state-of-the-art review. forms: J. Comput (2005), 263–289.
[33]
John K Kruschke. 2013. Doing Bayesian data analysis: A tutorial with R, JAGS, and Stan. Academic Press.
[34]
Max Kuhn, Kjell Johnson, 2013. Applied predictive modeling. Vol. 26. Springer.
[35]
Thomas W Lucas, W David Kelton, Paul J Sánchez, Susan M Sanchez, and Ben L Anderson. 2015. Changing the paradigm: Simulation, now a method of first resort. Naval Research Logistics (NRL) 62, 4 (2015), 293–303.
[36]
Masa. 2023. Masa Sword. https://www.masasim.com/en/sword. Last accessed 15 April 2023.
[37]
David M McKeown, Evan J Klauda, Jeff J Lio, and S Siddharth. 2012. Correlated Terrain for Serious Games: Achieving Interoperability Across Diverse Runtime Environments. IMAGE (2012).
[38]
Douglas C Montgomery. 2017. Design and analysis of experiments. John wiley & sons.
[39]
Alisan Oeztuerk. 2016. Grundsatzbetrachtung der FLAMES Runtime Suite (Basic Consideration of the FLAMES Runtime Suite). Technical Report. UNIBW.
[40]
Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, 2011. Scikit-learn: Machine learning in Python. Journal of machine learning research 12, Oct (2011), 2825–2830.
[41]
Presagis. 2023. STAGE. https://www.presagis.com/en/product/stage/. Last accessed 15 April 2023.
[42]
J Mark Pullen, Mohammad Ababneh, Lisa Nicklas, Michael Connor, and Alexandre Barreto. 2012. An Open Source MSDL/C-BML Interface to VR-Forces. How is M&S Interoperability Different from Other Interoperability Domains? (2012), 28.
[43]
Peter J Rousseeuw and K Van Driessen. 2019. Detecting outliers: theory and applications. John Wiley & Sons.
[44]
John R Taylor. 2017. An introduction to error analysis: The study of uncertainties in physical measurements. University Science Books.
[45]
MAK Technologies. 2023. VR-Forces. https://www.mak.com/mak-one/apps/vr-forces/. Last accessed 15 April 2023.
[46]
Ternion. 2023. FLAMES Development Suite. https://flamesframework.com/. Last accessed 15 April 2023.
[47]
Armon Toubman, JJM Roessingh, G Poppinga, Ming Hou, Linus Luotsinen, Rikke Amilde Løvlid, Christophe Meyer, RJ Rijken, and M Turcanik. 2015. Modeling CGF behavior with machine learning techniques. (2015).
[48]
North Atlantic Treaty. 2021. Modelling and Simulation Group 145: Operationalization of Standardized C2-Simulation Interoperability. (2021).
[49]
John W Tukey. 1977. Exploratory Data Analysis. Addison-Wesley.
[50]
Pauli Virtanen, Ralf Gommers, Travis E. Oliphant, Matt Haberland, Tyler Reddy, David Cournapeau, Evgeni Burovski, Pearu Peterson, Warren Weckesser, Jonathan Bright, Stéfan J. van der Walt, Matthew Brett, Joshua Wilson, K. Jarrod Millman, Nikolay Mayorov, Andrew R. J. Nelson, Eric Jones, Robert Kern, Eric Larson, C J Carey, İlhan Polat, Yu Feng, Eric W. Moore, Jake VanderPlas, Denis Laxalde, Josef Perktold, Robert Cimrman, Ian Henriksen, E. A. Quintero, Charles R. Harris, Anne M. Archibald, Antônio H. Ribeiro, Fabian Pedregosa, Paul van Mulbregt, and SciPy 1.0 Contributors. 2020. SciPy 1.0: Fundamental Algorithms for Scientific Computing in Python. Nature Methods 17 (2020), 261–272. https://doi.org/10.1038/s41592-019-0686-2
Index Terms
- AsaPy: A Python Library for Aerospace Simulation Analysis
Comments
Information & Contributors
Information
Published In
June 2024
155 pages
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 24 June 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
SIGSIM-PADS '24
Sponsor:
SIGSIM-PADS '24: 38th ACM SIGSIM Conference on Principles of Advanced Discrete Simulation
June 24 - 26, 2024
GA, Atlanta, USA
Acceptance Rates
Overall Acceptance Rate 398 of 779 submissions, 51%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 21Total Downloads
- Downloads (Last 12 months)21
- Downloads (Last 6 weeks)21
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatGet Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in