Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

An ensemble model using temporal convolution and dual attention gated recurrent unit to analyze risk of civil aircraft

Published: 01 February 2024 Publication History
  • Get Citation Alerts
  • Highlights

    A DAGRU model is established by integrating two attention gates into the GRU.
    A novel ensemble method is proposed by integrating TCN with DAGRU.
    The proposed TCN-DAGRU learns lessons from ASRS report to analyze the risk level.
    The proposed TCN-DAGRU can solve data imbalance and improve prediction accuracy.

    Abstract

    As the most important issue in civil aviation, safety needs to be maintained on an acceptable risk level in the air transport system at all times. Due to the high safety requirements in civil aviation, effective emergency response to high-risk events is of great significance for safety insurance. Therefore, it is very necessary to judge the risk level immediately after receiving the unsafe event reports. Unsafe event reports collected in the Aviation Safety Report System (ASRS) contain highly unstructured short texts, which pose a challenge for rapid risk analysis. In this paper, a risk analysis model that integrates a temporal convolutional network (TCN) and a dual attention gated recurrent unit (DAGRU) neural network is proposed for predicting the risk of civil aircraft based on the ASRS report. On the one hand, the causal convolution and dilated convolution structures of TCN are utilized to obtain higher-level text sequence features. On the other hand, the gated recurrent unit (GRU) neural network with dual attention gates is used to learn the contextual information of ASRS report. The introduced attention mechanism of GRU pays much attention to the significant information during the prediction procedure. The ability of GRU to solve long-term dependency problems is greatly enhanced. Finally, in order to verify the validity and reliability of the proposed ensemble model, the proposed TCN-DAGRU is compared with seven benchmark models. The comparison results show that the proposed TCN-DAGRU ensemble model can achieve the highest prediction accuracy and provide reliable support for rapid prediction of aviation safety risk.

    References

    [1]
    Aksan, E., & Hilliges, O. (2019). STCN: Stochastic temporal convolutional networks. arXiv preprint arXiv:1902.06568.
    [2]
    Bai, S., Kolter, J. Z., & Koltun, V. (2018). An Empirical Evaluation Of Generic Convolutional And Recurrent Networks For Sequence Modeling. ArXiv.Org. https://arxiv.org/abs/1803.01271.
    [3]
    Chung, J., Gulcehre, C., Cho, K., & Bengio, Y. (2014). Empirical evaluation of gated recurrent neuronal networks on sequence modeling. Neuronal and Evolutionary Computing, 1412. arXiv preprint arXiv:1412.3555.
    [4]
    A. Encalada-Davila, L. Moyon, C. Tutiven, B. Puruncajas, Y. Vidal, Early Fault Detection in the Main Bearing of Wind Turbines Based on Gated Recurrent Unit (GRU) Neural Networks and SCADA Data, IEEE/ASME Transactions on Mechatronics 27 (6) (2022) 5583–5593,.
    [5]
    FAA. (1998). AC 25.1309-1A system design and analysis. Federal Aviation Administration. https://www.faa.gov/documentLibrary/media/Advisory_Circular/AC_25_1309-1A.pdf.
    [6]
    U. Gupta, V. Bhattacharjee, P.S. Bishnu, StockNet—GRU based stock index prediction, Expert Systems with Applications 207 (2022),.
    [7]
    S. Hochreiter, J. Schmidhuber, Long short-term memory, Neural Computation 8 (9) (1997) 1735–1780,.
    [8]
    ICAO. (2017). Safety management manual (SMM). International Civil Aviation Organization. https://www.aex.ru/imgupl/files/ICAO%20Doc%209859%20-%20SMM_Edition%204%20-%20Peer%20Review.pdf.
    [9]
    K.D. Kuhn, Using structural topic modeling to identify latent topics and trends in aviation incident reports, Transportation Research Part C: Emerging Technologies 87 (2018) 105–122,.
    [10]
    G. Li, H. Lee, A. Rai, A. Chattopadhyay, Analysis of operational and mechanical anomalies in scheduled commercial flights using a logarithmic multivariate Gaussian model, Transportation Research Part C: Emerging Technologies 110 (2020) 20–39,.
    [11]
    Y. Li, F.W. Guldenmund, Safety management systems: A broad overview of the literature, Safety Science 103 (2018) 94–123,.
    [12]
    Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013). Efficient Estimation of Word Representations in Vector Space. ArXiv Preprint ArXiv:1301.3781. 10.48550/arXiv.1301.3781 Focus to learn more.
    [13]
    A. Miyamoto, M.V. Bendarkar, D.N. Mavris, Natural Language Processing of Aviation Safety Reports to Identify Inefficient Operational Patterns, Aerospace 9 (8) (2022) 450,.
    [14]
    NASA. (2021). ASRS Coding Taxonomy. National Aeronautics and Space Administration. https://akama.arc.nasa.gov/ASRSDBOnline/CodingForm.pdf.
    [15]
    X. Olive, L. Basora, Detection and identification of significant events in historical aircraft trajectory data, Transportation Research Part C: Emerging Technologies 119 (2020),.
    [16]
    T.G. Puranik, N. Rodriguez, D.N. Mavris, Towards online prediction of safety-critical landing metrics in aviation using supervised machine learning, Transportation Research Part C: Emerging Technologies 120 (2020),.
    [17]
    J. Ren, W. Wu, G. Liu, Z. Chen, R. Wang, Bidirectional Gated Temporal Convolution with Attention for text classification, Neurocomputing 455 (2021) 265–273,.
    [18]
    S.D. Robinson, Temporal topic modeling applied to aviation safety reports: A subject matter expert review, Safety Science 116 (2019) 275–286,.
    [19]
    R.L. Rose, T.G. Puranik, D.N. Mavris, Natural Language Processing Based Method for Clustering and Analysis of Aviation Safety Narratives, Aerospace 7 (10) (2020) 143,.
    [20]
    R.L. Rose, T.G. Puranik, D.N. Mavris, A.H. Rao, Application of structural topic modeling to aviation safety data, Reliability Engineering & System Safety 224 (2022),.
    [21]
    L. Tanguy, N. Tulechki, A. Urieli, E. Hermann, C. Raynal, Natural language processing for aviation safety reports: From classification to interactive analysis, Computers in Industry 78 (2016) 80–95,.
    [22]
    Y. Wang, Y. Pang, O. Chen, H.N. Iyer, P. Dutta, P.K. Menon, Y. Liu, Uncertainty quantification and reduction in aircraft trajectory prediction using Bayesian-Entropy information fusion, Reliability Engineering & System Safety 212 (2021),.
    [23]
    X. Zhang, S. Mahadevan, Ensemble machine learning models for aviation incident risk prediction, Decision Support Systems 116 (2019) 48–63,.
    [24]
    X. Zhang, S. Mahadevan, Bayesian network modeling of accident investigation reports for aviation safety assessment, Reliability Engineering & System Safety 209 (2021),.
    [25]
    Z. Zhang, Q. He, J. Gao, M. Ni, A deep learning approach for detecting traffic accidents from social media data, Transportation Research Part C: Emerging Technologies 86 (2018) 580–596,.

    Index Terms

    1. An ensemble model using temporal convolution and dual attention gated recurrent unit to analyze risk of civil aircraft
            Index terms have been assigned to the content through auto-classification.

            Recommendations

            Comments

            Information & Contributors

            Information

            Published In

            cover image Expert Systems with Applications: An International Journal
            Expert Systems with Applications: An International Journal  Volume 236, Issue C
            Feb 2024
            1583 pages

            Publisher

            Pergamon Press, Inc.

            United States

            Publication History

            Published: 01 February 2024

            Author Tags

            1. Aviation safety
            2. Risk analysis
            3. Deep neural network
            4. Attention mechanism
            5. Recurrent unit

            Qualifiers

            • Research-article

            Contributors

            Other Metrics

            Bibliometrics & Citations

            Bibliometrics

            Article Metrics

            • 0
              Total Citations
            • 0
              Total Downloads
            • Downloads (Last 12 months)0
            • Downloads (Last 6 weeks)0
            Reflects downloads up to 27 Jul 2024

            Other Metrics

            Citations

            View Options

            View options

            Get Access

            Login options

            Media

            Figures

            Other

            Tables

            Share

            Share

            Share this Publication link

            Share on social media