Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Optimization of the generalized covariance estimator in noncausal processes

Published: 31 May 2024 Publication History
  • Get Citation Alerts
  • Abstract

    This paper investigates the performance of routinely used optimization algorithms in application to the Generalized Covariance estimator (GCov) for univariate and multivariate mixed causal and noncausal models. The GCov is a semi-parametric estimator with an objective function based on nonlinear autocovariances to identify causal and noncausal orders. When the number and type of nonlinear autocovariances included in the objective function are insufficient/inadequate, or the error density is too close to the Gaussian, identification issues can arise. These issues result in local minima in the objective function, which correspond to parameter values associated with incorrect causal and noncausal orders. Then, depending on the starting point and the optimization algorithm employed, the algorithm can converge to a local minimum. The paper proposes the Simulated Annealing (SA) optimization algorithm as an alternative to conventional numerical optimization methods. The results demonstrate that SA performs well in its application to mixed causal and noncausal models, successfully eliminating the effects of local minima. The proposed approach is illustrated by an empirical study of a bivariate series of commodity prices.

    References

    [1]
    Aarts, E., Korst, J., Michiels, W.: Simulated Annealing. Search Methodologies: Introductory Tutorials in Optimization and Decision Support Techniques, pp. 187–210 (2005)
    [2]
    Bec F, Nielsen HB, and Saidi S Mixed causal–noncausal autoregressions: bimodality issues in estimation and unit root testing 1 Oxford Bull. Econ. Stat. 2020 82 6 1413-1428
    [3]
    Breidt, F.J., Davis, R.A., Lh, K.-S., Rosenblatt, M.: Maximum likelihood estimation for noncausal autoregressive processes. J. Multivar. Anal. 36(2), 175–198 (1991)
    [4]
    Broyden CG The convergence of a class of double-rank minimization algorithms 1. General considerations IMA J. Appl. Math. 1970 6 1 76-90
    [5]
    Byrd RH, Peihuang L, Nocedal J, and Zhu C A limited memory algorithm for bound constrained optimization SIAM J. Sci. Comput. 1995 16 5 1190-1208
    [6]
    Carnevali, P., Coletti, L., Patarnello, S.: Image processing by simulated annealing. Readings in Computer Vision. Elsevier, pp. 551–561 (1987)
    [7]
    Cavaliere G, Nielsen HB, and Rahbek A Bootstrapping noncausal autoregressions: with applications to explosive bubble modeling J. Bus. Econ. Stat. 2020 38 1 55-67
    [8]
    Černy V Thermodynamical approach to the traveling salesman problem: an efficient simulation algorithm J. Optim. Theory Appl. 1985 45 41-51
    [9]
    Chan K-S, Ho L-H, and Tong H A note on time-reversibility of multivariate linear processes Biometrika 2006 93 1 221-227
    [10]
    Corana A, Marchesi M, Martini C, and Ridella S Minimizing multimodal functions of continuous variables with the “simulated annealing" algorithm—Corrigenda for this article is available here ACM Trans. Math. Softw. 1987 13 3 262-280
    [11]
    Cubadda G, Hecq A, and Voisin E Detecting common bubbles in multivariate mixed causal–noncausal models Econometrics 2023 11 1 9
    [12]
    Davis RA and Song L Noncausal vector AR processes with application to economic time series J. Econom. 2020 216 1 246-267
    [13]
    Dennis Jr, J.E., Schnabel, R.B.: Numerical Methods for Unconstrained Optimization and Nonlinear Equations. SIAM (1996)
    [14]
    Findley DF The uniqueness of moving average representations with independent and identically distributed random variables for non-Gaussian stationary time series Biometrika 1986 73 2 520-521
    [15]
    Fletcher R A new approach to variable metric algorithms Comput. J. 1970 13 3 317-322
    [16]
    Fletcher R Practical Methods of Optimization 2000 London Wiley
    [17]
    Fries S and Zakoian J-M Mixed causal–noncausal ar processes and the modelling of explosive bubbles Economet. Theor. 2019 35 6 1234-1270
    [18]
    Giancaterini F, Hecq A, and Morana C Is climate change time-reversible? Econometrics 2022 10 4 36
    [19]
    Goffe, W.L.: SIMANN: a global optimization algorithm using simulated annealing. Stud. Nonlinear Dyn. Econom. 1(3) (1996)
    [20]
    Goffe WL, Ferrier GD, and Rogers J Simulated annealing: an initial application in econometrics Comput. Sci. Econ. Manag. 1992 5 133-146
    [21]
    Goffe WL, Ferrier GD, and Rogers J Global optimization of statistical functions with simulated annealing J. Econom. 1994 60 1–2 65-99
    [22]
    Goldfarb, D.: A family of variable metric updates derived by variational means, v. 24. Math. Comput., pp. 21–55 (1970)
    [23]
    Gourieroux C and Jasiak J Noncausal vector autoregressive process: representation, identification and semi-parametric estimation J. Econom. 2017 200 1 118-134
    [24]
    Gourieroux C and Jasiak J Misspecification of noncausal order in autoregressive processes J. Econom. 2018 205 1 226-248
    [25]
    Gourieroux, C., Jasiak, J.: Nonlinear forecasts and impulse responses for causal-noncausal (S) VAR models (2022). arXiv:2205.09922
    [26]
    Gourieroux C and Jasiak J Generalized covariance estimator J. Bus. Econ. Stat. 2023 41 1315-1327
    [27]
    Gourieroux C and Zakoian J-M Local explosion modelling by non-causal process J. R. Stat. Soc. Ser. B Stat Methodol. 2017 79 3 737-756
    [28]
    Gu M, Lin Y, Lee VC, and Qiu DY Probabilistic forecast of nonlinear dynamical systems with uncertainty quantification Physica D 2024 457
    [29]
    Hecq A, Lieb L, and Telg S Identification of mixed causal–noncausal models in finite samples Ann. Econ. Stat./Ann. d’ É con. et de Stat. 2016 123/124 307-331
    [30]
    Hecq, A., Velasquez-Gaviria, D.: Spectral estimation for mixed causal-noncausal autoregressive models (2022). arXiv:2211.13830
    [31]
    Hecq A and Voisin E Forecasting bubbles with mixed causal–noncausal autoregressive models Econom. Stat. 2021 20 29-45
    [32]
    Hencic, A., Gouriéroux, C.: Noncausal autoregressive model in application to bitcoin/USD exchange rates. Econom. Risk, pp. 17–40 (2015)
    [33]
    Jasiak, J., Neyazi, A.M.: GCov-based portmanteau test (2023). arXiv:2312.05373
    [34]
    Jones, R.O.: Molecular structures from density functional calculations with simulated annealing. Angew. Chem. Int. Ed. Engl. 30(6), 630–640 (1991)
    [35]
    Kirkpatrick S, Gelatt CD Jr, and Vecchi MP Optimization by simulated annealing Science 1983 220 4598 671-680
    [36]
    Lanne, M., Saikkonen, P.: Noncausal autoregressions for economic time series. J. Time Ser. Econom. 3(3) (2011)
    [37]
    Lanne M and Saikkonen P Noncausal vector autoregression Economet. Theor. 2013 29 3 447-481
    [38]
    Pannetier J, Bassas-Alsina J, Rodriguez-Carvajal J, and Caignaert V Prediction of crystal structures from crystal chemistry rules by simulated annealing Nature 1990 346 6282 343-345
    [39]
    Schmid, P.J.: Dynamic mode decomposition of numerical and experimental data. J. Fluid Mech. 656, 5–28 (2010)
    [40]
    Shanno DF Conditioning of quasi-Newton methods for function minimization Math. Comput. 1970 24 111 647-656
    [41]
    Swensen A On causal and non-causal cointegrated vector autoregressive time series J. Time Ser. Anal. 2022 43 2 178-196
    [42]
    Tu, J.H.: Dynamic mode decomposition: theory and applications. Ph.D. thesis. Princeton University (2013)
    [43]
    Wong, D.F., Leong, H.W., Liu, H.W.: Simulated Annealing for VLSI Design, vol. 42. Springer (2012)

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image Statistics and Computing
    Statistics and Computing  Volume 34, Issue 4
    Aug 2024
    578 pages

    Publisher

    Kluwer Academic Publishers

    United States

    Publication History

    Published: 31 May 2024
    Accepted: 13 May 2024
    Received: 08 January 2024

    Author Tags

    1. Mixed causal and noncausal models
    2. Generalized covariance estimator
    3. Simulated Annealing
    4. Optimization
    5. Commodity prices

    Qualifiers

    • Research-article

    Funding Sources

    • Università degli Studi di Roma Tor Vergata

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 0
      Total Downloads
    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 09 Aug 2024

    Other Metrics

    Citations

    View Options

    View options

    Get Access

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media