research-article

Noise-suppressing zeroing neural network for online solving time-varying matrix square roots problems: : A control-theoretic approach

Authors:

Bangcheng Zhang,

Junzhi YuAuthors Info & Claims

Volume 192, Issue C

https://doi.org/10.1016/j.eswa.2021.116272

Published: 15 April 2022 Publication History

Abstract

In this paper, the noise-suppressing zeroing neural network models (NSZNNMs) for online solving time-varying matrix square roots problems (TVMSRPs) are revisited and redesigned from a control viewpoint framework. Specifically, to solve TVMSRPs with different noises in real time, some noise-suppressing zeroing neural network functions are proposed. Moreover, a novel generally noise-suppressing zeroing neural network model (GNSZNNM) with generally noise-suppressing time-varying error-monitoring function is developed for online solving TVMSRPs with different measurement noises. In particular, the developed NSZNNMs globally converge to the time-varying theoretical solution of the TVMSRPs without noises, and exponentially converge to the theoretical solutions in the presence of noises, which are verified and analyzed theoretically. Compared with the classical zeroing neural network model (ZNNM), numerical results are provided to substantiate the efficiency and superiority of the developed NSZNNMs for online solving TVMSRPs with inherent tolerance to noises. In addition, a time-varying tensor square root problem is provided and illustrated to substantiate the potentially practical applications of the proposed NSZNNM for real-time TVMSRPs. The obtained results indicate that different activation functions can be utilized to accelerate the convergence speed of the GNSZNNM, which demonstrates its high efficiency and robustness.

Highlights

•

Noise-tolerant neural networks are proposed for time-varying matrix square roots.

•

The superiorities are demonstrated for noise-tolerant zeroing neural networks.

•

Different activation functions may accelerate the convergence speed.

•

The MATLAB Simulink modeling is directly beneficial to the hardware implementation.

References

[1]

Babaei S., Geranmayeh A., Seyyedsalehi S.A., Towards designing modular recurrent neural networks in learning protein secondary structures, Expert Systems with Applications 39 (6) (2012) 6263–6274.

Digital Library

[2]

Cross G.W., Lancaster P., Square roots of complex matrices, Linear Multilinear Algebra 1 (4) (1974) 289–293.

[3]

Frommer A., Hashemi B., Verified computation of square roots of a matrix, SIAM Journal on Matrix Analysis and Applications 31 (3) (2009) 1279–1392.

[4]

Ge S.S., Lee T.H., Harris C.J., Adaptive neural network control of robotic manipulators, World Scientific, London, 1998.

[5]

Hasan, M. A., Hasan, A. A., & Rahman, S. (2000). Fixed point iterations for computing square roots and the matrix sign function of complex matrices. In The 39th IEEE conference on decision and control (pp. 4253–4258).

[6]

Higham N.J., Stable iterations for the matrix square root, Numerical Algorithms 15 (2) (1997) 227–242.

[7]

Higham N.J., Accuracy and stability of numerical algorithms, society for industrial and applied mathematics, 2nd ed., SIAM, England, 2002.

[8]

Higham N.J., Functions of matrices: Theory and computation. society for industrial and applied mathematics, SIAM, England, 2008.

[9]

Hu Z.S., Xiao L., Dai J.H., Xu Y., Q.Y. Zuo., C.B. Liu., A unified predefined-time convergent and robust ZNN model for constrained quadratic programming, IEEE Transactions on Industrial Informatics 17 (3) (2021) 1998–2010.

[10]

Jin L., Li S., Hu B., RNN models for dynamic matrix inversion: A control-theoretical perspective, IEEE Transactions on Industrial Informatics 14 (1) (2018) 189–199.

[11]

Jin L., Li S., Hu B., Liu M., Yu J.G., Noise-suppressing neural algorithm for solving time-varying system of linear equations: A control-based approach, IEEE Transactions on Industrial Informatics 15 (1) (2019) 236–246.

[12]

Jin L., Yan J.K., Du X.J., Xiao X.C., Fu D.Y., RNN for solving time-variant generalized sylvester equation with applications to robots and acoustic source localization, IEEE Transactions on Neural Networks 16 (10) (2020) 6359–6369.

[13]

Jin L., Ying L.F., Lu H.Y., Zhang Z.J., Saturation-allowed neural dynamics applied to perturbed time-dependent system of linear equations and robots, IEEE Transactions on Industrial Electronics 68 (10) (2021) 9844–9854.

[14]

Jin L., Zhang Y.N., Li S., Zhang Y.Y., Noise-tolerant ZNN models for solving time-varying zero-finding problems: A control-theoretic approach, IEEE Transactions on Automatic Control 62 (2) (2017) 992–997.

[15]

Johnson C.R., Okubo K., Reams R., Uniqueness of matrix square roots and an application, Linear Algebra and its Applications 323 (1–3) (2001) 51–60.

[16]

Kilmer M.E., Braman K., Hao N., Hoover R.C., Third-order tensors as operators on matrices: a theoretical and computational framework with applications in imaging, SIAM Journal on Matrix Analysis and Applications 34 (1) (2013) 148–172.

[17]

Li X.X., Yu J.G., Li S., Shao Z.H., Ni L.N., A non-linear and noise-tolerant ZNN model and its application to static and time-varying matrix square root finding, Neural Processing Letters 50 (2) (2019) 1687–1703.

[18]

Li Z., Zhang Y., Improved zhang neural network model and its solution of time-varying generalized linear matrix equations, Expert Systems with Applications 37 (10) (2010) 7213–7218.

Digital Library

[19]

Long, J. H., Hu, X. Y., & Zhang, L. (2007). Newton’s method with exact line search for the square root of a matrix. In International symposium on nonlinear dynamics (pp. 1–5).

[20]

Meini B., The matrix square root from a new functional perspective: theoretical results and computational issues, SIAM Journal on Matrix Analysis and Applications 26 (2) (2004) 362–376.

[21]

Mo C.X., Gerontitis D.K., Stanimirovi P.S., Neurocomputing 445 (2021) 309–325.

[22]

Mo C.X., Li C.Q., Wang X.Z., Wei Y.M., Z-eigenvalues based structured tensors: M z-tensors and strong M z-tensors, Computational & Applied Mathematics 38 (4) (2019) 175.

[23]

Oppenheim A.V., Willsky A.S., Signals and systems, Prentice-Hall, Englewood Cliffs, NJ, USA, 1997.

[24]

Sun Z.B., Li F., Zhang B.C., Sun Y.Y., Jin L., Different modified zeroing neural dynamics with inherent tolerance to noises for time-varying reciprocal problems: A control-theoretic approach, Neurocomputing 337 (2019) 165–179.

Digital Library

[25]

Talpaert Y., Simmonds J., Tensor analysis and continuum mechanics, Kluwer Academic Publishers, Dordrecht, The Nether-lands, 2004.

[26]

Wei L., Jin L., Yang C.G., Ke Chen., Li W.B., New noise-tolerant neural algorithms for future dynamic nonlinear optimization with estimation on Hessian matrix inversion, IEEE Transactions on Systems, Man, and Cybernetics: Systems 51 (4) (2021) 2623–3611.

[27]

Xiao L., Accelerating a recurrent neural network to finite-time convergence using a new design formula and its application to time-varying matrix square root, Journal of the Franklin Institute 354 (13) (2017) 5667–5677.

[28]

Xiao L., A finite-time convergent zhang neural network and its application to real-time matrix square root finding, Neural Computing and Applications 31 (S2) (2019) 793–800.

[29]

Xiao L., Zhang Y.S., Dai J.H., Zuo Q.Y., Wang S.J., Comprehensive analysis of a new varying parameter zeroing neural network for time varying matrix inversion, IEEE Transactions on Industrial Informatics 17 (3) (2021) 1604–1613.

[30]

Xie Z.T., Jin L., Luo X., Sun Z.B., Liu M., RNN for repetitive motion generation of redundant robot manipulators: An orthogonal projection-based scheme, IEEE Transactions on Neural Networks and Learning Systems (2020),. (in press).

[31]

Ying L.F., Jin L., Xu J.Q., Xiao X.C., Fu D.Y., Reformative noise-immune neural network for equality-constrained optimization applied to image target detection, IEEE Transactions on Emerging Topics in Computing (2021),. (in press).

[32]

Zhang Y.N., Chen K., Tan H.Z., Performance analysis of gradient neural network exploited for online time-varying matrix inversion, IEEE Transactions on Automatic Control 54 (2009) 1940–1945.

[33]

Zhang Y., Ge S.S., Design and analysis of a general recurrent neural network model for time-varying matrix inversion, IEEE Transactions on Neural Networks 16 (6) (2005) 1477–1490.

Digital Library

[34]

Zhang Y.N., Guo D.S., Zhang Functions and Various Models, Springer-Verlag, Berlin Heidelberg, 2015.

[35]

Zhang Y.N., He L., Hu C.W., Guo J.J., Li J., Shi Y., General four-step discrete-time zeroing and derivative dynamics applied to time-varying nonlinear optimization, Journal of Computational and Applied Mathematics 347 (2019) 314–329.

[36]

Zhang Y., Jiang D., Wang J., A recurrent neural network for solving sylvester equation with time-varying coefficients, IEEE Transactions on Industrial Informatics 13 (5) (2002) 1053–1063.

[37]

Zhang J.Z., Jin L., Cheng L., RNN for perturbed manipulability optimization of manipulators based on a distributed scheme: A game-theoretic perspective, IEEE Transactions on Neural Networks and Learning Systems 31 (12) (2020) 5116–5126.

[38]

Zhang, Y., Leithead, W. E., & Leith, D. J. (2005). Time-series Gaussian process regression based on Toeplitz computation of O ( N 2 ) operations and O ( N )-level storage. In The 44th IEEE conference on decision and control and european control conference, (pp. 3711–3716).

[39]

Zhang Y.N., Li Z., Zhang neural network for online solution of time-varying convex quadratic program subject to time-varying linear-equality constrains, Physics Letters. A 373 (18–19) (2009) 1639–1643.

[40]

Zhang Y.N., Li W.B., Guo D.S., Ke Z.D., Different zhang functions leading to different ZNN models illustrated via time-varying matrix square roots finding, Expert Systems with Applications 40 (2013) 4393–4403.

[41]

Zhang Y.N., Li Z., Guo D.S., Li W.B., Chen P., Z-type and G-type models for time-varying inverse square root (TVISR) solving, Soft Computing 17 (2013) 2021–2032.

[42]

Zhang, Y., Ma, W., Chen, K., & Li, P. (2007). MATLAB simulation of Zhang neural networks for time-varying Sylvester equation solving. In The international conference on information computing and automation, (pp. 392–395).

[43]

Zhang, Y. N., & Yang, Y. W. (2008). Simulation and comparison of Zhang neural network and gradient neural network solving for time-varying matrix square roots. In 2008 Second International Symposium on Intelligent Information Technology Application, (pp. 966–970).

[44]

Zhang Y.N., Yang Y.W., Cai B.H., Guo D.S., Zhang neural network and its application to Newton iteration for matrix square root estimation, Neural Computing and Applications 21 (2012) 453–460.

[45]

Zhang Y.N., Yang Y.W., Tan N., Cai B.H., Zhang neural network solving for time-varying full-rank matrix Moore–Penrose inverse, Computing 92 (2011) 97–121.

[46]

Zhang Z., Zhang Y.N., Design and experimentation of acceleration level drift-free scheme aided by two recurrent neural networks, IET Control Theory & Applications 7 (2013) 25–42.

Cited By

Jin JLei XChen CLi Z(2025)A fuzzy activation function based zeroing neural network for dynamic Arnold map image cryptographyMathematics and Computers in Simulation10.1016/j.matcom.2024.10.031230:C(456-469)Online publication date: 1-Apr-2025
https://dl.acm.org/doi/10.1016/j.matcom.2024.10.031
Shi YChong WZhao WLi SLi BSun X(2024)A new recurrent neural network based on direct discretization method for solving discrete time-variant matrix inversion with applicationInformation Sciences: an International Journal10.1016/j.ins.2023.119729652:COnline publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1016/j.ins.2023.119729
Zhang BZheng YLi SChen XMao Y(2024)Fixed-time convergence ZNN model for solving rectangular dynamic full-rank matrices inversionExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.123992251:COnline publication date: 24-Jul-2024
https://dl.acm.org/doi/10.1016/j.eswa.2024.123992
Show More Cited By

Index Terms

Noise-suppressing zeroing neural network for online solving time-varying matrix square roots problems: A control-theoretic approach

Index terms have been assigned to the content through auto-classification.

Recommendations

Noise-suppressing zeroing neural network for online solving time-varying nonlinear optimization problem: a control-based approach
Abstract
Time-varying nonlinear optimization problems with different noises often arise in the fields of scientific and engineering research. Noises are unavoidable in the practical workspace, but the most existing models for time-varying nonlinear ...
Time-Varying Matrix Square Roots Solving via Zhang Neural Network and Gradient Neural Network: Modeling, Verification and Comparison
ISNN '09: Proceedings of the 6th International Symposium on Neural Networks on Advances in Neural Networks

A special kind of recurrent neural networks (RNN) with implicit dynamics has recently been proposed by Zhang <em>et al</em> , which could be generalized to solve online various time-varying problems. In comparison with conventional gradient neural ...
Exponential convergence and Lagrange stability for impulsive Cohen-Grossberg neural networks with time-varying delays

In this paper, the problem on exponential convergence and Lagrange exponential stability for a class of delayed Cohen-Grossberg neural networks with impulses effects is investigated. To this end, a new delay impulsive differential inequality is ...

Comments

Information & Contributors

Information

Published In

cover image Expert Systems with Applications: An International Journal

Expert Systems with Applications: An International Journal Volume 192, Issue C

Apr 2022

831 pages

ISSN:0957-4174

Issue’s Table of Contents

Elsevier Ltd.

Publisher

Pergamon Press, Inc.

United States

Publication History

Published: 15 April 2022

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Jin JLei XChen CLi Z(2025)A fuzzy activation function based zeroing neural network for dynamic Arnold map image cryptographyMathematics and Computers in Simulation10.1016/j.matcom.2024.10.031230:C(456-469)Online publication date: 1-Apr-2025
https://dl.acm.org/doi/10.1016/j.matcom.2024.10.031
Shi YChong WZhao WLi SLi BSun X(2024)A new recurrent neural network based on direct discretization method for solving discrete time-variant matrix inversion with applicationInformation Sciences: an International Journal10.1016/j.ins.2023.119729652:COnline publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1016/j.ins.2023.119729
Zhang BZheng YLi SChen XMao Y(2024)Fixed-time convergence ZNN model for solving rectangular dynamic full-rank matrices inversionExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.123992251:COnline publication date: 24-Jul-2024
https://dl.acm.org/doi/10.1016/j.eswa.2024.123992
Cai JZhang WZhong SYi C(2024)A super-twisting algorithm combined zeroing neural network with noise tolerance and finite-time convergence for solving time-variant Sylvester equationExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.123380248:COnline publication date: 15-Aug-2024
https://dl.acm.org/doi/10.1016/j.eswa.2024.123380
Jiang XZhang GZheng YJiang Z(2024)Explicit potential function and fast algorithm for computing potentials in α × β conic surface resistor networkExpert Systems with Applications: An International Journal10.1016/j.eswa.2023.122157238:PEOnline publication date: 27-Feb-2024
https://dl.acm.org/doi/10.1016/j.eswa.2023.122157
Zhao LHeng TLiu KSun Z(2024)A zeroing neural network model for form-finding problemsEngineering Applications of Artificial Intelligence10.1016/j.engappai.2023.107492128:COnline publication date: 14-Mar-2024
https://dl.acm.org/doi/10.1016/j.engappai.2023.107492
Sun YCao JSun ZTang S(2023)A nonconvex function activated noise-tolerant neurodynamic model aided with Fischer-Burmeister function for time-varying quadratic programming in the presence of noisesNeurocomputing10.1016/j.neucom.2022.11.067520:C(365-375)Online publication date: 1-Feb-2023
https://dl.acm.org/doi/10.1016/j.neucom.2022.11.067
Wang GLiu YSun YYu JSun Z(2023)Generalized zeroing neural dynamics model for online solving time-varying cube roots problem with various external disturbances in different domainsInformation Sciences: an International Journal10.1016/j.ins.2022.12.058623:C(648-670)Online publication date: 1-Apr-2023
https://dl.acm.org/doi/10.1016/j.ins.2022.12.058
Jiang CZhang YMou CLi BSun XShi Y(2023)A new ZNN model for finding discrete time-variant matrix square rootJournal of Computational and Applied Mathematics10.1016/j.cam.2023.115260431:COnline publication date: 15-Oct-2023
https://dl.acm.org/doi/10.1016/j.cam.2023.115260
Jin JZhu JZhao LChen L(2022)A fixed-time convergent and noise-tolerant zeroing neural network for online solution of time-varying matrix inversionApplied Soft Computing10.1016/j.asoc.2022.109691130:COnline publication date: 1-Nov-2022
https://dl.acm.org/doi/10.1016/j.asoc.2022.109691
Show More Cited By

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents