- Research
- Open Access

# Peak-to-peak exponential direct learning of continuous-time recurrent neural network models: a matrix inequality approach

- Choon Ki Ahn
^{1}Email author and - Moon Kyou Song
^{2}

**2013**:68

https://doi.org/10.1186/1029-242X-2013-68

© Ahn and Song; licensee Springer 2013

**Received:**9 October 2012**Accepted:**4 February 2013**Published:**25 February 2013

## Abstract

The purpose of this paper is to propose a new peak-to-peak exponential direct learning law (P2PEDLL) for continuous-time dynamic neural network models with disturbance. Dynamic neural network models trained by the proposed P2PEDLL based on matrix inequality formulation are exponentially stable, with a guaranteed exponential peak-to-peak norm performance. The proposed P2PEDLL can be determined by solving two matrix inequalities with a fixed parameter, which can be efficiently checked using existing standard numerical algorithms. We use a numerical example to demonstrate the validity of the proposed direct learning law.

## Keywords

- exponential peak-to-peak norm performance
- training law
- dynamic neural network models
- disturbance
- matrix inequality

## 1 Introduction

Remarkable progress has been made recently in the field of neural networks due to their advantages in overcoming several problems such as learning ability, parallel computation, fault tolerance, and function approximation. New and exciting applications appear frequently in combinatorial optimization, signal processing, control, and pattern recognition and most aim to improve the stability and performance of neural networks [1].

The use of neural networks in applications such as optimization solvers or associative memories requires analysis of the stability of the neural networks. We have two main categories in stability analysis of neural networks: stability of neural networks [2–7] and stability of learning laws [8–16]. This paper focuses on obtaining a new robust learning method for disturbed neural networks. Essentially, if identification or tracking errors in neural networks are analyzed, stable learning methods for neural networks can be obtained. Previous authors [9] who used neural network models to simultaneously identify and control nonlinear systems studied the stability conditions of learning laws. In [17], a modification of the dynamic backpropagation was proposed under $N{L}_{q}$ stability constraints. In [11, 13, 15, 16], the passivity concept was applied to obtain learning laws for neural networks. Identification or modeling errors always exist between neural network models and unknown nonlinear systems. Thus, extensive modification of either the backpropagation algorithm or the normal gradient algorithm is required [8, 9, 12, 14]. Despite these advances in stable learning of neural networks, the previous research results were derived solely from neural networks without disturbances. However, in real physical systems, model uncertainties and external disturbances always occur. Thus, obtaining learning algorithms for dynamic neural networks with external disturbances is of practical importance. Ahn [18–22] recently proposed several robust training algorithms for dynamic neural networks, switched neural networks, and fuzzy neural networks with external disturbances.

The peak-to-peak norm approach (also known as the induced ${\mathcal{L}}_{\mathrm{\infty}}$ norm approach in control engineering) introduced in [23–26] is recognized as an efficient method for handling various systems with bounded noises or disturbances because we can obtain general stability results using bounded input and output measurements. This raises a question about the possibility of obtaining a peak-to-peak norm based learning algorithm for dynamic neural networks. In this paper, we provide an answer to this interesting question. As far as we are aware, no result published on training law has yet considered the peak-to-peak norm performance for dynamic neural networks. Thus, this research topic still remains unresolved and challenging.

In this paper, we prove, for the first time, the existence of a new robust learning law that considers the peak-to-peak norm performance for dynamic neural networks with external disturbance. This new learning law is called a peak-to-peak exponential direct learning law (P2PEDLL). A new matrix inequality condition for the existence of the P2PEDLL is proposed to ensure that neural networks are exponentially stable with a guaranteed peak-to-peak norm performance. Based on matrix inequality formulation with a fixed parameter, the proposed learning law can be designed by solving two matrix inequalities, which can be checked easily using standard numerical software [27, 28]. In contrast to the existing work [18, 19, 21, 22] on learning algorithms for continuous-time neural networks, the advantage of our work is that we can deal with the worst-case peak value of the state vector for all bounded peak values of external disturbance in learning algorithm effectively.

This paper is organized as follows. In Section 2, we propose a new peak-to-peak exponential direct learning law of dynamic neural networks with disturbance. In Section 3, a numerical example is given, and finally, conclusions are presented in Section 4.

## 2 Peak-to-peak exponential direct learning law

where $x(t)={[{x}_{1}(t)\cdots {x}_{n}(t)]}^{T}\in {R}^{n}$ is the state vector, $d(t)={[{d}_{1}(t)\cdots {d}_{k}(t)]}^{T}\in {R}^{k}$ is the disturbance vector, $\tau >0$ is the time-delay, $A\in {R}^{n\times n}$ is the self-feedback matrix, $W(t)\in {R}^{n\times p}$, $V(t)\in {R}^{n\times p}$ are the weight matrices, $\theta (x)={[{\theta}_{1}(x),\dots ,{\theta}_{p}(x)]}^{T}:{R}^{n}\to {R}^{p}$ is the nonlinear vector field, and $G\in {R}^{n\times k}$ is a known constant matrix. The element functions ${\theta}_{i}(x)$ ($i=1,\dots ,p$) are usually selected as sigmoid functions.

under zero-initial conditions for all nonzero $d(t)\in {L}_{\mathrm{\infty}}[0,\mathrm{\infty})$, where *κ* is a positive constant.

A new peak-to-peak exponential direct learning law is given in the following theorem.

**Theorem 1**

*Let*

*κ*

*be a given positive constant*.

*For a given level*$\gamma >0$,

*assume that there exist matrices*$P={P}^{T}>0$,

*Y*

*and positive scalars*

*λ*,

*μ*

*such that*

*If the weight matrices*$W(t)$

*and*$V(t)$

*are updated as*

*then the neural network* (1) *is exponentially stable with a guaranteed exponential peak*-*to*-*peak norm bound* *γ*.

*Proof*The neural network (1) can be represented by

*P*. It follows from (26) that

Thus, the exponential stability of the neural network (1) is guaranteed.

Introducing a change of variable $PK=Y$, $\mathrm{\Omega}<0$ is equivalently changed into the matrix inequality (3). Then the gain matrix of the P2PEDLL is given by $K={P}^{-1}Y$. The direct learning laws (12)-(13) are changed into (5)-(6). This completes the proof. □

**Remark 1** (3) and (4) are bilinear matrix inequalities (BMI). Thus, solving the feasibility problem of (3) and (4) is difficult. A global optimization method, such as branch and bound, is required for guaranteed convergence to the global optimum of a BMI problem because the BMI problem is not convex [30]. However, we can solve the BMI problem by solving the LMI problem for a fixed variable. For a fixed positive scalar *λ*, (3) and (4) are linear matrix inequalities (LMIs). Several LMI problems can be solved efficiently by using recently developed convex optimization algorithms [27]. In this paper, we utilized MATLAB LMI Control Toolbox [28] to solve the LMI problem.

## 3 Numerical example

## 4 Conclusion

In this paper, we have proved the existence of the P2PEDLL, which is a new class of robust learning laws, for dynamic neural networks with external disturbance. The P2PEDLL based on two matrix inequalities was proposed to ensure that neural networks are exponentially stable with a guaranteed peak-to-peak norm performance. A numerical simulation demonstrated the effectiveness of the proposed P2PEDLL. Our expectation is that the P2PEDLL proposed in this paper can be applied to several identification and control problems using neural networks. Implementation of the P2PEDLL using hardware will require that we continuously store state information of neural networks because it uses delayed state information, but this needs a lot of memory/storage in hardware. Thus, a new and efficient implementation algorithm of the P2PEDLL that will include the reduction of memory/storage remains as a future emphasis.

## Declarations

## Authors’ Affiliations

## References

- Gupta MM, Jin L, Homma N:
*Static and Dynamic Neural Networks*. Wiley, New York; 2003.View ArticleGoogle Scholar - Kelly DG:
**Stability in contractive nonlinear neural networks.***IEEE Trans. Biomed. Eng.*1990, 3: 241–242.Google Scholar - Matsouka K:
**Stability conditions for nonlinear continuous neural networks with asymmetric connections weights.***Neural Netw.*1992, 5: 495–500. 10.1016/0893-6080(92)90011-7View ArticleGoogle Scholar - Liang XB, Wu LD:
**A simple proof of a necessary and sufficient condition for absolute stability of symmetric neural networks.***IEEE Trans. Circuits Syst. I*1998, 45: 1010–1011. 10.1109/81.721271MathSciNetView ArticleGoogle Scholar - Sanchez EN, Perez JP:
**Input-to-state stability (ISS) analysis for dynamic neural networks.***IEEE Trans. Circuits Syst. I*1999, 46: 1395–1398. 10.1109/81.802844MathSciNetView ArticleGoogle Scholar - Chu T, Zhang C, Zhang Z:
**Necessary and sufficient condition for absolute stability of normal neural networks.***Neural Netw.*2003, 16: 1223–1227. 10.1016/S0893-6080(03)00075-3View ArticleGoogle Scholar - Chu T, Zhang C:
**New necessary and sufficient conditions for absolute stability of neural networks.***Neural Netw.*2007, 20: 94–101. 10.1016/j.neunet.2006.06.003View ArticleGoogle Scholar - Rovithakis GA, Christodoulou MA:
**Adaptive control of unknown plants using dynamical neural networks.***IEEE Trans. Syst. Man Cybern.*1994, 24: 400–412. 10.1109/21.278990MathSciNetView ArticleGoogle Scholar - Jagannathan S, Lewis FL:
**Identification of nonlinear dynamical systems using multilayered neural networks.***Automatica*1996, 32: 1707–1712. 10.1016/S0005-1098(96)80007-0MathSciNetView ArticleGoogle Scholar - Suykens JAK, Vandewalle J, De Moor B:
**Lur’e systems with multilayer perceptron and recurrent neural networks; absolute stability and dissipativity.***IEEE Trans. Autom. Control*1999, 44: 770–774. 10.1109/9.754815MathSciNetView ArticleGoogle Scholar - Yu W, Li X:
**Some stability properties of dynamic neural networks.***IEEE Trans. Circuits Syst. I*2001, 48: 256–259. 10.1109/81.904893View ArticleGoogle Scholar - Chairez I, Poznyak A, Poznyak T:
**New sliding-mode learning law for dynamic neural network observer.***IEEE Trans. Circuits Syst. II, Express Briefs*2006, 53: 1338–1342.View ArticleGoogle Scholar - Yu W, Li X:
**Passivity analysis of dynamic neural networks with different time-scales.***Neural Process. Lett.*2007, 25: 143–155. 10.1007/s11063-007-9034-0View ArticleGoogle Scholar - Rubio JJ, Yu W:
**Nonlinear system identification with recurrent neural networks and dead-zone Kalman filter algorithm.***Neurocomputing*2007, 70: 2460–2466. 10.1016/j.neucom.2006.09.004View ArticleGoogle Scholar - Ahn CK:
**Passive learning and input-to-state stability of switched Hopfield neural networks with time-delay.***Inf. Sci.*2010, 180(23):4582–4594. 10.1016/j.ins.2010.08.014View ArticleGoogle Scholar - Ahn CK:
**Some new results on stability of Takagi-Sugeno fuzzy Hopfield neural networks.***Fuzzy Sets Syst.*2011, 179(1):100–111. 10.1016/j.fss.2011.05.010View ArticleGoogle Scholar - Suykens JAK, Vandewalle J, De Moor B:$N{L}_{q}$ theory: checking and imposing stability of recurrent neural networks for nonlinear modelling.
*IEEE Trans. Signal Process.*1997, 45: 2682–2691. 10.1109/78.650094View ArticleGoogle Scholar - Ahn CK:An ${\mathcal{H}}_{\mathrm{\infty}}$ approach to stability analysis of switched Hopfield neural networks with time-delay.
*Nonlinear Dyn.*2010, 60(4):703–711. 10.1007/s11071-009-9625-6View ArticleGoogle Scholar - Ahn CK:${\mathcal{L}}_{2}\text{-}{\mathcal{L}}_{\mathrm{\infty}}$ nonlinear system identification via recurrent neural networks.
*Nonlinear Dyn.*2010, 62(3):543–552. 10.1007/s11071-010-9741-3View ArticleGoogle Scholar - Ahn CK:
**A new robust training law for dynamic neural networks with external disturbance.***Discrete Dyn. Nat. Soc.*2010., 2010: Article ID 415895, 14 pagesGoogle Scholar - Ahn CK:
**Robust stability of recurrent neural networks with ISS learning algorithm.***Nonlinear Dyn.*2011, 65(4):413–419. 10.1007/s11071-010-9901-5View ArticleGoogle Scholar - Ahn CK:Exponential ${\mathcal{H}}_{\mathrm{\infty}}$ stable learning method for Takagi-Sugeno fuzzy delayed neural networks: a convex optimization approach.
*Comput. Math. Appl.*2012, 63(5):887–895. 10.1016/j.camwa.2011.11.054MathSciNetView ArticleGoogle Scholar - Abedor J, Nagpal K, Poolla K:
**A linear matrix inequality approach to peak-to-peak gain minimization.***Int. J. Robust Nonlinear Control*1996, 6: 899–927. 10.1002/(SICI)1099-1239(199611)6:9/10<899::AID-RNC259>3.0.CO;2-GMathSciNetView ArticleGoogle Scholar - Scherer C, Gahinet P, Chilali M:
**Multiobjective output-feedback control via LMI optimization.***IEEE Trans. Autom. Control*1997, 42: 896–911. 10.1109/9.599969MathSciNetView ArticleGoogle Scholar - Ahn CK, Lee YS:Induced ${l}_{\mathrm{\infty}}$ stability of fixed-point digital filters without overflow oscillations and instability due to finite word length effects.
*Adv. Differ. Equ.*2012., 2012: Article ID 51Google Scholar - Ahn, CK, Kim, PS: New peak-to-peak state-space realization of direct form digital filters free of overflow limit cycles. Int. J. Innov. Comput. Inf. Control (2013, in press)Google Scholar
- Boyd S, Ghaoui LE, Feron E, Balakrishinan V:
*Linear Matrix Inequalities in Systems and Control Theory*. SIAM, Philadelphia; 1994.View ArticleGoogle Scholar - Gahinet P, Nemirovski A, Laub AJ, Chilali M:
*LMI Control Toolbox*. The Mathworks, Natick; 1995.Google Scholar - Albert AE:
*Regression and the Moore-Penrose Pseudoinverse*. Academic Press, San Diego; 1972.Google Scholar - VanAntwerp JG, Braatz RD:
**A tutorial on linear and bilinear matrix inequalities.***J. Process Control*2000, 10: 363–385. 10.1016/S0959-1524(99)00056-6View ArticleGoogle Scholar - Hunt KJ, Sbarbaro D, Zbikowski R, Gawthrop PJ:
**Neural networks for control systems - a survey.***Automatica*1992, 28: 1083–1112. 10.1016/0005-1098(92)90053-IMathSciNetView ArticleGoogle Scholar

## Copyright

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.