- Research
- Open access
- Published:
New delay-dependent observer-based control for uncertain stochastic time-delay systems
Journal of Inequalities and Applications volume 2019, Article number: 294 (2019)
Abstract
This paper considers the problem of estimating the state vector of uncertain stochastic time-delay systems, while the system states are unmeasured. The system under study involves parameter uncertainties, noise disturbances and time delay, and they are dependent on the state. Based on the Lyapunov–Krasovskii functional approach, we present a delay-dependent condition for the existence of a state observer in terms of a linear matrix inequality. A numerical example is exploited to show the validity of the results obtained.
1 Introduction
Uncertain stochastic time-delay systems have come to play an important role in many branches of science and engineering applications. Some recent improved research results pertaining to the analysis for stochastic time-delay systems have been reported; see [1,2,3,4,5,6] and the references therein. It is well known that the dynamic behaviour of many industrial processes contains inherent time delays due to the distributed nature of the systems [7,8,9,10,11,12,13,14,15,16,17]. Both time delay and uncertainties are inevitable in real applications. Systems have difficulty keeping nice performances, because time delay and/or uncertainties often destroy the stability of systems. As regards being based on the size of the time delays of the systems, the criteria for time-delay systems can be classified into two groups: delay-independent criteria and delay-dependent criteria. Generally speaking, since delay-dependent conditions make use of information on the length of the delay, they are less conservative than delay-independent ones. To obtain delay-dependent conditions, the main approaches consist of model transformations of an original system and the bounding technique [18, 19].
On the other hand, the availability for direct measurements of all the state variables is rare in practice. In most cases, we need to estimate unmeasurable state variables. For this particular task, a state observer is more common, in order to accurately reconstruct the state variables of the systems [20,21,22,23,24]. The problem of observer design for uncertain stochastic time-delay systems has been investigated by many researchers. For example, the authors in [25] designed an exponent filter estimate state for stochastic nonlinear systems with time delay by using a high-gain observer-based approach. The authors of [26] investigated a stochastic system with process noises and sensor noises, and they gave a design method of observer minimizing the upper bound of an error variance. In [27], the authors dealt with the output feedback sliding mode control for Itô stochastic time-delay systems. The delay-independent sufficient condition for the asymptotic stability in probability of the overall closed-loop stochastic system was derived. To the best of the author’s knowledge, so far little work is available in the literature that addresses a delay-dependent condition of the existence of observer for uncertain stochastic time-delay systems.
This article considers state estimation for a class of Itô-type stochastic systems subject to time delay and parameter uncertainties. The system states are unmeasured. The stochastic system involves parameter uncertainties and time delay, and they are dependent on the state. The objective is to design a robust observer such that the dynamics of the estimation error is guaranteed to be asymptotically stable in the mean square. Attention is focused on the design of the gain matrix and the state-feedback controller. This paper derived an observer design method of uncertain stochastic time-delay systems by constructing a proper Lyapunov–Krasovskii functional and by making use of the free weighting matrix method. In [27], the authors obtained some theorems, but conclusions are independent of time delay. Consequently, this will largely restrict the applying area of the conclusions. The innovation of this paper is that the delay-dependent sufficient condition for the existence of such a state observer for any admissible uncertainties is given. We present a new method to estimate the stochastic systems. Based on the new criterion, a delay-dependent condition for the existence of state observer is derived in terms of a linear matrix inequality (LMI), therefore it is in the sense of being conservative reduced. A numerical example is exploited to show the validity of the results obtained.
In this paper, we work on the complete probability space \((\varOmega ,\mathcal{F},\mathcal{P})\) with the filtration \(\mathcal{F} _{t\{t\geq 0\}}\) satisfying the usual conditions. \(\mathbb{R}^{n}\) and \(\mathbb{R}^{m\times n}\) denote, respectively, the n-dimensional Euclidean space and the set of all \(m\times n\) real matrices. \(L_{2}[0,\infty )\) is the space of square-integrable vector functions over \([0,\infty )\). \(C^{2,1}(\mathbb{R}^{n}\times \mathbb{R}_{+};\mathbb{R}_{+})\) denotes the family of all nonnegative functions \(V(x(t),t)\) on \(\mathbb{R}^{n}\times \mathbb{R}_{+}\) that are continuously twice differentiable in x and once differentiable in t. Let \(\tau >0\) and denote by \(C([-\tau ,0];\mathbb{R}^{n})\) the family of continuous functions φ from \([-\tau ,0]\) to \(\mathbb{R}^{n}\) with the norm \(\|\varphi \|=\sup_{\theta \in [- \tau ,0]} |\varphi (\theta )|\), where \(|\cdot |\) and \(\|\cdot \|\) are the usual Euclidean norm in \(\mathbb{R}^{n}\) and the \(L_{2}[0,\infty )\) norm, respectively. \(P>0\) means the matrix P is symmetric positive definite, the notation \(U>V\), where U and V are symmetric matrices, means that \(U-V\) is a positive definite matrix. \(\mathbb{E}(x)\) stands for the expectation of stochastic variable x, \(B^{T}\) represents the transposed matrix of B, I denote the identity matrix of compatible dimension; moreover, . The shorthand \(\operatorname{diag}\{F_{1},\ldots ,F_{n}\}\) denotes a block diagonal matrix with diagonal blocks being the matrices \(F_{1},\ldots ,F_{n}\).
2 Preliminaries
Consider the following stochastic time-delay systems described in Itô’s form:
where \(x(t)\in \mathbb{R}^{n}\) is the state, \(u(t)\in \mathbb{R}^{p}\) is the control input, \(y(t)\in \mathbb{R}^{r}\) is the measured output, τ is a real constant time delay satisfying \(0\leq \tau <\infty \). \(\varphi (t)\in C([-\tau ,0];\mathbb{R}^{n})\) is a continuous vector-valued initial function, and \(\omega (t)\) is a one-dimensional Brownian motion satisfying
Here, \(A\in \mathbb{R}^{n\times n}\), \(A_{\tau }\in \mathbb{R}^{n\times n}\), \(B \in \mathbb{R}^{n\times p}\), \(D\in \mathbb{R}^{n\times n}\), \(C\in \mathbb{R}^{r\times n}\) are known real constant matrices of appropriate dimensions. Moreover, \(\varDelta A(t)\) and \(\varDelta A_{\tau }(t)\) are unknown matrices representing time-varying parameter uncertainties, and they are assumed to be of the form
where G, \(H_{1}\), \(H_{2}\) are known real constant matrices and \(F(t)\) is an unknown time-varying matrix function satisfying
The parameter uncertainties \(\varDelta A(t)\) and \(\varDelta A_{\tau }(t)\) are said to be admissible if both (2) and (3) hold.
Definition 1
([28])
System (1a)–(1c) is said to be robustly asymptotically mean-square stable if for all admissible uncertainties (2) and (3) the following holds for any initial condition:
Remark 1
Uncertain stochastic time-delay systems in the form of (1a)–(1c) are common in many branches of engineering applications [1, 3, 5]. It is observed that, in system (1a)–(1c), parameter uncertainties, Itô-type stochastic disturbances and time delay are considered simultaneously, also they are dependent on the state. The aim of this paper is to design a state observer of system (1a)–(1c) such that dynamics of the estimation error is asymptotically stable in the mean square.
Before presenting the main results of this article, we first introduce the following several lemmas, which will be essential for later developments.
Lemma 1
(Schur complement [29])
For a given the symmetric matrix , the following conditions are equivalent:
- (a)
\(X<0\),
- (b)
\(X_{11}<0\), \(X_{22}-X_{12}^{T}X_{11}^{-1}X_{12}<0\),
- (c)
\(X_{22}<0\), \(X_{11}-X_{12}X_{22}^{-1}X_{12}^{T}<0\).
Lemma 2
([27])
LetG, Hand \(F(t)\)be real matrices of appropriate dimensions with \(F(t)\)satisfying \(F(t)^{T}F(t)\leq I\). Then, for any scalar \(\varepsilon >0\), we have
Lemma 3
([30])
Let us have any positive definite matrix \(R>0\), scalar \(\tau >0\). If there exists a vector function \(x(t):[0,\tau ]\rightarrow \mathbb{R}^{n}\), such that \(\int _{0}^{\tau }x^{T}(s)Rx(s)\,\mathrm{d}s\)and \(\int _{0}^{\tau }x^{T}(s)\,\mathrm{d}s\)are well defined, then we have the following inequality:
3 Main results
We design an observer to asymptotically estimate \(x(t)\). Let us propose the following Luenberger-type observer [31] of the uncertain stochastic time-delay system (1a)–(1c):
where \(L\in \mathbb{R}^{n\times r}\) is the observer gain to be designed later. From (1a)–(1c) and (4), the error vector \(e(t)=x(t)- \hat{x}(t)\) can be expressed as
We introduce the following new state variable for convenience:
then we rewrite the systems (4) and (5) as
Next, we will analyze the stability of the observer system (4) and the error system (5). We aim at designing a gain matrix and a state-feedback matrix such that the error systems are asymptotically stable in the mean square. In the following theorem, we present a delay-dependent LMI condition for the observer design of the error systems with \(u(t)\equiv 0\).
Theorem 1
Consider the stochastic time-delay system (1a)–(1c) with \(u(t)\equiv 0\). The state observer has the form of (4). If there exist matrices \(P>0\), \(Q_{1}>0\), \(Q_{2}>0,N_{1},N_{2},N_{3},N_{4}\), and positive scalar \(\varepsilon >0\)satisfying the following linear matrix inequality (LMI):
with
then the error systems are asymptotically stable in the mean square, and the observer gain is given by \(L=P^{-1}Y\).
Proof
Let , . Now we choose a Lyapunov–Krasovskii functional candidate \(V(\hat{x}(t),e(t))\in C^{2,1}(\mathbb{R}^{n}\times \mathbb{R}_{+}; \mathbb{R}_{+})\) as follows:
By using Itô’s formula [32], we obtain the differential operator
By using the well-known Leibniz–Newton formula inequality, we have
Using the properties of stochastic integral, one has
Noticing Eq. (8), one has
Furthermore, we can also obtain the following two inequalities from Lemma 3:
Adding the left sides of Eqs. (12) and (13) to \(\mathcal{L}V(\hat{x}(t),e(t),t)\), combining with (14) and (15), we have
where
with
By applying the Schur decomposition result, we can see that \(\varSigma <0\) if and only if
with
Noting that pre- and post-multiplying by \(\operatorname{diag}\{I,I,I,I,I,I,P,P \}\) and considering the condition (2) (3), we can write the matrix inequality (18) as
with
Here, \(\bar{H}=[(H_{1})_{1,1},(H_{1})_{2,2},(H_{2})_{3,3},(H_{2})_{4,4},(H _{1})_{5,1},(H_{1})_{6,2},(H_{2})_{7,3},(H_{2})_{8,4}]\) denotes a block square matrix whose all nonzero blocks are the 11st block \(H_{1}\), the 21st block \(H_{2}, \ldots \) , the 84th block \(H_{2}\), and all other blocks are zero matrices, i.e.,
Similarly, \(\bar{G}=[(PG)_{2,1},(PG)_{2,2},(PG)_{2,3},(PG)_{2,4},(PG)_{8,5},(PG)_{8,6},(PG)_{8,7},(PG)_{8,8}]\), furthermore, \(\bar{F}(t)\) denotes a block diagonal matrix with diagonal blocks being the matrix \(F(t)\).
Let \(L=P^{-1}Y\). By utilizing Lemma 2 and the Schur decomposition result again, it follows that the matrix inequality (19) is implied by the LMI (9) for a scalar \(\varepsilon >0\), which guarantees that \(\mathbb{E}\mathcal{L}V(\hat{x}(t),e(t),t)<0\). Hence, the trivial solution of the error system is asymptotically stable in the mean square. □
Remark 2
A delay-dependent sufficient condition for the existence of the observer is given in Theorem 1. It is easy to see that the LMI condition in (9) is dependent on the length of delay and is less conservative than the delay-independent ones. The largest upper bound of the delay τ such that the LMI in (9) holds can be obtained by solving the following LMI problem:
Next, we consider the state-feedback-based controller problem for the stochastic time-delay systems (1a)–(1c). A delay-dependent LMI technique will be developed in order to obtain the state-feedback observer. The following theorem shows that the controller is reachable in the stochastic theory.
Theorem 2
Consider the uncertain stochastic time-delay system (1a)–(1c). The state observer has the form of (4). If there exist matrices \(P>0\), \(Q_{1}>0\), \(Q_{2}>0\), \(N_{1}\), \(N_{2}\), \(N_{3}\), \(N_{4}\), and positive scalars \(\varepsilon >0\), \(\sigma >0\)such that the following LMI is satisfied:
with
then the overall closed-loop stochastic time-delay system is asymptotically stable in the mean square. In this case, the observer gain is given by \(L=P^{-1}Y\)and an appropriate robust stabilizing state-feedback controller can be chosen as \(u(x)=K\hat{x}(t)\), \(K=\sigma ^{-1}B^{T}P\).
Proof
Applying the controller \(u(x)=\sigma ^{-1}B^{T}P\hat{x}(t)\) to the system (4), and similar to the proof of Theorem 1, we can obtain \(\mathbb{E}\mathcal{L}V(\hat{x}(t),e(t),t)<0\) if LMI (20) is satisfied. It implies that the trivial solution of the closed-loop system is asymptotically stable in the mean square. □
Theorem 2 provides a delay-dependent sufficient condition for the existence of the robust observer of uncertain stochastic time-delay systems by state feedback. A desired gain matrix and state-feedback controller can be obtained by solving the LMI (20).
Remark 3
In [33], the state estimation method is given for a class of stochastic systems, but the stochastic disturbance is independent on the system state. However, the stochastic disturbance of uncertain systems we investigated in this paper is state dependent. In [34], the disturbance–observer design method is given for time-delay uncertain systems, and the considered uncertainties do not contain stochastic disturbances by Brown motion. The systems in this paper include not only parameter uncertainties but also a stochastic disturbance, it is derived that the closed-loop system maintains good stability despite the presence of parameter uncertainties and a stochastic factor by Brown motion. Then the method of this paper has some advantage in convergence property, the proposed method can be applied to a more general class of nonlinear systems.
4 Simulation study
In order to illustrate the usefulness and flexibility of the theory developed in the above section, we present a simple numerical example in this section.
Example 1
We consider the uncertain stochastic time-delay system (1a)–(1c) with
Solving LMI (20) yields the maximum allowable bound of the time delay as \(\tau =0.4454\). This means that, for any time delay τ satisfying \(0<\tau \leq 0.4454\), there exist a gain matrix and a state-feedback matrix such that the resulting augmented system is asymptotically stable in the mean square. For this example, if we choose the time delay as \(\tau =0.2\), then, by using the Matlab control toolbox to solve the LMI (20), we obtain
By Theorem 2, we can obtain the desired gain matrix and state-feedback matrix as follows:
State response trajectories for the open-loop and closed-loop systems are given. Figure 1 is for the state response trajectories for the open-loop systems without uncertainties, Figs. 2–4 are the state response trajectories for the open-loop systems with uncertainties. We can see that the system is stable without parameter uncertainties and stochastic disturbances in Fig. 1, but from Figs. 2–4, the parameter uncertainties and stochastic disturbances makes the stability of the system decline. In [35], Higham gives a numerical simulation algorithm for the system with stochastic disturbances. Now, by using a similar approach, we take the initial parameters as \(x(t)=(1\ {-}1\ 0.5)^{T}\), \(\hat{x}(t)=(-1.5\ 1\ {-}1.5)^{T}\), \(t\in [-0.2,0]\), the simulation time \(t\in [0,T]\) with \(T=10\), \(\delta t=T/N\), with \(N=10^{4}\), step size \(\Delta t=R\delta t\) with \(R=5\). Figures 5–7 show the average trajectories over eight paths of \(x_{1}(t)\), \(x_{2}(t)\) and \(x_{3}(t)\) and their estimates, respectively. From the figures, we can see that the simulation result is satisfactory. The control performance of the state and parametric estimation is still very well despite the presence of the stochastic factor.
5 Conclusions
This article considers the estimation of the state vector of stochastic systems with time delay and parametrical uncertainty. The delay-dependent sufficient conditions for the existence of the observer are given. Also, the desired gain matrix and state-feedback controller are constructed by solving certain LMIs, which can be implemented by using the LMI control toolbox. Moreover, one can readily obtain the delay-dependent results on the existence of an observer for the uncertain stochastic time-delay system. The numerical example has demonstrated the effectiveness of the proposed method.
References
Xu, S.Y., Lam, J., Chen, T.W.: Robust \(H_{\infty }\) control for uncertain discrete stochastic time-delay systems. Syst. Control Lett. 51, 203–215 (2004)
Nowak, M., Sigmund, K.: The evolution of stochastic strategies in the prisoner’s dilemma. Acta Appl. Math. 20, 247–265 (1990)
Mao, X.R., Marion, G., Renshaw, E.: Environmental noise suppresses explosion in population dynamics. Stoch. Process. Appl. 97, 95–110 (2002)
Wan, L., Zhou, Q.H.: Stochastic Lotka–Volterra model with infinite delay. Stat. Probab. Lett. 79, 698–706 (2009)
Niu, Y.G., Ho, D.W.C., Lam, J.: Robust integral sliding mode control for uncertain stochastic systems with time-varying delay. Automatica 41, 873–880 (2005)
Wang, J., Li, C.: Stabilization of a class of stochastic systems with time delays. J. Appl. Math. (2014) https://doi.org/10.1155/2014/274681
Malek-Zavarei, M., Jamshidi, M.: Time Delay Systems: Analysis, Optimization and Applications. North Holland, Amsterdam (1987)
Luan, X., Liu, F., Shi, P.: Finite-time filtering for non-linear stochastic systems with partially known transition jump rates. IET Control Theory Appl. 45, 735–745 (2009)
He, Y., Wang, Q.G., Lin, C., Wu, M.: Delay-range-dependent stability for systems with time-varying delay. Automatica 43(2), 371–376 (2007)
Chen, L., Han, Z., Ma, Z.: Exponential stability for impulsive stochastic nonlinear network systems with time delay. J. Appl. Math. (2014) https://doi.org/10.1155/2014/787568
Sakthivel, R., Mathiyalagan, K., Marshal Anthoni, S.: Robust stability and control for uncertain neutral time delay systems. Int. J. Control 85, 373–383 (2012)
Lu, R., Li, H., Zhu, Y.: Quantized \(H_{\infty }\) filtering for singular time-varying delay systems with unreliable communication channel. Circuits Syst. Signal Process. 31(2), 521–538 (2012)
Sun, J., Liu, G.P., Chen, J., Rees, D.: Improved delay-range-dependent stability criteria for linear systems with time-varying delays. Automatica 46(2), 466–470 (2010)
Zhang, H., Liu, Z., Huang, G.B.: Novel delay-dependent robust stability analysis for switched neutral-type neural networks with time-varying delays via SC technique. IEEE Trans. Syst. Man Cybern., Part B, Cybern. 40(6), 1480–1491 (2010)
Zheng, C.D., Shan, Q.H., Zhang, H., Wang, Z.: On stabilization of stochastic Cohen–Grossberg neural networks with mode-dependent mixed time-delays and Markovian switching. IEEE Trans. Neural Netw. Learn. Syst. 24(5), 800–811 (2013)
Feng, Z.G., Lam, J., Gao, H.J.: α-Dissipativity analysis and synthesis of singular time-delay systems. Automatica 47, 2548–2552 (2011)
Feng, Z.G., Lam, J., Yang, G.H.: Optimal partitioning method for stability analysis of continuous/discrete delay systems. Int. J. Robust Nonlinear Control (2013). https://doi.org/10.1002/rnc.3106
Park, P.: A delay-dependent stability criterion for systems with uncertain time-invariant delays. IEEE Trans. Autom. Control 44, 876–877 (1999)
Moon, Y.S., Park, P., Kwon, W.H., Lee, Y.S.: Delay-dependent robust stabilization of uncertain state-delayed systems. Int. J. Control 74, 1447–1455 (2001)
Wang, Z.D., Huang, B., Unbehauen, H.: Robust \(H_{\infty }\) observer design of linear time-delay systems with parametric uncertainty. Syst. Control Lett. 42, 303–312 (2001)
Tong, S.C., Li, C.Y., Li, Y.M.: Fuzzy adaptive observer backstepping control for MIMO nonlinear systems. Fuzzy Sets Syst. 160(19), 2755–2775 (2009)
Liu, Y.G., Zhang, J.F.: Reduced-order observer-based control design for nonlinear stochastic systems. Syst. Control Lett. 52, 123–135 (2004)
Rathinasamy, S., Karimi, H.R., Raajananthini, K., et al.: Observer-based tracking control for switched stochastic systems based on a hybrid 2-D model. Int. J. Robust Nonlinear Control 28(2), 478–491 (2018)
Sakthivel, R., Susana Ramya, L., Selvaraj, P.: Observer-based state tracking control of uncertain stochastic systems via repetitive controller. Int. J. Control 48, 2272–2281 (2017)
Ma, H.J., Yang, G.H.: Filtering for a class of nonlinear MIMO uncertain time-delay stochastic systems. Int. J. Control 83(2), 432–440 (2010)
Jung, J., Huh, K., Lee, T.H.: Observer design methodology for stochastic and deterministic robustness. Int. J. Control 81(7), 1172–1192 (2008)
Niu, Y.G., Ho, D.W.C.: Robust observer design for Itô stochastic time-delay systems via sliding mode control. Syst. Control Lett. 55, 781–793 (2006)
Wang, C., Shen, Y.: Delay-range-dependent stability for uncertain stochastic systems with interval time-varying delay and nonlinear perturbations. Int. J. Comput. Math. 89(8), 983–997 (2012)
Boyd, S., Ghaoui, L., Feron, E., et al.: Linear Matrix Inequalities in System and Control Theory. Studies in Applied Mathematics. SIAM, Philadelphia (1994)
Raja, R., Anthoni, S.M.: Stability criteria for stochastic recurrent neural networks with two time-varying delays and impulses. Int. J. Comput. Appl. 1(28), 28–35 (2010)
Luenberger, D.G.: Observers for multi-variable systems. IEEE Trans. Autom. Control 11, 190–197 (1966)
Mao, X.R.: Stochastic Differential Equations and Applications. Horwood, Chichester (1997)
Xie, L., Khargonekar, P.P.: Lyapunov-based adaptive state estimation for a class of nonlinear stochastic systems. Automatica 48, 1423–1431 (2012)
Chen, M., Chen, W.H.: Disturbance-observer-based robust control for time delay uncertain systems. Int. J. Control. Autom. Syst. 8(2), 445–453 (2010)
Higham, D.: An algorithmic introduction to numerical simulation of stochastic differential equations. SIAM Rev. 43, 525–546 (2001)
Availability of data and materials
Data sharing not applicable to this article as no datasets were generated during the current study.
Funding
This research is supported by the Doctoral Research Fund of Harbin University of Commerce (2017BS011) and Young Innovative Talents Project of Harbin University of Commerce (2016QN047).
Author information
Authors and Affiliations
Contributions
All authors contributed equally to the writing of this paper. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflicts of interest
The authors declare that there is no conflict of interests regarding the publication of this article.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Miao, Xf., Li, Ls. New delay-dependent observer-based control for uncertain stochastic time-delay systems. J Inequal Appl 2019, 294 (2019). https://doi.org/10.1186/s13660-019-2241-1
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13660-019-2241-1