- Research
- Open Access
- Published:

# Analysis on control of a class of uncertain stochastic system by inequality technique

*Journal of Inequalities and Applications*
**volume 2020**, Article number: 132 (2020)

## Abstract

In this paper, some theoretical results of PID control of second order nonlinear uncertain stochastic system are given via inequalities. We extend the results of the corresponding deterministic systems to stochastic systems. Specifically, as long as we have a certain understanding of the upper bound of the derivative of the unknown nonlinear drift term and diffusion term, an analytic design method can be constructed for these three PID parameters to ensure the global stability and asymptotic stability of the closed-loop control systems. In addition, the numerical simulation results verify the theoretical analysis results.

## Introduction

The rapid development of control technology has an impact on every field of the control discipline. Although in the past half century, people have carried out extensive research on modern control theory, classic proportional integral differential (PID) control is still the most widely used and successful controller design method in all engineering systems [1, 2].

There are some reasons for the widely used of the PID controller: It does not need precise mathematical models and has a simple controller structure; it can not only eliminate steady state offsets via the integral action, but also anticipate the tendency through the derivative action; through the linear feedback mechanism, the influence of various uncertainties such as internal structure uncertainty and external interference can be reduced. On the contrary, the PID controller also has some shortcomings which cannot be ignored, for instance, the application of various advanced PID controls is not perfect, which is difficult to master by enterprise technicians. Specifically, one of the key problems in the realization of PID controller is how to choose three PID parameters, which are usually realized by experiment or experience. One of the famous PID parameter design methods is the Ziegler–Nichols rule. Naturally, with its extensive practical application, PID controllers have been widely studied in the academic fields, but most of them are for the linear deterministic system, less for the uncertain stochastic system [3–6].

In practical control engineering, due to the modeling error, environmental disturbances and other factors, a completely deterministic system usually does not exist. It has important theoretical and practical value to study the control of uncertain nonlinear systems. A stochastic nonlinear system is a kind of nonlinear system with stochastic dynamic characteristics, which has become one of the much-studied topics of nonlinear control theory in recent years. The effect of PID controller in the actual system is related to many factors. Therefore, in order to provide theoretical support for the design of PID parameters with excellent performance and improve the wide application of PID controller in engineering, the uncertain nonlinear stochastic dynamic system must be investigated [7–14].

Recently, Zhao and Guo investigated the PID control for uncertain nonlinear deterministic dynamic. They constructed a three-dimensional manifold within which the three PID parameters can be chosen arbitrarily to stabilize the nonlinear uncertain dynamical systems [15, 16]. Then Cong and Guo extended the results of [16] to stochastic system, they demonstrated the global stability and asymptotic regulation of the closed-loop control systems [17]. Motivated by these facts, we will further extend the results of [17]. By using upper bounds of the derivatives of both the nonlinear drift and the diffusion terms, we will construct a concrete three-dimensional manifold within which the three PID parameters can be chosen arbitrarily to globally stabilize the uncertain stochastic systems. We modified some inequalities to ensure that the results of our paper can be degenerated to the case of deterministic systems of [16] when the diffusion terms is zero. Also, the numerical simulation is given to verify the theoretical analysis results.

The remainder of the paper is organized as follows. Section 2 will give the preliminaries and problem description, Sect. 3 will present the main results together with mathematical proofs, Sect. 4 will show the numerical simulation results to verify the theoretical analysis results, and Sect. 5 will give the conclusion.

## Preliminaries

### Definition 2.1

\((\varOmega , \mathscr {F},P)\) is a probability space. When \(0\leq t< s<\infty \), family \(\{\mathscr {F}_{t}\}_{t\geq 0}\) is a filtration, and it satisfies the relation that \(\mathscr {F}_{t}\subset \mathscr {F}_{s}\subset \mathscr {F}\). For all \(t\geq 0\), the filtration is right continuous on the premise of expression that \(\mathscr {F}_{t}=\bigcap_{s>t}\mathscr {F}_{s}\). When the probability space is complete, if the filtration is right continuous and \(\mathscr {F}_{0}\) contains all *P*-null sets, then it is considered to satisfy the usual conditions [13].

Set *x* as the state of the system, \(x \in \mathbb{R}^{n}\), \(f \in \mathbb{R}^{n}\), \(g \in \mathbb{R}^{n}\), and \(B(t)\) is a Brownian motion, then a stochastic system defined by stochastic differential equation is as follows:

where the *f* term can be called a drift or a vector field, \(g(x(t),t)\) is called the diffusion coefficient, while the noise term \(g(x(t),t)\,\mathrm{d}B(t)\) is a model for uncertainty. Both the external random effect and the parameter fluctuation in the mathematical model may affect the uncertainty of the model.

### Ito’s Formula

([13])

Set \(0< h \leq \infty \). Using \(C^{2,1}(S_{h}\times R_{+};R_{+})\) to represent the family \(V(x,t)\) of all nonnegative functions defined on \(S_{h}\times R_{+}\), so that they can be continuously twice differentiable in *x* and once in *t*. Define the differential operator L as follows:

If L acts on a function \(V \in C^{2,1}(S_{h}\times R_{+};R_{+})\), then

If \(x(t)\in S_{h}\), then

where tr is the trace of the matrix, \(\mathrm{H}(V)=V_{x_{i}x_{j}}\) is the \(n \times n\) symmetric Hessian matrix.

## Main results

Let \(\{B(t)\}_{t\geq 0}\) be a standard Wiener process defined on a complete probability space \((\varOmega , \mathscr {F},P)\) with a natural filtration \(\{\mathscr {F}_{t}\}_{t\geq 0}\) satisfying the usual conditions (see Definition 2.1 in the Preliminaries).

The classical PID controller has the following standard form:

where \(k_{p}\), \(k_{i}\), \(k_{d}\) are the three controller parameters, \(e(t)=y(t)-y^{*} \in \mathbb{R}^{d}\) is the regulation error.

Consider the following class of second order nonlinear uncertain stochastic systems:

where \(u(t)\) denotes the input signals, \(x_{1}(0), x_{2}(0)\in \mathbb{R} \); \(f(x_{1},x_{2},t)\) and \(g (x_{1},x_{2},t)\) are both unknown nonlinear functions.

Two function spaces are defined as follows:

where \(C^{1}(\mathbb{R}^{2} \times \mathbb{R}^{+})\) represents the space of all functions from \(\mathbb{R}^{2} \times \mathbb{R}^{+}\) to \(\mathbb{R}\), which are locally Lipschitz in \((x_{1},x_{2})\) uniformly in *t*, piecewise continuous in *t*, continuous partial derivative in \((x_{1},x_{2})\), where \(L_{1}\), \(L_{2}\) and \(G_{1}\), \(G_{2}\) are known positive constants.

### Theorem 1

*Consider the PID controlled system* (2) *with any unknown functions*\(f \in \mathscr {F}_{L_{1},L_{2}}\)*and*\(g \in \mathscr {D}_{N_{1},N_{2}}\). *Assume*\(f(y,0,t)=f(y,0,0)\), \(g(y,0,t)=g(y,0,0)\), *and*\(g(y^{*},0,t)=0\)*for all*\(t\in \mathbb{R}^{+}\)*and*\(y\in \mathbb{R}\). *Then*, *for any*\(L_{1},L_{2}>0\)*and*\(G_{1},G_{2}>0\), *there exists a three*-*dimensional manifold*\(\varOmega _{\mathrm{pid}} \subset \mathbb{R}^{3}\), *the specific form is as follows*:

*when the controller parameters*\((k_{p},k_{i},k_{d})\)*are taken from*\(\varOmega _{\mathrm{pid}}\), *the closed*-*loop system* (2) *will be globally stable and asymptotically optimal under the conditions*

*and*

*for any initial value*\((x_{1}(0),x_{2}(0))\in \mathbb{R}^{2}\)*and any constant setpoint*\(y^{*} \in \mathbb{R}\).

### Remark 1

Obviously, the manifold \(\varOmega _{\mathrm{pid}}\) of the controller parameters is an infinite open set. Theorem 1 shows that the design of PID parameters has great flexibility and the PID control system has strong robustness to unknown nonlinear dynamics and random noise.

### Proof

*The first step*: We transform the control system (3) into a standard state space equation by introducing some symbols.

Denote \(x(t)=\int _{0}^{t} e(s)\,\mathrm{d}s+\frac{f(y^{*},0,0)}{k_{i}}\), \(y(t)=e(t)\), \(z(t) =\dot{e} (t)\), \(h_{1}(y,z,t)=-f(y^{*}-y,-z,t)+f(y^{*},0,t)\), \(h_{2}(y,z,t)=-g(y^{*}-y,-z,t) \) (see [16]), then (2) turns into

Here, \(h_{1}(y,z,t)\) and \(h_{2}(y,z,t)\) can be expressed as follows:

the functions \(q_{1}(y,t)\), \(p_{1}(y,z,t)\), \(q_{2}(y,t)\) and \(p_{2}(y,t)\) are defined as follows:

According to the mean value theorem and the definition of \(\mathscr {F}_{L_{1},L_{2}}\), obviously, for all *y*, *z*, *t*, the inequality \(|q_{1}(y,t)|\le L_{1}\), \(|p_{1}(y,z,t)|\le L_{2}\) can be established. This is so because, for all \(t\geq 0\) and \(y\in \mathbb{R}\), \(f(y,0,t)=f(y,0,0)\), obviously, \(q_{1}(y,t)=\frac{h_{1}(y,0,0)}{y}\) is merely a function of *y*, denoted henceforth by \(q_{1}(y)\), and \(q_{1}(\cdot)\) is continuous. Similarly, \(q_{2}(y,t)\) can be denoted by \(q_{2}(y)\), and \(|q_{2}(y)|\le G_{1}\), \(|p_{2}(y,z,t)|\le G_{2}\).

Hence, the closed-loop equation (6) can be rewritten as

where

*The second step*: The Lyapunov function is constructed now.

Denote \(\varPsi =\frac{\varPsi _{0}+\varPsi _{1}}{2}\), where \(\varPsi _{0}=\inf_{y,z,t } \{-p_{1}(y,z,t)+k_{d}\}\), \(\varPsi _{1}=\sup_{y,z,t} \{-p_{1}(y,z,t)+k_{d}\}\), and \(\varphi _{0}= \inf_{y} \varphi (y)\) where \(\varphi (y)=-q_{1}(y)+k_{p}\). Then \(\varphi _{0}\geq k_{p}-L_{1}>0\) and \(\varPsi _{0}\geq k_{d}-L_{2}>0\) under the condition of \(k_{p}>L_{1}\) and \(k_{d}>L_{2}+\frac{1}{2}G_{2}^{2}\).

Similar to the cases in [16] and [17], we continue to prove that the following quadratic form plus an integral term is indeed a stochastic Lyapunov function:

where the constant matrix *P* is

and \(\mu >0\) is a constant defined by

It can be proved that *p* is a positive definite matrix, so \(V(x,y,z)\) is a positive definite function, and it is radially unbounded in *x*, *y*, *z*.

*The third step*: We calculate the differential operator L (see the Preliminaries) associated with (7),

It is obvious that the first term on the right-hand side is zero, and the third term can be expressed as follows:

according to the definition of \(h_{2}(y,z,t)\) and the fact that Hessian matrix \(H(V)\) is *P*. Therefore, after analyzing the second item and considering the above third term, it can be found that

where \(Q(y,z,t)\) is a symmetric matrix, and the specific expression is

and we have

Now, we prove that \(Q(y,z,t)\) is actually positive definite for all \(y,z \in \mathbb{R}\) and \(t\in \mathbb{R}^{+}\).

Denote \(\alpha =-\frac{\mu }{2} [\varPsi +p_{1}(y,z,t)-k_{d}]\), \(\beta =-\mu -p_{1}(y,z,t)+k_{d}\), note that by the definitions of \(\varphi _{0}\), \(\varPsi _{0}\), \(\varPsi _{1}\), we have

here, the expressions \(\varPsi =\frac{\varPsi _{0}+\varPsi _{1}}{2}\) and \(|p_{1}(y,z,t)|\le L_{2}\) hold.

Therefore, by (9) and (10), the following inequalities can be obtained:

According to the above inequality and (9), the matrix \(Q(y,z,t)\) is positive definite for all *y*, *z*, *t*.

The minimum eigenvalue of \(Q(y,z,t)\) can be obtained as

Define \(\lambda (y)= \inf_{\alpha , \beta }\theta (y,\alpha , \beta )\), where the infimum is taken for all \(|\alpha -\frac{1}{2}p_{2}q_{2}|\le \frac{1}{2} \sqrt{\mu ^{2} L_{2}^{2}+G_{1}^{2}G_{2}^{2}+2| \mu L_{2}G_{1}G_{2}|}\) and \(-\mu +\varPsi _{0}\leq \beta \leq -\mu +\varPsi _{1}\).

We can derive that \(\lambda (\cdot)\) is a positive function of *y*, and \(\lambda (\cdot)\) is a continuous function by [16]. Further, by the boundedness of the function \(\varphi (y)\), there exists \(\underline{\lambda }>0\) such that \(\lambda (y)\geq \underline{\lambda }\).

Therefore, we have

*The fourth step*: By the Itô formula (see the Preliminaries), we have

We express the diffusion term as \(G(y,z,t)\), noting the definition of \(h_{2}(y,z,t)\), we have

Then, for any case where \(T > 0\), the following equation holds:

We wish to prove the following equation:

We need to prove the following inequality:

From the above expression of \(G(y,z,t)\) and the boundedness of \(q_{2}(y)\) and \(p_{2}(y,z,t)\), we can come to the following conclusion:

Therefore, by taking \(p=4\) in Theorem 4.1 in [13], we can get (14). So, considering the expectation on both sides of (13) and using Eq. (12), we get

Therefore, according to the definition of \(V(x,y,z)\) and the positive attribute of *P*, for all \(T \geq 0\), we get

and

Therefore, we get the global stability as follows:

this is expected result (4). In order to prove the optimality of the trace, we can get it by letting \(T\rightarrow \infty \) in (17),

*The fifth step*: We need to verify the uniform continuity of \(\mathrm{E}y^{2}(t)\) on \((0,\infty )\) in order to use the Barbalat lemma in Ref. [18], from which it can be concluded that \(\mathrm{E}y^{2}(t)\rightarrow 0\) when \(t\rightarrow \infty \).

First of all, according to the mean value theorem, there exists a random variable \(\bar{y} \in [y_{t_{1}},y_{t_{2}}]\) such that

By the Schwarz inequality, we have

There exists a constant \(M_{1}>0\) such that

According to the boundedness property (4), we know that there is a constant \(M_{2}>0\) such that

Finally, by using (19)–(21), we can get the following inequality:

*The sixth step*: We draw the conclusion that

Then the proof of Theorem 1 has been finished. □

## Simulation

We use a numerical simulation example to illustrate the theoretical results. We consider the following system:

We use the PID controller

such that \(x_{1}(t)\) converges to the given constant setpoint \(y^{*}\). The two function spaces \(\mathscr {F}_{L_{1},L_{2}}\) and \(\mathscr {D}_{G_{1},G_{2}}\) are defined in Sect. 3. The three-dimensional manifold \(\varOmega _{\mathrm{pid}} \subset \mathbb{R}^{3}\) can be found in Eq. (3) of Sect. 3.

Let: \(L_{1} = 5\) and \(L_{2} = 5\), \(G_{1} = 2\) and \(G_{2} = 1\), the domain of the set \(\varOmega _{\mathrm{pid}}\) is restricted to \(0 \le k_{p}\), \(k_{i},k_{d} \le 50\). Then Fig. 1 shows the graphic display of the three-dimensional manifold.

## Conclusion

The theory and the design method of the PID controller for a class of second order nonlinear uncertain stochastic system are given in this paper. We have shown that as long as the upper bounds of the derivative of the nonlinear uncertain diffusion and drift functions are valid, the global stability and asymptotic regulation of the closed-loop stochastic control system can be guaranteed by constructing a three-dimensional manifold within which the three PID parameters can be chosen arbitrarily. Also, when the diffusion term is zero, it can be degenerated to the case of deterministic systems of [16]. Furthermore, the numerical simulation is given to verify the theoretical analysis results.

## References

- 1.
Åström, K.J., Hägglund, T.: Automatic tuning of simple regulators with specifications on phase and amplitude margins. Automatica

**20**, 645–651 (1984) - 2.
Åström, K.J., Hägglund, T.: PID Controllers: Theory, Design and Tuning. International Society of America, Pittsburgh (1995)

- 3.
Killingsworth, N.J., Krstic, M.: PID tuning using extremum seeking: online, model-free performance optimization. IEEE Control Syst.

**26**, 70–79 (2006) - 4.
Voda, A.A., Landau, I.D.: A method for the auto-calibration of PID controllers. Automatica

**31**, 41–53 (1995) - 5.
Jun, M., Safonov, M.G.: Automatic pid tuning: an application of unfalsified control. In: Proc. of IEEE International Symposium on CACSD, Hawaii, pp. 328–333 (1999)

- 6.
Keel, L.H., Bhattacharyya, S.P.: Controller synthesis free of analytical models: three term controllers. IEEE Trans. Autom. Control

**53**, 1353–1369 (2008) - 7.
Krstć, M., Kanellakopoulos, I., Kokotović, P.: Nonlinear and Adaptive Control Design. A Wiley-Interscience Publication. Wiley, New York (1995)

- 8.
Øksendal, B.: Stochastic Differential Equations. Springer, Berlin (2005)

- 9.
Liu, Y.G., Zhang, J.F.: Practical output-feedback risk-sensitive control for stochastic nonlinear systems with stable zero-dynamics. SIAM J. Control Optim.

**45**, 885–926 (2006) - 10.
Koralov, L.B., Sinai, Y.G.: Theory of Probability and Random Processes. Springer, Heidelberg (2007)

- 11.
Diwadkar, A., Vaidya, U.: Synchronization in large-scale nonlinear network systems with uncertain links. Automatica

**100**, 194–199 (2019) - 12.
Koralov, L.B., Sinai, Y.G.: An Introduction to Stochastic Dynamics. Science Press, Beijing (2015)

- 13.
Mao, X.R.: Stochastic Differential Equations and Applications. Horwood, Chichester (2008)

- 14.
Khasminskii, R.: Stochastic Stability of Differential Equations. Springer, Heidelberg (2012)

- 15.
Zhao, C., Guo, L.: On the capability of PID control for nonlinear uncertain systems. In: Proc. 20th IFAC World Congress, pp. 9–14 (2017)

- 16.
Zhao, C., Guo, L.: PID controller design for second order nonlinear uncertain systems. Sci. China Inf. Sci.

**60**, Article number: 022201 (2017) - 17.
Cong, X.R., Guo, L.: PID control for a class of nonlinear uncertain stochastic systems. In: IEEE 56th Annual Conference on Decision and Control, 2017, Melbourne, Australia (2017)

- 18.
Reissig, R., Sansone, G., Conti, R.: Non-linear Differential Equations of Higher Order. Springer, Heidelberg (1974)

### Acknowledgements

Not applicable.

### Availability of data and materials

Data sharing not applicable to this article as no datasets were generated during the current study.

## Funding

Not applicable.

## Author information

### Affiliations

### Contributions

All authors read and approved the final manuscript.

### Corresponding author

## Ethics declarations

### Competing interests

The authors declare that they have no competing interests.

## Rights and permissions

**Open Access** This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

## About this article

### Cite this article

Lu, Q., Li, L. Analysis on control of a class of uncertain stochastic system by inequality technique.
*J Inequal Appl* **2020, **132 (2020). https://doi.org/10.1186/s13660-020-02400-1

Received:

Accepted:

Published:

### Keywords

- Stochastic system
- Inequality
- Global stability