Analysis on control of a class of uncertain stochastic system by inequality technique

In this paper, some theoretical results of PID control of second order nonlinear uncertain stochastic system are given via inequalities. We extend the results of the corresponding deterministic systems to stochastic systems. Specifically, as long as we have a certain understanding of the upper bound of the derivative of the unknown nonlinear drift term and diffusion term, an analytic design method can be constructed for these three PID parameters to ensure the global stability and asymptotic stability of the closed-loop control systems. In addition, the numerical simulation results verify the theoretical analysis results.


Introduction
The rapid development of control technology has an impact on every field of the control discipline. Although in the past half century, people have carried out extensive research on modern control theory, classic proportional integral differential (PID) control is still the most widely used and successful controller design method in all engineering systems [1,2].
There are some reasons for the widely used of the PID controller: It does not need precise mathematical models and has a simple controller structure; it can not only eliminate steady state offsets via the integral action, but also anticipate the tendency through the derivative action; through the linear feedback mechanism, the influence of various uncertainties such as internal structure uncertainty and external interference can be reduced. On the contrary, the PID controller also has some shortcomings which cannot be ignored, for instance, the application of various advanced PID controls is not perfect, which is difficult to master by enterprise technicians. Specifically, one of the key problems in the realization of PID controller is how to choose three PID parameters, which are usually realized by experiment or experience. One of the famous PID parameter design methods is the Ziegler-Nichols rule. Naturally, with its extensive practical application, PID controllers have been widely studied in the academic fields, but most of them are for the linear deterministic system, less for the uncertain stochastic system [3][4][5][6].
In practical control engineering, due to the modeling error, environmental disturbances and other factors, a completely deterministic system usually does not exist. It has impor-tant theoretical and practical value to study the control of uncertain nonlinear systems. A stochastic nonlinear system is a kind of nonlinear system with stochastic dynamic characteristics, which has become one of the much-studied topics of nonlinear control theory in recent years. The effect of PID controller in the actual system is related to many factors. Therefore, in order to provide theoretical support for the design of PID parameters with excellent performance and improve the wide application of PID controller in engineering, the uncertain nonlinear stochastic dynamic system must be investigated [7][8][9][10][11][12][13][14].
Recently, Zhao and Guo investigated the PID control for uncertain nonlinear deterministic dynamic. They constructed a three-dimensional manifold within which the three PID parameters can be chosen arbitrarily to stabilize the nonlinear uncertain dynamical systems [15,16]. Then Cong and Guo extended the results of [16] to stochastic system, they demonstrated the global stability and asymptotic regulation of the closed-loop control systems [17]. Motivated by these facts, we will further extend the results of [17]. By using upper bounds of the derivatives of both the nonlinear drift and the diffusion terms, we will construct a concrete three-dimensional manifold within which the three PID parameters can be chosen arbitrarily to globally stabilize the uncertain stochastic systems. We modified some inequalities to ensure that the results of our paper can be degenerated to the case of deterministic systems of [16] when the diffusion terms is zero. Also, the numerical simulation is given to verify the theoretical analysis results.
The remainder of the paper is organized as follows. Section 2 will give the preliminaries and problem description, Sect. 3 will present the main results together with mathematical proofs, Sect. 4 will show the numerical simulation results to verify the theoretical analysis results, and Sect. 5 will give the conclusion.

Preliminaries
Definition 2.1 (Ω, F , P) is a probability space. When 0 ≤ t < s < ∞, family {F t } t≥0 is a filtration, and it satisfies the relation that F t ⊂ F s ⊂ F . For all t ≥ 0, the filtration is right continuous on the premise of expression that F t = s>t F s . When the probability space is complete, if the filtration is right continuous and F 0 contains all P-null sets, then it is considered to satisfy the usual conditions [13]. Set x as the state of the system, x ∈ R n , f ∈ R n , g ∈ R n , and B(t) is a Brownian motion, then a stochastic system defined by stochastic differential equation is as follows: where the f term can be called a drift or a vector field, g(x(t), t) is called the diffusion coefficient, while the noise term g(x(t), t) dB(t) is a model for uncertainty. Both the external random effect and the parameter fluctuation in the mathematical model may affect the uncertainty of the model.

Ito's Formula
of all nonnegative functions defined on S h × R + , so that they can be continuously twice differentiable in x and once in t. Define the differential operator L as follows: .
where tr is the trace of the matrix, H(V ) = V x i x j is the n × n symmetric Hessian matrix.

Main results
Let {B(t)} t≥0 be a standard Wiener process defined on a complete probability space (Ω, F , P) with a natural filtration {F t } t≥0 satisfying the usual conditions (see Definition 2.1 in the Preliminaries). The classical PID controller has the following standard form: where k p , k i , k d are the three controller parameters, e(t) = y(t)y * ∈ R d is the regulation error.
Consider the following class of second order nonlinear uncertain stochastic systems: where u(t) denotes the input signals, x 1 (0), x 2 (0) ∈ R; f (x 1 , x 2 , t) and g(x 1 , x 2 , t) are both unknown nonlinear functions.
Two function spaces are defined as follows: where C 1 (R 2 × R + ) represents the space of all functions from R 2 × R + to R, which are locally Lipschitz in (x 1 , x 2 ) uniformly in t, piecewise continuous in t, continuous partial derivative in (x 1 , x 2 ), where L 1 , L 2 and G 1 , G 2 are known positive constants.
Theorem 1 Consider the PID controlled system (2) with any unknown functions f ∈ F L 1 ,L 2 and g ∈ D N 1 ,N 2 . Assume f (y, 0, t) = f (y, 0, 0), g(y, 0, t) = g(y, 0, 0), and g(y * , 0, t) = 0 for all t ∈ R + and y ∈ R. Then, for any L 1 , L 2 > 0 and G 1 , G 2 > 0, there exists a three-dimensional manifold Ω pid ⊂ R 3 , the specific form is as follows: when the controller parameters (k p , k i , k d ) are taken from Ω pid , the closed-loop system (2) will be globally stable and asymptotically optimal under the conditions and for any initial value (x 1 (0), x 2 (0)) ∈ R 2 and any constant setpoint y * ∈ R.
Remark 1 Obviously, the manifold Ω pid of the controller parameters is an infinite open set. Theorem 1 shows that the design of PID parameters has great flexibility and the PID control system has strong robustness to unknown nonlinear dynamics and random noise.
Hence, the closed-loop equation (6) can be rewritten as where F(x, y, z, t) = -k i x + q 1 (y)k p y + p 1 (y, z, t)k d z.
The second step: The Lyapunov function is constructed now. Denote Ψ = Ψ 0 +Ψ 1 2 , where Ψ 0 = inf y,z,t {-p 1 (y, z, t) + k d }, Ψ 1 = sup y,z,t {-p 1 (y, z, t) + k d }, and ϕ 0 = inf y ϕ(y) where ϕ(y) = -q 1 (y) + k p . Then ϕ 0 ≥ k p -L 1 > 0 and Ψ 0 ≥ k d -L 2 > 0 under the condition of k p > L 1 and k d > L 2 + 1 2 G 2 2 . Similar to the cases in [16] and [17], we continue to prove that the following quadratic form plus an integral term is indeed a stochastic Lyapunov function: where the constant matrix P is and μ > 0 is a constant defined by It can be proved that p is a positive definite matrix, so V (x, y, z) is a positive definite function, and it is radially unbounded in x, y, z.
The third step: We calculate the differential operator L (see the Preliminaries) associated with (7), It is obvious that the first term on the right-hand side is zero, and the third term can be expressed as follows: according to the definition of h 2 (y, z, t) and the fact that Hessian matrix H(V ) is P. Therefore, after analyzing the second item and considering the above third term, it can be found that where Q(y, z, t) is a symmetric matrix, and the specific expression is and we have Now, we prove that Q(y, z, t) is actually positive definite for all y, z ∈ R and t ∈ R + . Denote α = -μ 2 [Ψ + p 1 (y, z, t)k d ], β = -μp 1 (y, z, t) + k d , note that by the definitions of ϕ 0 , Ψ 0 , Ψ 1 , we have -μ + Ψ 1 -1 2 p 2 2 (y, z, t) ≥ β - here, the expressions Ψ = Ψ 0 +Ψ 1 2 and |p 1 (y, z, t)| ≤ L 2 hold. Therefore, by (9) and (10), the following inequalities can be obtained: According to the above inequality and (9), the matrix Q(y, z, t) is positive definite for all y, z, t. The minimum eigenvalue of Q(y, z, t) can be obtained as λ min Q(y, z, t) = θ (y, α, β) Define λ(y) = inf α,β θ (y, α, β), where the infimum is taken for all |α -1 2 p 2 q 2 | ≤ 1 2 × μ 2 L 2 2 + G 2 1 G 2 2 + 2|μL 2 G 1 G 2 | and -μ + Ψ 0 ≤ β ≤ -μ + Ψ 1 . We can derive that λ(·) is a positive function of y, and λ(·) is a continuous function by [16]. Further, by the boundedness of the function ϕ(y), there exists λ > 0 such that λ(y) ≥ λ.
Then, for any case where T > 0, the following equation holds: We wish to prove the following equation: We need to prove the following inequality: From the above expression of G(y, z, t) and the boundedness of q 2 (y) and p 2 (y, z, t), we can come to the following conclusion: Therefore, by taking p = 4 in Theorem 4.1 in [13], we can get (14). So, considering the expectation on both sides of (13) and using Eq. (12), we get Therefore, according to the definition of V (x, y, z) and the positive attribute of P, for all T ≥ 0, we get and Therefore, we get the global stability as follows: this is expected result (4). In order to prove the optimality of the trace, we can get it by letting T → ∞ in (17), The fifth step: We need to verify the uniform continuity of Ey 2 (t) on (0, ∞) in order to use the Barbalat lemma in Ref. [18], from which it can be concluded that Ey 2 (t) → 0 when t → ∞.
By the Schwarz inequality, we have There exists a constant M 1 > 0 such that According to the boundedness property (4), we know that there is a constant M 2 > 0 such that Finally, by using (19)-(21), we can get the following inequality: The sixth step: We draw the conclusion that Then the proof of Theorem 1 has been finished.

Simulation
We use a numerical simulation example to illustrate the theoretical results. We consider the following system: We use the PID controller such that x 1 (t) converges to the given constant setpoint y * . The two function spaces F L 1 ,L 2 and D G 1 ,G 2 are defined in Sect. 3. The three-dimensional manifold Ω pid ⊂ R 3 can be found in Eq. (3) of Sect. 3. Let: L 1 = 5 and L 2 = 5, G 1 = 2 and G 2 = 1, the domain of the set Ω pid is restricted to 0 ≤ k p , k i , k d ≤ 50. Then Fig. 1 shows the graphic display of the three-dimensional manifold.

Conclusion
The theory and the design method of the PID controller for a class of second order nonlinear uncertain stochastic system are given in this paper. We have shown that as long as the upper bounds of the derivative of the nonlinear uncertain diffusion and drift functions are valid, the global stability and asymptotic regulation of the closed-loop stochastic control system can be guaranteed by constructing a three-dimensional manifold within which the three PID parameters can be chosen arbitrarily. Also, when the diffusion term is zero, it can be degenerated to the case of deterministic systems of [16]. Furthermore, the numerical simulation is given to verify the theoretical analysis results.