Skip to main content

Riemann–Liouville fractional stochastic evolution equations driven by both Wiener process and fractional Brownian motion

Abstract

This article is devoted to the study of the existence and uniqueness of mild solution to a class of Riemann–Liouville fractional stochastic evolution equations driven by both Wiener process and fractional Brownian motion. Our results are obtained by using fractional calculus, stochastic analysis, and the fixed-point technique. Moreover, an example is provided to illustrate the application of the obtained abstract results.

1 Introduction

Fractional calculus has gained considerable popularity during the past decades since it has been recognized as one of the best tools to model physical systems possessing long-term memory and long-range spatial interactions, which also plays an important role in diverse areas of science and engineering, as well as other applied sciences. As a result of the intensive development of fractional calculus, there has been a significant breakthrough in theoretical analysis and applications of fractional differential equations in the literature [8, 14, 15, 17, 23]. In recent decades, the existence and uniqueness of mild solutions, as well as controllability for fractional differential equations with Caputo fractional derivative, have attracted much attention. We can refer to [13, 11, 13, 16, 1820, 24, 25] and the references therein.

It is worth mentioning that by applying Laplace transform and probability density functions, Zhou et al. [26] gave a suitable concept of mild solutions for a class of Riemann–Liouville fractional evolution equations with nonlocal conditions. Li et al. [10] considered the Cauchy problems for fractional differential equations with Riemann–Liouville fractional derivatives by using the α-resolvent operator. Yang and Wang [22] investigated the approximate controllability of Riemann–Liouville fractional differential inclusions. For more details about the existence of mild solutions of Riemann–Liouville fractional differential equations, one can refer to [12, 20]. On the other hand, Ahmed and El-Borai [1] studied Hilfer fractional stochastic integro-differential equations. We can refer to [57] for more details about the existence of mild solutions and approximate controllability of Hilfer fractional differential equations and inclusions.

As an generalization of Brownian motion, fractional Brownian motion has received a lot of attention in the recent years, which as we know is a Gaussian process with self-similarity and stationary increments, as well as long-range dependence properties. When Hurst parameter \(H \in (0,\frac{1}{2})\), fractional Brownian motion is neither a semimartingale nor a Markov process. Hence, the classical stochastic analysis techniques are invalid to study it. Recently, the research of stochastic differential equations driven by fractional Brownian motion has been investigated by many authors, see [4, 9, 21, 28] and the references therein.

However, we would like to emphasize that it is natural and also important to study the existence of mild solutions for Riemann–Liouville fractional stochastic evolution equations driven by both Wiener process and fractional Brownian motion since it has not yet been sufficiently studied in contrast with the integer-order case. In this paper we are concerned with the following Riemann–Liouville fractional stochastic evolution equations with nonlocal conditions driven by both Wiener process and fractional Brownian motion:

$$ \textstyle\begin{cases} {} ^{L}\mathcal{D}^{\alpha }[x(t)-h(t,x(t))] = Ax(t)+F(t,x(t)) \frac{d\omega (t)}{dt} \\\hphantom{{} ^{L}\mathcal{D}^{\alpha }[x(t)-h(t,x(t))] =} {} +\sigma (t) \frac{dB_{Q}^{H}(t)}{dt}, \quad t\in J{'}=(0,b], \\ \mathcal{I}_{0^{+}}^{1-\alpha }[x(0)-g(x)]=x_{0}\in X, \end{cases} $$
(1.1)

where \({}^{L}\mathcal{D}_{t}^{\alpha }\) denotes the Riemann–Liouville fractional derivative in time defined for \(\frac{1}{2}<\alpha <1\), \(\mathcal{I}^{\alpha }\) is the temporal Riemann–Liouville fractional integral operator of order α; \(x(\cdot )\) takes values in a separable Hilbert space X, A is the infinitesimal generator of an analytic semigroup \(\{S(t)\}_{t\geq 0}\) on a real separable Hilbert space X with inner product \(\langle \cdot , \cdot \rangle \) and norm \(\Vert \cdot \Vert \). Assume K to be another separable Hilbert space with inner product \(\langle \cdot , \cdot \rangle \) and norm \(\Vert \cdot \Vert _{K}\). Let \(L(K,X)\) denote the space of all bounded linear operators from K to X, \(h: J\times X\rightarrow X\) and \(F: J\times X\rightarrow L(K,X)\) be functions satisfying some specific assumptions given in (\(\mathrm{H}_{2}\))–(\(\mathrm{H}_{3}\)); \(\{\omega (t)\}_{t\geq 0}\) is a given K-valued Wiener process with a finite trace nuclear covariance operator \(Q>0\) defined on the filtered complete probability space \((\Omega ,\mathcal{F},P)\); \(B^{H}\) is a fractional Brownian motion with Hurst parameter \(H \in (\frac{1}{2}, 1)\). The initial data \(x_{0}\) is an \(\mathcal{F}_{0}\)-measurable, stochastic process independent of the Wiener process ω and fBm \(B^{H}(t)\) with finite second moment.

A brief outline of this paper is given as follows. In Sect. 2, we recall some notations and preliminaries about fractional Brownian motion and fractional calculus. Using the fixed point theorem, Sect. 3 establishes the existence of mild solutions for system (1.1). In Sect. 4, we will give an example to illustrate the application of the obtained abstract results. Conclusions and discussions are given in the final section.

2 Preliminaries

In this section, we first present some notations, definitions, and preliminary facts.

We first recall some basic facts about fBm and the Wiener integral with respect to fBm. Let \((\Omega ,\mathcal{F},P)\) be a complete probability space. We choose a time interval \(J=[0, b]\) with arbitrary fixed horizon b, assume \(\{B^{H}(t), t \in J\}\) to be a one-dimensional fractional Brownian motion with Hurst parameter \(H\in (0,1)\). The definition implies that \(B^{H}\) is a continuous and centered Gaussian process with covariance function

$$ R_{H}(s,t)=\frac{1}{2} \bigl(t^{2H}+s^{2H}- \vert t-s \vert ^{2H} \bigr). $$

In what follows, we always assume \(\frac{1}{2}< H<1\). Consider the square integrable kernel

$$ K_{H}(s,t)=c_{H}s^{\frac{1}{2}-H} \int _{s}^{t}(u-s)u^{H-\frac{1}{2}}\,du, $$

where \(c_{H}=[\frac{H(2H-1)}{\beta (2-2H,H-\frac{1}{2})}]^{\frac{1}{2}}\), \(t>s\). Then we have

$$ \frac{\partial K_{H}}{\partial t}(t,s)=c_{H} \biggl(\frac{t}{s} \biggr)^{H- \frac{1}{2}}(t-s)^{H-\frac{3}{2}}. $$

We will denote by \(\mathcal{H}\) the reproducing kernel Hilbert space of the fBm. In fact, \(\mathcal{H}\) is the closure of the linear space of indicator functions \(\{I_{[0, t]}, t \in [0, T]\}\) with respect to the scalar product

$$ \langle I_{[0,t]},I_{[0,s]}\rangle _{\mathcal{H}}=R_{H}(t,s). $$

The mapping \(I_{[0,t]}\rightarrow {B^{H}(t)}\) can be extended to an isometry between \(\mathcal{H}\) and the first Wiener chaos, and we denote by \(B^{H}(\varphi )\) the image of φ under this isometry.

Set \(K_{H}^{*}\) be the linear operator from \(\mathcal{H}\) to \(L^{2}([0,b])\) defined by

$$ \bigl(K_{H}^{*}\varphi \bigr) (s)= \int _{s}^{t}\varphi (t) \frac{\partial K_{H}}{\partial t}(t,s)\,dt. $$

Recall that the operator \(K_{H}^{*}\) is an isometry between \(\mathcal{H}\) and \(L^{2}([0,b])\).

Let the process \(\omega =\omega (t)\), \(t\in [0,b]\) be defined by

$$ \omega (t)=B^{H} \bigl( \bigl(K_{H}^{*} \bigr)^{-1}I_{[0,b])} \bigr). $$

Then ω is a Wiener process, while \(B^{H}\) has the integral representation

$$ B^{H}(t)= \int _{0}^{t}K_{H}(t,s)\,d\omega (s). $$

We recall that for φ, ψ on \([0,b]\), their scalar product in \(\mathcal{H}\) is given by

$$ \langle \varphi ,\psi \rangle _{\mathcal{H}}=\alpha _{H} \int _{0}^{b} \int _{0}^{b}\varphi (r)\psi (u) \vert r-u \vert ^{2H-2}\,du\,dr< \infty , $$

where \(\alpha _{H}=H(2H-1)\).

The embedding relationship is as follows [21]:

$$ L^{1} \bigl([0,b] \bigr)\subset L^{\frac{1}{\mathcal{H}}}\subset \vert \mathcal{H} \vert \subset \mathcal{H}. $$

Assume that Y is a real separable Hilbert space. Suppose that there exists a complete orthogonal system \(\{e_{n}\}_{n=1}^{\infty }\) in Y. Let \(Q\in L(Y,Y)\) be an operator with finite trace \(\operatorname{Tr}Q=\sum_{n=1}^{\infty }\lambda _{n}<\infty \) (\(\lambda _{n} \geq 0\)) such that \(Qe_{n}=\lambda _{n} e_{n}\). By using the covariance operator Q, the infinite-dimensional fBM on Y can be defined as

$$ B^{H}(t)=B_{Q}^{H}(t)=\sum _{n=1}^{\infty }\sqrt{\lambda _{n}} \varphi e_{n}B_{n}^{H}(t), $$

where \(B_{n}^{H}(t)\) are one-dimensional standard fractional Brownian motions mutually independent on \((\Omega ,\mathcal{F},P)\). Assume that the space \(\mathcal{L}_{2}^{0}:=\mathcal{L}_{2}^{0}(Y,X)\) consists of all Q-Hilbert–Schmidt operators \(\varphi :Y\rightarrow X\). Recall that \(\varphi \in L(Y,X)\) is called a Q-Hilbert–Schmidt operator if

$$ \Vert \varphi \Vert _{\mathcal{L}_{2}^{0}}^{2}:=\sum _{n=1}^{\infty } \Vert \sqrt{\lambda _{n}}\varphi e_{n} \Vert ^{2}< \infty , $$
(2.1)

and that the space \(\mathcal{L}_{2}^{0}\) equipped with the inner product \(\langle \varphi ,\psi \rangle _{\mathcal{L}_{2}^{0}}=\sum_{n=1}^{ \infty }\langle \varphi e_{n},\psi e_{n}\rangle \) is a separable Hilbert space.

Let \((\phi (s))_{s\in [0,b]}\) be a deterministic function with values in \(\mathcal{L}_{2}^{0}(Y,X)\). The stochastic integral of ϕ with respect to \(B^{H}\) is defined as

$$ \int _{0}^{t}\phi (s)\,dB^{H}(s)=\sum _{n=1}^{\infty } \int _{0}^{t} \sqrt{\lambda _{n}} \bigl(K_{H}^{*}(\phi e_{n}) \bigr) (s)\,dB_{n}(s). $$

Lemma 2.1

([4])

If \(\varphi :[0,b]\rightarrow \mathcal{L}_{2}^{0}(Y,X)\) satisfies \(\int _{0}^{b}\Vert \varphi (s)\Vert ^{2}_{\mathcal{L}_{2}^{0}}\,ds<\infty \), then the aforementioned sum in (2.1) is well defined as an X-valued random variable, and we have

$$ E \biggl\Vert \int _{0}^{t}\varphi (s)\,dB^{H}(s) \biggr\Vert ^{2}\leq c_{0}H(2H-1)t^{2H-1} \int _{0}^{t} \bigl\Vert \varphi (s) \bigr\Vert _{\mathcal{L}_{2}^{0}}^{2}\,ds. $$

We next denote by \(\mathcal{L}_{2}(\Omega ,X)\) the collection of all strongly-measurable, square-integrable, X-valued random variables. Obviously, \(\mathcal{L}_{2}(\Omega ,X)\) is a Banach space equipped with norm \(\Vert x(\cdot )\Vert _{\mathcal{L}_{2}(\Omega ,X)}=(E\vert x(\cdot )\vert )^{ \frac{1}{2}}\). Let \(C(J,\mathcal{L}_{2}(\Omega ,X))\) denote the Banach space of all X-valued continuous functions from \(J=[0,b]\) into \(\mathcal{L}_{2}(\Omega ,X)\) satisfying \(\sup_{t\in J}\Vert x(t)\Vert ^{2}<\infty \). Let \(J{'}=(0,b]\). To define the mild solution of system (1.1), we also need to consider the Banach space \(C_{\alpha }(J,X)=\{x:t^{1-\alpha }x(t)\in C(J,\mathcal{L}_{2}(\Omega ,X)) \}\) with the norm

$$ \Vert x \Vert _{C_{\alpha }}= \Bigl(\sup_{t\in J} E \bigl\Vert t^{1-\alpha }x(t) \bigr\Vert ^{2} \Bigr)^{ \frac{1}{2}}. $$

Throughout this paper, we assume that \(0\in \rho (A)\) where \(\rho (A)\) denotes the resolvent set of A. Then it is possible for us to define the fractional power \(A^{\eta }\) as a closed linear operator on its domain \(D(A^{\eta })\) for \(0<\eta \leq 1\) (see [25]). For an analytic semigroup \(\{S(t)\}_{t\geq 0}\), the following properties hold:

  1. (i)

    There exists \(M\geq 1\) such that

    $$\begin{aligned} M:=\sup_{t\in [0,+\infty )}S(t)< \infty ; \end{aligned}$$
  2. (ii)

    For \(\forall \eta \in (0,1]\), there exists a positive constant \(C_{\eta }\) such that

    $$\begin{aligned} \bigl\Vert A^{\eta }S(t) \bigr\Vert \leq \frac{C_{\eta }}{t^{\eta }}, \quad 0< t \leq b. \end{aligned}$$

For further convenience, set

$$\begin{aligned} \mathcal{S}_{\alpha }(t)x= \int _{0}^{\infty }\phi _{\alpha }(\theta )S \bigl(t^{ \alpha }\theta \bigr)x\,d\theta ,\quad\quad \mathcal{P}_{\alpha }(t)x= \int _{0}^{ \infty }\alpha \theta \phi _{\alpha }( \theta )S \bigl(t^{\alpha }\theta \bigr)x\,d \theta , \end{aligned}$$

where

$$\begin{aligned} \phi _{\alpha }(\theta )=\frac{1}{\alpha }\theta ^{-1-\frac{1}{\alpha }} \psi _{\alpha } \bigl(\theta ^{\frac{-1}{\alpha }} \bigr), \end{aligned}$$

which involves the Wright-type function

$$\begin{aligned} \psi _{\alpha }(\theta )=\frac{1}{\pi }\sum_{n=1}^{\infty }(-1)^{n-} \theta ^{-\alpha n-1} \frac{\Gamma (n\alpha +1)}{n!}\sin (n\pi \alpha ), \quad \theta \in (0,\infty ), \end{aligned}$$

connected with the following one-sided stable probability function: \(\phi _{\alpha }(\theta )\geq 0\), \(\theta \in (0,\infty )\) and \(\int _{0}^{\infty }\phi _{\alpha }(\theta )\,d\theta =1\).

Lemma 2.2

([23])

The operators \(\mathcal{S}_{\alpha }\) and \(\mathcal{P}_{\alpha }\) have the following properties:

  1. (i)

    For any fixed \(t\geq 0,\mathcal{S}_{\alpha }(t)\) and \(\mathcal{P}_{\alpha }(t)\) are linear and bounded operators, i.e., for any \(x\in X\),

    $$\begin{aligned}& \bigl\Vert \mathcal{S}_{\alpha }(t)x \bigr\Vert \leq M \Vert x \Vert \quad \textit{and}\quad \bigl\Vert \mathcal{P}_{\alpha }(t)x \bigr\Vert \leq \frac{M}{\Gamma (\alpha )} \Vert x \Vert . \end{aligned}$$
  2. (ii)

    \(\{\mathcal{S}_{\alpha }(t)\}_{t\geq 0}\) and \(\{\mathcal{P}_{\alpha }(t)\}_{t\geq 0}\) are strongly continuous.

  3. (iii)

    For every \(t>0\), \(\mathcal{S}_{\alpha }(t)\) and \(\mathcal{P}_{\alpha }(t)\) are also compact operators if \(S(t), t>0\) is compact.

Lemma 2.3

([25, 27])

For any \(t > 0\) and \(0 \leq \gamma < 1\), there exists a positive constant \(C_{\gamma }\) such that

$$ A\mathcal{P}_{\alpha }(t)x=A^{1-\gamma }\mathcal{P}_{\alpha }(t)A^{ \gamma }x $$

and

$$ \bigl\Vert A^{\gamma }\mathcal{P}_{\alpha }(t) \bigr\Vert \leq \frac{\alpha C_{\gamma }\Gamma (2-\gamma )}{t^{\alpha \gamma }\Gamma (1+\alpha (1-\gamma ))}. $$

Lemma 2.4

([23])

For \(\sigma \in (0,1]\) and \(0< a\leq b\), we have \(\vert a^{\sigma }-b^{\sigma }\vert \leq (b-a)^{\sigma }\).

Lemma 2.5

If

$$ \begin{aligned} x(t)={}& \frac{t^{\alpha -1}}{\Gamma (\alpha )}\bigl[x_{0}+h \bigl(0,x(0)\bigr)+g(x)\bigr]+h\bigl(t,x(t)\bigr)+ \frac{1}{\Gamma (\alpha )} \int _{0}^{t}(t-s)^{\alpha -1}Ax(s)\,ds \\ & {} + \frac{1}{\Gamma (\alpha )} \int _{0}^{t}(t-s)^{\alpha -1}F\bigl(s,x(s) \bigr)\,d \omega (s)+ \frac{1}{\Gamma (\alpha )} \int _{0}^{t}(t-s)^{ \alpha -1}\sigma (s)\,dB_{Q}^{H}(s), \quad t>0, \end{aligned} $$

then we have

$$ \begin{aligned} x(t)&=t^{\alpha -1}\mathcal{P}_{\alpha }(t) \bigl[x_{0}+h\bigl(0,x(0)\bigr)+g(x)\bigr]+h\bigl(t,x(t)\bigr) \\ &\quad {} + \int _{0}^{t}(t-s)^{\alpha -1} \mathcal{P}_{\alpha }(t-s)F\bigl(s,x(s)\bigr)\,d \omega (s) \\ &\quad {} + \int _{0}^{t}(t-s)^{\alpha -1}A \mathcal{P}_{\alpha }(t-s)h\bigl(s,x(s)\bigr)\,ds \\ &\quad {} + \int _{0}^{t}(t-s)^{\alpha -1} \mathcal{P}_{\alpha }(t-s) \sigma (s)\,dB_{Q}^{H}(s), \quad t>0. \end{aligned} $$

Proof

Referring to [25], we omit the proof here. □

3 Main results

In this section, we present and prove the existence of mild solutions for system (1.1). To develop our results, we first give the concept of mild solution for system (1.1).

Definition 3.1

An \(\mathcal{F}_{t}\)-adapted and measurable stochastic process \(x\in C_{\alpha }(J,X)\) is said to be a mild solution of system (1.1) if \(x_{0},g\in \mathcal{L}_{2}^{0}(\Omega ,X)\), for each \(s\in [0,b)\), the function \((t-s)^{\alpha -1}AT_{\alpha }(t-s)h(s,x(s))\) is integrable and the following integral equation is verified:

$$\begin{aligned} x(t) =&t^{\alpha -1}\mathcal{P}_{\alpha }(t) \bigl[x_{0}+h \bigl(0,x(0) \bigr)+g(x) \bigr]+h \bigl(t,x(t) \bigr) \\ & {} + \int _{0}^{t}(t-s)^{\alpha -1} \mathcal{P}_{\alpha }(t-s)F \bigl(s,x(s) \bigr)\,d \omega (s) \\ & {} + \int _{0}^{t}(t-s)^{\alpha -1}A \mathcal{P}_{\alpha }(t-s)h \bigl(s,x(s) \bigr)\,ds \\ & {} + \int _{0}^{t}(t-s)^{\alpha -1} \mathcal{P}_{\alpha }(t-s)\sigma (s)\,dB_{Q}^{H}(s), \quad t \in J{'}. \end{aligned}$$

For our readers’ convenience, we first introduce some notations:

$$\begin{aligned}& \bigl\Vert A^{-\beta } \bigr\Vert =M_{0}, \quad\quad K( \alpha ,\beta )= \frac{C_{1-\beta }\Gamma (1+\beta )}{\beta \Gamma (1+\alpha \beta )}, \quad\quad c= \frac{\alpha -1}{1-\alpha _{1}}, \quad\quad \Lambda = \frac{b^{(1+c)(2-2\alpha _{1})}}{(1+c)^{2-2\alpha _{1}}}, \\& \alpha _{1} \in \bigg[\frac{1}{2}, \alpha \bigg). \end{aligned}$$

To establish the main results, we require the following hypotheses:

(\(\mathrm{H}_{1}\)):

Semigroup \(S(t)\) is compact for each \(t>0\);

(\(\mathrm{H}_{2}\)):
  1. (2a)

    for each \(x\in X\), the function \(F(\cdot ,x):J\rightarrow \mathcal{L}_{2}^{0}(X, Y)\) is strongly measurable with respect to t, and for each \(t\in J\), the function \(F(t,\cdot ):X\rightarrow \mathcal{L}_{2}^{0}(X, Y)\) is continuous with respect to x;

  2. (2b)

    there exist a function \(N(t)\in L^{\frac{1}{2\alpha _{1}-1}}(J)\), \(\alpha _{1}\in [\frac{1}{2}, \alpha )\) and a continuous nondecreasing function \(\vartheta :[0,\infty )\to (0,\infty )\) such that for any \((t,x)\in J\times C_{\alpha }\), we have \(E\Vert F(t,x(t))\Vert ^{2}\leq N(t)\times \vartheta (\Vert x\Vert _{C_{\alpha }})\), \(\liminf_{r\rightarrow \infty }\frac{\vartheta (r)}{r}\,ds= \Theta <\infty \);

(\(\mathrm{H}_{3}\)):
  1. (3a)

    \(h(t,\cdot ):X\rightarrow X\) is continuous for each \(t\in J\), and for each \(x\in X\), the function \(h(\cdot ,x):J\rightarrow X\) is strongly measurable;

  2. (3b)

    there exist constants \(\beta \in (0,1)\) and \(L>0\) such that \(h\in D(A^{\beta })\) and for any \(x,y\in C_{\alpha }(J,X)\), \(t\in J\), the function \(A^{\beta }h(\cdot ,x)\) is strongly measurable, and \(A^{\beta }h(t,x(t))\) satisfies

    $$ E \bigl\Vert A^{\beta }h \bigl(t,x(t) \bigr)-A^{\beta }h \bigl(t,y(t) \bigr) \bigr\Vert ^{2}\leq L \Vert x-y \Vert _{C_{ \alpha }}, $$

    for all \(x,y\in C_{\alpha }(J,X)\), \(t\in J\);

  3. (3c)

    there exist a continuous nondecreasing function \(\zeta :[0,\infty )\rightarrow (0,\infty )\) and a constant \(r>0\) such that for a.e. \(t\in J\), \(x\in C_{\alpha }(J,X)\), we have

    $$ E \bigl\Vert A^{\beta }h \bigl(t,x(t) \bigr) \bigr\Vert ^{2} \leq L \bigl(1+\zeta \bigl( \Vert x \Vert _{C_{\alpha }} \bigr) \bigr), \quad \quad \liminf_{r\rightarrow \infty }\frac{\zeta (r)}{r}\,ds= \Pi _{1}< \infty ; $$
(\(\mathrm{H}_{4}\)):

\(g : C_{\alpha }(J,X) \rightarrow \mathcal{L}_{0}^{2} (\Omega ,X)\) is such that

  1. (i)

    there exist a continuous nondecreasing function \(\mu :[0,\infty )\to (0,\infty )\) such that \(E\Vert g(x) \Vert ^{2}\leq \mu (\Vert x\Vert _{C_{\alpha }})\) for all \(x \in C_{\alpha }(J,X)\) and a constant \(r>0\) such that for a.e. \(t\in J\), \(x\in C_{\alpha }(J,X)\), we have

    $$ E \bigl\Vert g(x) \bigr\Vert ^{2}\leq L \bigl(1+\mu \bigl( \Vert x \Vert _{C_{\alpha }} \bigr) \bigr), \quad\quad \liminf _{r \rightarrow \infty } \frac{\mu (r)}{r}\,ds=\Pi _{2}< \infty ; $$
  2. (ii)

    g is a completely continuous map;

(\(\mathrm{H}_{5}\)):

the function \(\sigma : J \rightarrow \mathcal{L}_{2}^{0}(X, Y)\) satisfies

$$ \int _{0}^{b} \bigl\Vert \sigma (s) \bigr\Vert _{\mathcal{L}_{2}^{0}}^{ \frac{2}{2\alpha _{1}-1}}\,ds< \infty , \quad \forall b>0. $$

We define the operator \(\Psi :C_{\alpha }(J,X)\rightarrow C_{\alpha }(J,X)\) as follows:

$$\begin{aligned} (\Psi x) (t) =&t^{\alpha -1}\mathcal{P}_{\alpha }(t) \bigl[x_{0}+h \bigl(0,x(0) \bigr)+g(x) \bigr]+h \bigl(t,(t) \bigr) \\ & {} + \int _{0}^{t}(t-s)^{\alpha -1}A \mathcal{P}_{\alpha }(t-s)h \bigl(s,x(s) \bigr)\,ds \\ & {} + \int _{0}^{t}(t-s)^{\alpha -1} \mathcal{P}_{\alpha }(t-s)F \bigl(s,x(s) \bigr)\,d \omega (s) \\ & {} + \int _{0}^{t}(t-s)^{\alpha -1} \mathcal{P}_{\alpha }(t-s)\sigma (s)\,dB_{Q}^{H}(s), \quad t \in J{'}. \end{aligned}$$

Set

$$\begin{aligned}& \begin{aligned} (\Psi _{1}x) (t)={}&t^{\alpha -1} \mathcal{P}_{\alpha }(t) \bigl[x_{0}+h \bigl(0,x(0) \bigr)+g(x) \bigr]+h \bigl(t,x(t) \bigr) \\ & {} + \int _{0}^{t}(t-s)^{\alpha -1}A \mathcal{P}_{\alpha }(t-s)h \bigl(s,x(s) \bigr)\,ds, \quad t \in J{'}, \end{aligned} \\& \begin{aligned} (\Psi _{2}x) (t)={}& \int _{0}^{t}(t-s)^{\alpha -1} \mathcal{P}_{\alpha }(t-s)F \bigl(s,x(s) \bigr)\,d \omega (s) \\ & {} + \int _{0}^{t}(t-s)^{\alpha -1} \mathcal{P}_{\alpha }(t-s)\sigma (s)\,dB_{Q}^{H}(s), \quad t \in J{'}. \end{aligned} \end{aligned}$$

According to assumption (\(\mathrm{H}_{3}\)) and Lemma 2.3, we obtain

$$\begin{aligned}& E \biggl\Vert \int _{0}^{t}(t-s)^{\alpha -1}A \mathcal{P}_{\alpha }(t-s)h \bigl(s,x(s) \bigr)\,ds \biggr\Vert ^{2} \\ & \quad \leq E \int _{0}^{t} \bigl\Vert (t-s)^{\alpha -1}A^{1-\beta } \mathcal{P}_{ \alpha }(t-s)A^{\beta }h \bigl(s,x(s) \bigr) \bigr\Vert ^{2}\,ds \\ & \quad \leq \int _{0}^{t} \bigl\Vert (t-s)^{\alpha -1}A^{1-\beta } \mathcal{P}_{\alpha }(t-s) \bigr\Vert \,ds \\ & \quad \quad {} \times \int _{0}^{t}(t-s)^{\alpha -1}A^{1-\beta } \mathcal{P}_{ \alpha }(t-s)E \bigl\Vert A^{\beta }h \bigl(s,x(s) \bigr) \bigr\Vert ^{2}\,ds \\ & \quad \leq \frac{\alpha ^{2}(C_{1-\beta })^{2}\Gamma ^{2}(1+\beta )}{\Gamma ^{2}(1+\alpha \beta )} \\ & \quad \quad {} \times \int _{0}^{t}(t-s)^{\alpha \beta -1}\,ds \int _{0}^{t}(t-s)^{ \alpha \beta -1}E \bigl\Vert A^{\beta }h \bigl(s,x(s) \bigr) \bigr\Vert ^{2}\,ds \\ & \quad \leq b^{2\alpha \beta } \frac{(C_{1-\beta })^{2}\Gamma ^{2}(1+\beta )}{\beta ^{2}\Gamma ^{2}(1+\alpha \beta )}L \bigl(1+ \zeta \bigl( \Vert x \Vert _{C_{\alpha }} \bigr) \bigr) \\ & \quad = b^{2\alpha \beta }K(\alpha ,\beta )L \bigl(1+\zeta \bigl( \Vert x \Vert _{C_{\alpha }} \bigr) \bigr). \end{aligned}$$

Now, from assumption (\(\mathrm{H}_{2}\)), we get

$$\begin{aligned}& E \biggl\Vert \int _{0}^{t}(t-s)^{\alpha -1} \mathcal{P}_{\alpha }(t-s)F \bigl(s,x(s) \bigr) \,d \omega (s) \biggr\Vert ^{2} \\ & \quad \leq \operatorname{Tr}Q\frac{M^{2}}{\Gamma ^{2}(\alpha )} \int _{0}^{t}(t-s)^{2( \alpha -1)}E \bigl\Vert F \bigl(s,x(s) \bigr) \bigr\Vert ^{2}\,ds \\ & \quad \leq \operatorname{Tr}Q\frac{M^{2}}{\Gamma ^{2}(\alpha )} \biggl( \int _{0}^{t}(t-s)^{ \frac{2(\alpha -1)}{2-2\alpha _{1}}}\,ds \biggr)^{2-2\alpha _{1}}\vartheta \bigl( \Vert x \Vert _{C_{\alpha }} \bigr) \Vert N \Vert _{L^{\frac{1}{2\alpha _{1}-1}}} \\ & \quad \leq \operatorname{Tr}Q\frac{M^{2}}{\Gamma ^{2}(\alpha )}\vartheta \bigl( \Vert x \Vert _{C_{\alpha }} \bigr) \frac{b^{(1+c)(2-2\alpha _{1})}}{(1+c)^{2-2\alpha _{1}}} \Vert N \Vert _{L^{ \frac{1}{2\alpha _{1}-1}}} \\ & \quad = \operatorname{Tr}Q\frac{M^{2}}{\Gamma ^{2}(\alpha )}\vartheta \bigl( \Vert x \Vert _{C_{ \alpha }} \bigr)\Lambda \Vert N \Vert _{L^{\frac{1}{2\alpha _{1}-1}}}. \end{aligned}$$

For the last term of the mild solution, from assumption (\(\mathrm{H}_{5}\)), we have the estimate

$$\begin{aligned}& E \biggl\Vert \int _{0}^{t}(t-s)^{\alpha -1} \mathcal{P}_{\alpha }(t-s)\sigma (s) \,dB^{H}_{Q}(s) \biggr\Vert ^{2} \\ & \quad \leq c_{0}H(2H-1)t^{2H-1}\frac{M^{2}}{\Gamma ^{2}(\alpha )} \int _{0}^{t}(t-s)^{2( \alpha -1)} \bigl\Vert \sigma (s) \bigr\Vert _{\mathcal{L}_{2}^{0}}^{2}\,ds \\ & \quad \leq c_{0}H(2H-1)t^{2H-1}\frac{M^{2}}{\Gamma ^{2}(\alpha )} \biggl( \int _{0}^{t}(t-s)^{ \frac{2(\alpha -1)}{2-2\alpha _{1}}}\,ds \biggr)^{2-2\alpha _{1}} \\ & \quad \quad {} \times \biggl( \int _{0}^{b} \bigl\Vert \sigma (s) \bigr\Vert ^{\frac{2}{2\alpha _{1}-1}}\,ds \biggr)^{2 \alpha _{1}-1} \\ & \quad \leq c_{0}H(2H-1)\frac{M^{2}}{\Gamma ^{2}(\alpha )} \frac{b^{(1+c)(2-2\alpha _{1})+2H-1}}{(1+c)^{2-2\alpha _{1}}} \biggl( \int _{0}^{b} \bigl\Vert \sigma (s) \bigr\Vert ^{\frac{2}{2\alpha _{1}-1}}\,ds \biggr)^{2\alpha _{1}-1}. \end{aligned}$$

In the following, we set to present our first existence result for system (1.1).

Theorem 3.1

Suppose that hypotheses (\(\mathrm{H}_{1}\))(\(\mathrm{H}_{5}\)) hold, then system (1.1) has at least one mild solution defined on \(J{'}\) provided that \(2b^{2(1-\alpha )}M_{0}L+2b^{2(1-\alpha +\alpha \beta )}K^{2}(\alpha , \beta )L<1\) and

$$\begin{aligned}& \frac{15M^{2}}{\Gamma ^{2}(\alpha )} \bigl[M^{2}_{0}L\Pi _{1}+L \Pi _{2} \bigr]+5b^{2(1- \alpha )}M_{0}L\Pi _{1}+5b^{2(1-\alpha +\alpha \beta )}K^{2}(\alpha , \beta )L\Pi _{1} \\& \quad {} +5b^{2(1-\alpha )}\frac{M^{2}}{\Gamma ^{2}(\alpha )}\Theta \Lambda \Vert N \Vert _{\frac{1}{2\alpha _{1}-1}}< 1. \end{aligned}$$

Proof

Denote \(B_{q}=\{x\in C_{\alpha }(J,X),\Vert x\Vert _{C_{\alpha }}\leq q\}\). Then it is obvious that \(B_{q}\) is a bounded, closed, convex set in \(C_{\alpha }(J,X)\). We demonstrate the proof in six steps.

Step 1. We shall show that there exists a constant \(r=r(a)\) such that \(\Psi (B_{r})\subset B_{r}\).

In fact, if this claim is not true, then for each positive constant r there exists some \(x^{(r)}\in B_{r}\) such that \(\Psi (x^{(r)})\notin B_{r}\), i.e.,

$$\begin{aligned} r < & \bigl\Vert \Psi \bigl(x^{(r)} \bigr) \bigr\Vert ^{2}_{C_{\alpha }} \\ \leq &\sup_{t\in J{'}}t^{2(1 -\alpha )} \biggl\{ 5E \bigl\Vert t^{ \alpha -1}\mathcal{P}_{\alpha }(t) \bigl[x_{0}+h \bigl(0,x^{(r)}(0) \bigr)+g \bigl(x^{(r)} \bigr) \bigr] \bigr\Vert ^{2} \\ & {} +5E \bigl\Vert h \bigl(t,x^{(r)}(t) \bigr) \bigr\Vert ^{2} \\ & {} +5E \biggl\Vert \int _{0}^{t}(t-s)^{\alpha -1}A \mathcal{P}_{\alpha }(t-s)h \bigl(s,x^{(r)}(s) \bigr)\,ds \biggr\Vert ^{2} \\ & {} +5E \biggl\Vert \int _{0}^{t}(t-s)^{\alpha -1} \mathcal{P}_{\alpha }(t-s)F \bigl(s,x^{(r)}(s) \bigr)\,d \omega (s) \biggr\Vert ^{2} \\ & {} +5E \biggl\Vert \int _{0}^{t}(t-s)^{\alpha -1} \mathcal{P}_{\alpha }(t-s)\sigma (s) \,dB^{H}_{Q}(s) \biggr\Vert ^{2} \biggr\} \\ \leq & \frac{5M^{2}}{\Gamma ^{2}(\alpha )} \bigl[E \bigl\Vert x_{0}+h \bigl(0,x^{(r)}(0) \bigr)+g \bigl(x^{(r)} \bigr) \bigr\Vert ^{2} \bigr] \\ & {} +5b^{2(1-\alpha )} \bigl\Vert A^{-\beta } \bigr\Vert ^{2}L \bigl(1+\zeta \bigl\Vert x^{(r)} \bigr\Vert _{C_{ \alpha }} \bigr) \\ & {} +5b^{2(1-\alpha +\alpha \beta )}K^{2}(\alpha ,\beta )L \bigl(1+\zeta \bigl\Vert x^{(r)} \bigr\Vert _{C_{\alpha }} \bigr) \\ & {} +5b^{2(1-\alpha )}\operatorname{Tr}Q\frac{M^{2}}{\Gamma ^{2}(\alpha )} \vartheta \bigl( \bigl\Vert x^{(r)} \bigr\Vert _{C_{\alpha }} \bigr)\Lambda \Vert N \Vert _{L^{ \frac{1}{2\alpha _{1}-1}}} \\ & {} +5c_{0}H(2H-1)\frac{M^{2}}{\Gamma ^{2}(\alpha )} \frac{b^{(1+c)(2-2\alpha _{1})+2H+1-2\alpha }}{(1+c)^{2-2\alpha _{1}}} \biggl( \int _{0}^{b} \bigl\Vert \sigma (s) \bigr\Vert ^{\frac{2}{2\alpha _{1}-1}}\,ds \biggr)^{2\alpha _{1}-1} \\ \leq & \frac{5M^{2}}{\Gamma ^{2}(\alpha )} \bigl[3E \Vert x_{0} \Vert ^{2}+3M^{2}_{0}L \bigl(1+ \zeta (r) \bigr)+3L \bigl(1+\mu (r) \bigr) \bigr] \\ & {} +5b^{2(1-\alpha )}M^{2}_{0}L \bigl(1+\zeta (r) \bigr)+5b^{2(1-\alpha +\alpha \beta )}K^{2}(\alpha ,\beta )L \bigl(1+\zeta (r) \bigr) \\ & {} +5b^{2(1-\alpha )}\operatorname{Tr}Q\frac{M^{2}}{\Gamma ^{2}(\alpha )} \vartheta (r)\Lambda \Vert N \Vert _{L^{\frac{1}{2\alpha _{1}-1}}} \\ & {} +5c_{0}H(2H-1)\frac{M^{2}}{\Gamma ^{2}(\alpha )} \frac{b^{(1+c)(2-2\alpha _{1})+2H+1-2\alpha }}{(1+c)^{2-2\alpha _{1}}} \biggl( \int _{0}^{b} \bigl\Vert \sigma (s) \bigr\Vert ^{\frac{2}{2\alpha _{1}-1}}\,ds \biggr)^{2\alpha _{1}-1}. \end{aligned}$$

Dividing both sides by r and letting \(r\rightarrow \infty \) yields

$$\begin{aligned}& \frac{15M^{2}}{\Gamma ^{2}(\alpha )} \bigl[M^{2}_{0}L\Pi _{1}+L \Pi _{2} \bigr]+5b^{2(1- \alpha )}M_{0}L\Pi _{1}+5b^{2(1-\alpha +\alpha \beta )}K^{2}(\alpha , \beta )L\Pi _{1} \\& \quad {} +5b^{2(1-\alpha )}\frac{M^{2}}{\Gamma ^{2}(\alpha )}\Theta \Lambda \Vert N \Vert _{\frac{1}{2\alpha _{1}-1}}> 1. \end{aligned}$$

This contradicts the assumption of Theorem 3.1, which implies that there exists r such that Ψ maps \(B_{r}\) into itself.

Step 2. We show that \(\Psi _{1}\) is a contraction on \(B_{r}\).

For any \(x,y\in B_{r}\), we derive

$$\begin{aligned}& \bigl\Vert (\Psi _{1}x) (t)-(\Psi _{1}y) (t) \bigr\Vert ^{2}_{C_{\alpha }} \\& \quad =\sup_{t\in J{'}}t^{2(1-\alpha )}E \bigl\Vert (\Psi _{1}x) (t)-(\Psi _{1}y) (t) \bigr\Vert ^{2} \\& \quad \leq \sup_{t\in J^{\prime }}2t^{2(1-\alpha )}E \bigl\Vert h \bigl(t,x(t) \bigr)-h \bigl(t,y(t) \bigr) \bigr\Vert ^{2} \\& \quad \quad {} +\sup_{t\in J{'}}2t^{2(1-\alpha )}E \biggl\Vert \int _{0}^{t}(t-s)^{ \alpha -1}A \mathcal{P}_{\alpha }(t-s) \bigl[h \bigl(s,x(s) \bigr)-h \bigl(s,y(s) \bigr) \bigr]\,ds \biggr\Vert ^{2} \\& \quad \leq \sup_{t\in J{'}}2t^{2(1-\alpha )} \bigl\Vert A^{-\beta } \bigr\Vert ^{2}E \bigl\Vert A^{\beta }h \bigl(t,x(t) \bigr)-A^{\beta }h \bigl(t,y(t) \bigr) \bigr\Vert ^{2} \\& \quad \quad {} +\sup_{t\in J{'}}2t^{2(1-\alpha )} \int _{0}^{t}(t-s)^{ \alpha -1}A^{1-\beta } \mathcal{P}_{\alpha }(t-s)\,ds \\& \quad \quad {} \times \int _{0}^{t}(t-s)^{\alpha -1}A^{1-\beta } \mathcal{P}_{ \alpha }(t-s)E \bigl\Vert A^{\beta }h \bigl(s,x(s) \bigr)-A^{\beta }h \bigl(s,y(s) \bigr) \bigr\Vert ^{2}\,ds \\& \quad \leq 2b^{2(1-\alpha )}M^{2}_{0}L \Vert x-y \Vert _{C_{1-\alpha }}+2b^{2(1- \alpha +\alpha \beta )}K^{2}(\alpha ,\beta )L \Vert x-y \Vert _{C_{\alpha }} \\& \quad = \bigl[2b^{2(1-\alpha )}M^{2}_{0}L+2b^{2(1-\alpha +\alpha \beta )}K^{2}( \alpha ,\beta )L \bigr] \Vert x-y \Vert _{C_{\alpha }}. \end{aligned}$$

Thus, \(\Psi _{1}\) is a contraction by assumption of Theorem 3.1.

Step 3. \(\Psi _{2}\) is completely continuous.

To prove this assertion, we subdivide Step 3 into three claims.

Claim 1. \(\Psi _{2}\) maps bounded sets into uniformly bounded sets in \(C_{\alpha }(J,X)\).

We only need to show that there exists constant \(\Delta >0\) such that for each \(\Psi _{2}x, x\in B_{r}\), \(\Vert \Psi _{2}x\Vert _{C_{\alpha }}\leq \Delta \) holds. In fact, for each \(t\in J{'}\), by using Hölder’s inequality, we have

$$\begin{aligned} \Vert \Psi _{2}x \Vert _{C_{\alpha }}^{2}&=\sup _{t\in J{'}}t^{2(1- \alpha )}E \biggl\Vert t^{\alpha -1} \mathcal{P}_{\alpha }(t) \bigl[x_{0}+h \bigl(0,x(0) \bigr)+g(x) \bigr] \\ &\quad {} + \int _{0}^{t}(t-s)^{\alpha -1} \mathcal{P}_{\alpha }(t-s)F \bigl(s,x(s) \bigr)\,d \omega (s) \\ &\quad {} + \int _{0}^{t}(t-s)^{\alpha -1} \mathcal{P}_{\alpha }(t-s)\sigma (s)\,dB_{Q}^{H} \biggr\Vert ^{2} \\ &\leq 3\frac{M^{2}}{\Gamma ^{2}(\alpha )}E \bigl\Vert x_{0}+h \bigl(0,x(0) \bigr)+g(x) \bigr\Vert ^{2} \\ &\quad {} +3b^{2(1-\alpha )}\operatorname{Tr}Q\frac{M^{2}}{\Gamma ^{2}(\alpha )} \vartheta (r) \Lambda \Vert N \Vert _{L^{\frac{1}{2\alpha _{1}-1}}} \\ &\quad {} +3b^{2H+1-2\alpha }c_{0}H(2H-1)\frac{M^{2}}{\Gamma ^{2}(\alpha )} \frac{b^{(1+c)(2-2\alpha _{1})}}{(1+c)^{2-2\alpha _{1}}} \biggl( \int _{0}^{b} \bigl\Vert \sigma (s) \bigr\Vert ^{\frac{2}{2\alpha _{1}-1}}\,ds \biggr)^{2\alpha _{1}-1} \\ &\leq 3\frac{M^{2}}{\Gamma ^{2}(\alpha )} \bigl[3E \Vert x_{0} \Vert ^{2}+3M^{2}_{0}L \bigl(1+ \zeta (r) \bigr)+3L \bigl(1+\mu (r) \bigr) \bigr] \\ &\quad {} +3b^{2-2\alpha }\operatorname{Tr}Q\frac{M^{2}}{\Gamma ^{2}(\alpha )} \vartheta (r) \Lambda \Vert N \Vert _{L^{\frac{1}{2\alpha _{1}-1}}} \\ &\quad {} +3b^{2H+1-2\alpha }c_{0}H(2H-1)\frac{M^{2}}{\Gamma ^{2}(\alpha )} \frac{b^{(1+c)(2-2\alpha _{1})}}{(1+c)^{2-2\alpha _{1}}} \biggl( \int _{0}^{b} \bigl\Vert \sigma (s) \bigr\Vert ^{\frac{2}{2\alpha _{1}-1}}\,ds \biggr)^{2\alpha _{1}-1} \\ & :=\Delta . \end{aligned}$$

Consequently, for each \(\rho \in \Psi _{2}x\), we have \(\Vert \rho (t)\Vert _{C_{\alpha }}\leq \Delta \).

Claim 2. \(\Psi _{2}(B_{r})\) is equicontinuous on \(B_{r}\).

Denoting \(\bar{E}=\{y\in C(J,X):y(t)=t^{1-\alpha }(\Psi _{2}x)(t), y(0)=y(0^{+}), x \in B_{r}\}\), for \(t_{1}=0\), \(0 < t_{2}\leq b\), we can obtain

$$\begin{aligned}& E \bigl\Vert y(t_{2})-y(0) \bigr\Vert ^{2} \\& \quad \leq 3 \bigl\Vert \bigl[\mathcal{P}_{\alpha }(t_{2})- \mathcal{P}_{\alpha }(0) \bigr] \bigl[x_{0}+h \bigl(0,x(0) \bigr)+g(x) \bigr] \bigr\Vert ^{2} \\& \quad\quad {} +3t_{2}^{1-\alpha } \biggl\Vert \int _{0}^{t_{2}}(t_{2}-s)^{\alpha -1} \mathcal{P}_{\alpha }(t_{2}-s)F \bigl(s,x(s) \bigr)\,d\omega (s) \biggr\Vert ^{2} \\& \quad \quad {} +3t_{2}^{1-\alpha } \biggl\Vert \int _{0}^{t_{2}}(t_{2}-s)^{\alpha -1} \mathcal{P}_{\alpha }(t_{2}-s)\sigma (s)\,dB_{Q}^{H}(s) \biggr\Vert ^{2} \rightarrow 0,\quad \text{as }t_{2} \rightarrow t_{1}=0. \end{aligned}$$

For \(0< t_{1}< t_{2}\leq b\), the strong continuity of \(\{\mathcal{P}_{\alpha }(t):t\geq 0\}\) implies that there exists a constant \(\delta >0\) such that \(\vert t_{2}-t_{1}\vert <\delta \) and \(\Vert \mathcal{P}_{\alpha }(t_{1})-\mathcal{P}_{\alpha }(t_{2})\Vert <\tau \). In addition, note that \(c=\frac{\alpha -1}{1-\alpha _{1}}\), then for \(\forall x\in B_{r}\), this yields that

$$\begin{aligned}& E \bigl\Vert y(t_{2})-y(t_{1}) \bigr\Vert ^{2} \\& \quad \leq 9E \bigl\Vert \mathcal{P}_{\alpha }(t_{2}) \bigl[x_{0}+h \bigl(0,x(0) \bigr)+g(x) \bigr]- \mathcal{P}_{\alpha }(t_{1}) \bigl[x_{0}+h \bigl(0,x(0) \bigr)+g(x) \bigr] \bigr\Vert ^{2} \\& \quad \quad {} +9E \biggl\Vert \int _{0}^{t_{1}} \bigl[t_{2}^{1-\alpha }(t_{2}-s)^{\alpha -1}-t_{1}^{1- \alpha }(t_{1}-s)^{\alpha -1} \bigr] \mathcal{P}_{\alpha }(t_{2}-s)F \bigl(s,x(s) \bigr)\,d \omega (s) \biggr\Vert ^{2} \\& \quad \quad {} +9E \biggl\Vert \int _{0}^{t_{1}} \bigl[t_{2}^{1-\alpha }(t_{2}-s)^{\alpha -1}-t_{1}^{1- \alpha }(t_{1}-s)^{\alpha -1} \bigr] \mathcal{P}_{\alpha }(t_{2}-s)\sigma (s)\,dB_{Q}^{H}(s) \biggr\Vert ^{2} \\& \quad \quad {} +9E \biggl\Vert \int _{0}^{t_{1}-\varepsilon }t_{1}^{1-\alpha }(t_{1}-s)^{ \alpha -1} \bigl[\mathcal{P}_{\alpha }(t_{2}-s)-\mathcal{P}_{\alpha }(t_{1}-s) \bigr]F \bigl(s,x(s) \bigr)\,d \omega (s) \biggr\Vert ^{2} \\& \quad \quad {} +9E \biggl\Vert \int _{0}^{t_{1}-\varepsilon }t_{1}^{1-\alpha }(t_{1}-s)^{ \alpha -1} \bigl[\mathcal{P}_{\alpha }(t_{2}-s)-\mathcal{P}_{\alpha }(t_{1}-s) \bigr] \sigma (s)\,dB_{Q}^{H}(s) \biggr\Vert ^{2} \\& \quad \quad {} +9E \biggl\Vert \int _{t_{1}-\varepsilon }^{t_{1}}t_{1}^{1-\alpha }(t_{1}-s)^{ \alpha -1} \bigl[\mathcal{P}_{\alpha }(t_{2}-s)-\mathcal{P}_{\alpha }(t_{1}-s) \bigr]F \bigl(s,x(s) \bigr)\,d \omega (s) \biggr\Vert ^{2} \\& \quad \quad {} +9E \biggl\Vert \int _{t_{1}-\varepsilon }^{t_{1}}t_{1}^{1-\alpha }(t_{1}-s)^{ \alpha -1} \bigl[\mathcal{P}_{\alpha }(t_{2}-s)-\mathcal{P}_{\alpha }(t_{1}-s) \bigr] \sigma (s)\,dB_{Q}^{H}(s) \biggr\Vert ^{2} \\& \quad \quad {} +9E \biggl\Vert \int _{t_{1}}^{t_{2}}t_{2}^{1-\alpha }(t_{2}-s)^{\alpha -1} \mathcal{P}_{\alpha }(t_{2}-s)F \bigl(s,x(s) \bigr)\,d\omega (s) \biggr\Vert ^{2} \\& \quad \quad {} +9E \biggl\Vert \int _{t_{1}}^{t_{2}}t_{2}^{1-\alpha }(t_{2}-s)^{\alpha -1} \mathcal{P}_{\alpha }(t_{2}-s)\sigma (s)\,dB_{Q}^{H}(s) \biggr\Vert ^{2} \\& \quad \leq 9 \bigl\Vert \mathcal{P}_{\alpha }(t_{2})- \mathcal{P}_{\alpha }(t_{1}) \bigr\Vert ^{2}E \bigl\Vert x_{0}+h \bigl(0,x(0) \bigr)+g(x) \bigr\Vert ^{2} \\& \quad \quad {} +9\operatorname{Tr}Q \int _{0}^{t_{1}} \bigl\Vert t_{2}^{1-\alpha }(t_{2}-s)^{ \alpha -1}-t_{1}^{1-\alpha }(t_{1}-s)^{\alpha -1} \bigr\Vert ^{2} \\& \quad \quad {} \times \bigl\Vert \mathcal{P}_{\alpha }(t_{2}-s) \bigr\Vert ^{2}E \bigl\Vert F \bigl(s,x(s) \bigr) \bigr\Vert ^{2}\,ds \\& \quad \quad {} +9c_{0}H(2H-1)t_{1}^{2H-1} \int _{0}^{t_{1}} \bigl\Vert t_{2}^{1-\alpha }(t_{2}-s)^{ \alpha -1}-t_{1}^{1-\alpha }(t_{1}-s)^{\alpha -1} \bigr\Vert ^{2} \\& \quad \quad {} \times \bigl\Vert \mathcal{P}_{\alpha }(t_{2}-s) \bigr\Vert ^{2} \bigl\Vert \sigma (s) \bigr\Vert _{ \mathcal{L}^{2}_{0}}^{2}\,ds \\& \quad \quad {} +9\sup_{[0,t_{1}-\varepsilon ]} \bigl\Vert \mathcal{P}_{\alpha }(t_{2}-s)- \mathcal{P}_{\alpha }(t_{1}-s) \bigr\Vert ^{2} \operatorname{Tr}Q\vartheta (r) \Vert N \Vert _{L^{ \frac{1}{2\alpha _{1}-1}}} \\& \quad \quad {} \times \biggl[ \frac{t_{1}^{(1+c)(2-2\alpha _{1})}}{(1+c)^{2-2\alpha _{1}}}- \frac{\varepsilon ^{(1+c)(2-2\alpha _{1})}}{(1+c)^{2-2\alpha _{1}}} \biggr] \\& \quad \quad {} +9c_{0}H(2H-1)b^{2H-1}\sup_{[0,t_{1}-\varepsilon ]} \bigl\Vert \mathcal{P}_{\alpha }(t_{2}-s)-\mathcal{P}_{\alpha }(t_{1}-s) \bigr\Vert ^{2} \\& \quad \quad {} \times \biggl[ \frac{t_{1}^{(1+c)(2-2\alpha _{1})}}{(1+c)^{2-2\alpha _{1}}}- \frac{\varepsilon ^{(1+c)(2-2\alpha _{1})}}{(1+c)^{2-2\alpha _{1}}} \biggr] \biggl( \int _{0}^{b} \bigl\Vert \sigma (s) \bigr\Vert ^{\frac{2}{2\alpha _{1}-1}}\,ds \biggr)^{2\alpha _{1}-1} \\& \quad \quad {} +9\operatorname{Tr}Q\frac{4M^{2}}{\Gamma ^{2}(\alpha )} \int _{t_{1}- \varepsilon }^{t_{1}}t_{1}^{2(1-\alpha )}(t_{1}-s)^{2(\alpha -1)}E \bigl\Vert F \bigl(s,x(s) \bigr) \bigr\Vert ^{2} \,ds \\& \quad \quad {} +9c_{0}H(2H-1)t_{1}^{2H-1} \frac{4M^{2}}{\Gamma ^{2}(\alpha )} \int _{t_{1}- \varepsilon }^{t_{1}}t_{1}^{2(1-\alpha )}(t_{1}-s)^{2(\alpha -1)} \bigl\Vert \sigma (s) \bigr\Vert _{\mathcal{L}_{2}^{0}}^{2}\,ds \\& \quad \quad {} +9\operatorname{Tr}Q\frac{M^{2}}{\Gamma ^{2}(\alpha )}b^{2-2\alpha } \int _{t_{1}}^{t_{2}}(t_{2}-s)^{2(\alpha -1)}E \bigl\Vert F \bigl(s,x(s) \bigr) \bigr\Vert ^{2}\,ds \\& \quad \quad {} +9c_{0}H(2H-1)\frac{M^{2}}{\Gamma ^{2}(\alpha )}b^{2H+1-2\alpha } \int _{t_{1}}^{t_{2}}(t_{2}-s)^{2(\alpha -1)} \bigl\Vert \sigma (s) \bigr\Vert _{ \mathcal{L}_{2}^{0}}^{2}\,ds \\& \quad =9\sum_{i=1}^{9}I_{i}, \end{aligned}$$

where

$$\begin{aligned}& I_{1}= \bigl\Vert \mathcal{P}_{\alpha }(t_{2})- \mathcal{P}_{\alpha }(t_{1}) \bigr\Vert ^{2}E \bigl\Vert x_{0}+h \bigl(0,x(0) \bigr)+g(x) \bigr\Vert ^{2}, \\& \begin{aligned} I_{2}={}&\operatorname{Tr}Q \int _{0}^{t_{1}} \bigl\Vert t_{2}^{1-\alpha }(t_{2}-s)^{ \alpha -1}-t_{1}^{1-\alpha }(t_{1}-s)^{\alpha -1} \bigr\Vert ^{2} \\ & {} \times \bigl\Vert \mathcal{P}_{\alpha }(t_{2}-s) \bigr\Vert ^{2}E \bigl\Vert F \bigl(s,x(s) \bigr) \bigr\Vert ^{2}\,ds, \end{aligned} \\& \begin{aligned} I_{3}={}&c_{0}H(2H-1)t_{1}^{2H-1} \int _{0}^{t_{1}} \bigl\Vert t_{2}^{1-\alpha }(t_{2}-s)^{ \alpha -1}-t_{1}^{1-\alpha }(t_{1}-s)^{\alpha -1} \bigr\Vert ^{2} \\ & {} \times \bigl\Vert \mathcal{P}_{\alpha }(t_{2}-s) \bigr\Vert ^{2} \bigl\Vert \sigma (s) \bigr\Vert ^{2}\,ds, \end{aligned} \\& \begin{aligned} I_{4}={}&\sup_{[0,t_{1}-\varepsilon ]} \bigl\Vert \mathcal{P}_{\alpha }(t_{2}-s)- \mathcal{P}_{\alpha }(t_{1}-s) \bigr\Vert ^{2}\operatorname{Tr}Q\vartheta (r) \Vert N \Vert _{L^{ \frac{1}{2\alpha _{1}-1}}} \\ & {} \times \biggl[ \frac{t_{1}^{(1+c)(2-2\alpha _{1})}}{(1+c)^{2-2\alpha _{1}}}- \frac{\varepsilon ^{(1+c)(2-2\alpha _{1})}}{(1+c)^{2-2\alpha _{1}}} \biggr], \end{aligned} \\& \begin{aligned} I_{5}={}&c_{0}H(2H-1)b^{2H-1}\sup _{[0,t_{1}-\varepsilon ]} \bigl\Vert \mathcal{P}_{\alpha }(t_{2}-s)- \mathcal{P}_{\alpha }(t_{1}-s) \bigr\Vert ^{2} \\ & {} \times \biggl[ \frac{t_{1}^{(1+c)(2-2\alpha _{1})}}{(1+c)^{2-2\alpha _{1}}}- \frac{\varepsilon ^{(1+c)(2-2\alpha _{1})}}{(1+c)^{2-2\alpha _{1}}} \biggr] \biggl( \int _{0}^{b} \bigl\Vert \sigma (s) \bigr\Vert ^{\frac{2}{2\alpha _{1}-1}}\,ds \biggr)^{2\alpha _{1}-1}, \end{aligned} \\& \begin{aligned} I_{6}={}&\operatorname{Tr}Q\frac{4M^{2}}{\Gamma ^{2}(\alpha )} \int _{t_{1}- \varepsilon }^{t_{1}}t_{1}^{2(1-\alpha )}(t_{1}-s)^{2(\alpha -1)}E \bigl\Vert F \bigl(s,x(s) \bigr) \bigr\Vert ^{2}\,ds \\ \leq{}&\operatorname{Tr}Q\frac{4M^{2}}{\Gamma ^{2}(\alpha )}t_{1}^{2-2 \alpha } \frac{\varepsilon ^{(1+c)(2-2\alpha _{1})}}{(1+c)^{2-2\alpha _{1}}} \vartheta (r) \Vert N \Vert _{L^{\frac{1}{2\alpha _{1}-1}}}, \end{aligned} \\& \begin{aligned} I_{7}={}&c_{0}H(2H-1)t_{1}^{2H-1} \frac{4M^{2}}{\Gamma ^{2}(\alpha )} \int _{t_{1}-\varepsilon }^{t_{1}}t_{1}^{2(1-\alpha )}(t_{1}-s)^{2( \alpha -1)} \bigl\Vert \sigma (s) \bigr\Vert _{\mathcal{L}_{2}^{0}}^{2}\,ds \\ \leq{}&c_{0}H(2H-1)t_{1}^{2H+1-2\alpha } \frac{4M^{2}}{\Gamma ^{2}(\alpha )} \frac{\varepsilon ^{(1+c)(2-2\alpha _{1})}}{(1+c)^{2-2\alpha _{1}}} \biggl( \int _{0}^{b} \bigl\Vert \sigma (s) \bigr\Vert ^{\frac{2}{2\alpha _{1}-1}}\,ds \biggr)^{2\alpha _{1}-1}, \end{aligned} \\& \begin{aligned} I_{8}&=\operatorname{Tr}Q\frac{M^{2}}{\Gamma ^{2}(\alpha )}b^{2-2\alpha } \int _{t_{1}}^{t_{2}}(t_{2}-s)^{2(\alpha -1)}E \bigl\Vert F \bigl(s,x(s) \bigr) \bigr\Vert ^{2}\,ds \\ &\leq \operatorname{Tr}Q\frac{M^{2}}{\Gamma ^{2}(\alpha )}b^{2-2\alpha } \frac{(t_{2}-t_{1})^{(1+c)(2-2\alpha _{1})}}{(1+c)^{2-2\alpha _{1}}} \vartheta (r) \Vert N \Vert _{L^{\frac{1}{2\alpha _{1}-1}}}, \end{aligned} \\& \begin{aligned} I_{9}&=c_{0}H(2H-1)\frac{M^{2}}{\Gamma ^{2}(\alpha )}b^{2H+1-2\alpha } \int _{t_{1}}^{t_{2}}(t_{2}-s)^{2(\alpha -1)} \bigl\Vert \sigma (s) \bigr\Vert _{ \mathcal{L}_{2}^{0}}^{2}\,ds \\ &\leq c_{0}H(2H-1)\frac{M^{2}}{\Gamma ^{2}(\alpha )}b^{2H+1-2 \alpha } \frac{(t_{2}-t_{1})^{(1+c)(2-2\alpha _{1})}}{(1+c)^{2-2\alpha _{1}}} \biggl( \int _{0}^{b} \bigl\Vert \sigma (s) \bigr\Vert ^{\frac{2}{2\alpha _{1}-1}}\,ds \biggr)^{2\alpha _{1}-1}. \end{aligned} \end{aligned}$$

Since \(p\in (0,\alpha )\), we have \((1+c)(2-2\alpha _{1})>0\), thus the terms from \(I_{6}\) to \(I_{9}\) tend to zero as \(t_{2}-t_{1}\rightarrow 0\) and \(\varepsilon \rightarrow 0\). The strong continuity of \(\{\mathcal{P}_{\alpha }(t): t\geq 0\}\) indicates that \(\Vert \mathcal{P}_{\alpha }(t_{2}-s)-\mathcal{P}_{\alpha }(t_{1}-s)\Vert ^{2} \rightarrow 0\) as \(\delta \rightarrow 0\). Hence \(I_{1}\), \(I_{4}\), \(I_{5}\) also tend to zero as \(t_{2}-t_{1}\rightarrow 0\).

For \(I_{2}\), by a standard calculation and for \(p\in (0,\alpha )\), we have

$$\begin{aligned} I_{2} \leq &\operatorname{Tr}Q \int _{0}^{t_{1}} \bigl\Vert t_{2}^{1-\alpha }(t_{2}-s)^{ \alpha -1}-t_{1}^{1-\alpha }(t_{1}-s)^{\alpha -1} \bigr\Vert ^{2} \\ & {} \times \bigl\Vert \mathcal{P}_{\alpha }(t_{2}-s) \bigr\Vert ^{2}E \bigl\Vert F \bigl(s,x(s) \bigr) \bigr\Vert ^{2}\,ds \\ \leq &\operatorname{Tr}Q\frac{M^{2}}{\Gamma ^{2}(\alpha )} \int _{0}^{t_{1}} \bigl\Vert t_{2}^{1-\alpha }(t_{2}-s)^{\alpha -1}-t_{1}^{1-\alpha }(t_{1}-s)^{ \alpha -1} \bigr\Vert ^{2}E \bigl\Vert F \bigl(s,x(s) \bigr) \bigr\Vert ^{2}\,ds \\ \leq &\operatorname{Tr}Q\frac{M^{2}}{\Gamma ^{2}(\alpha )} \frac{1}{(1+c)^{2-2\alpha _{1}}} \bigl[(t_{2}-t_{1})^{(1+c)(2-2\alpha _{1})} \\ & {} +t_{1}^{(1+c)(2-2\alpha _{1})}-t_{2}^{(1+c)(2-2\alpha _{1})} \bigr]\times \vartheta \bigl( \Vert x \Vert _{C_{\alpha }} \bigr) \Vert N \Vert _{L^{ \frac{1}{2\alpha _{1}-1}}}. \end{aligned}$$

Thus \(I_{2}\) tends to zero as \(t_{2}-t_{1}\rightarrow 0\). Similarly, we can get that \(I_{3}\) tends to zero as \(t_{2}-t_{1}\rightarrow 0\).

Therefore, the relationship of E and \(\{\Psi _{2}x:x\in B_{r}\}\) implies that \(\Psi _{2}\) is equicontinuous on \(B_{r}\).

Claim 3. \(V(t)=\{(\Psi _{2}x)(t), x\in B_{r}\}\) is a relatively compact in X.

Let \(0< t\leq b\) be fixed. Then for \(\forall \lambda \in (0,t)\) and \(\forall \delta >0\), \(x\in B_{r}\), define an operator

$$\begin{aligned} \bigl(\Psi _{2}^{\lambda ,\delta }x \bigr) (t) =&t^{1-\alpha } \mathcal{P}_{\alpha }(t) \bigl[x_{0}+h \bigl(0,x(0) \bigr)+g(x) \bigr] \\ & {} +\alpha \int _{0}^{t-\lambda } \int _{\delta }^{\infty }\theta (t-s)^{ \alpha -1}\phi _{\alpha }(\theta )S \bigl((t-s)^{\alpha }\theta \bigr)F \bigl(s,x(s) \bigr)\,d \omega (s) \\ & {} +\alpha \int _{0}^{t-\lambda } \int _{\delta }^{\infty }\theta (t-s)^{ \alpha -1}\phi _{\alpha }(\theta )S \bigl((t-s)^{\alpha }\theta \bigr)\sigma (s)\,dB^{H}_{Q}(s) \\ =&t^{1-\alpha }\mathcal{P}_{\alpha }(t) \bigl[x_{0}+h \bigl(0,x(0) \bigr)+g(x) \bigr] \\ & {} +\alpha S \bigl(\lambda ^{\alpha }\theta \bigr) \int _{0}^{t-\lambda } \int _{ \delta }^{\infty }\theta (t-s)^{\alpha -1}\phi _{\alpha }(\theta )S \bigl((t-s)^{ \alpha }\theta -\lambda ^{\alpha } \theta \bigr)F \bigl(s,x(s) \bigr)\,d\omega (s) \\ & {} +\alpha S \bigl(\lambda ^{\alpha }\theta \bigr) \int _{0}^{t-\lambda } \int _{ \delta }^{\infty }\theta (t-s)^{\alpha -1}\phi _{\alpha }(\theta )S \bigl((t-s)^{ \alpha }\theta -\lambda ^{\alpha } \theta \bigr)\sigma (s)\,dB^{H}_{Q}(s). \end{aligned}$$

From the compactness of \(S(\lambda ^{\alpha }\delta ), \lambda ^{\alpha }\delta >0\), we obtain that for \(\forall \lambda \in (0,t)\) and \(\forall \delta >0\), the set \(V^{\lambda ,\delta }(t)=\{(\Psi _{2}^{\lambda ,\delta }x)(t),x\in B_{r} \}\) is relatively compact in X.

Moreover, for each \(x\in B_{r}\), we have

$$\begin{aligned}& \bigl\Vert (\Psi _{2}x) (t)- \bigl(\Psi _{2}^{\lambda ,\delta }x \bigr) (t) \bigr\Vert _{C_{\alpha }} \\ & \quad =\sup_{t\in J{'}}t^{2(1-\alpha )}E\Vert \int _{0}^{t} \int _{0}^{ \delta }\alpha \theta (t-s)^{\alpha -1}\phi _{\alpha }(\theta )S \bigl((t-s)^{ \alpha }\theta \bigr)F(s,x(s)\,d\omega (s) \\ & \quad\quad {} + \int _{0}^{t} \int _{\delta }^{\infty }\alpha \theta (t-s)^{\alpha -1} \phi _{\alpha }(\theta )S \bigl((t-s)^{\alpha }\theta \bigr)F(s,x(s)\,d \omega (s) \\ & \quad\quad {} + \int _{0}^{t} \int _{\delta }^{\infty }\alpha \theta (t-s)^{\alpha -1} \phi _{\alpha }(\theta )S \bigl((t-s)^{\alpha }\theta \bigr)\sigma (s)\,dB^{H}_{Q}(s) \\ & \quad\quad {} - \int _{0}^{t-\lambda } \int _{\delta }^{\infty }\alpha \theta (t-s)^{ \alpha -1}\phi _{\alpha }(\theta )S \bigl((t-s)^{\alpha }\theta \bigr)F(s,x(s)\,d \omega (s) \\ & \quad\quad {} - \int _{0}^{t-\lambda } \int _{\delta }^{\infty }\alpha \theta (t-s)^{ \alpha -1}\phi _{\alpha }(\theta )S \bigl((t-s)^{\alpha }\theta \bigr)\sigma (s)\,dB^{H}_{Q}(s) \Vert ^{2} \\ & \quad \leq 4\alpha ^{2}\sup_{t\in J{'}} t^{2(1-\alpha )} E \Vert \int _{0}^{t} \int _{0}^{\delta }\theta (t-s)^{\alpha -1}\phi _{\alpha }( \theta )S \bigl((t-s)^{\alpha }\theta \bigr) F(s,x(s)\,d\omega (s) \Vert ^{2} \\ & \quad\quad {} +4\alpha ^{2}\sup_{t\in J{'}} t^{2(1-\alpha )} E \biggl\Vert \int _{0}^{t} \int _{0}^{\delta }\theta (t-s)^{\alpha -1}\phi _{\alpha }(\theta )S \bigl((t-s)^{ \alpha }\theta \bigr)\sigma (s)\,dB^{H}_{Q}(s) \biggr\Vert ^{2} \\ & \quad\quad {} +4\alpha ^{2}\sup_{t\in J{'}} t^{2(1-\alpha )} E\Vert \int _{t- \lambda }^{t} \int _{\delta }^{\infty }\theta (t-s)^{\alpha -1}\phi _{ \alpha }(\theta )S \bigl((t-s)^{\alpha }\theta \bigr) F(s,x(s)\,d\omega (s)\,ds \Vert ^{2} \\ & \quad\quad {} +4\alpha ^{2}\sup_{t\in J{'}} t^{2(1-\alpha )} E \biggl\Vert \int _{t- \lambda }^{t} \int _{\delta }^{\infty }\theta (t-s)^{\alpha -1}\phi _{ \alpha }(\theta )S \bigl((t-s)^{\alpha }\theta \bigr)\sigma (s)\,dB^{H}_{Q}(s) \biggr\Vert ^{2} \\ & \quad \leq 4\alpha ^{2} b^{2-2\alpha }M^{2} \operatorname{Tr}Q\Lambda \vartheta (r) \Vert N \Vert _{L^{ \frac{1}{2\alpha _{1}-1}}} \biggl( \int _{0}^{\delta }\theta \phi _{\alpha }( \theta )\,d \theta \biggr)^{2} \\ & \quad\quad {} +4\alpha ^{2}c_{0}H(2H-1) b^{2H+1-2\alpha }M^{2} \Lambda \biggl( \int _{0}^{ \delta }\theta \phi _{\alpha }(\theta )\,d \theta \biggr)^{2} \\ & \quad\quad {} \times \biggl( \int _{0}^{t} \bigl\Vert \sigma (s) \bigr\Vert ^{\frac{2}{2\alpha _{1}-1}}\,ds \biggr)^{2 \alpha _{1}-1} \\ & \quad\quad {} +4\alpha ^{2} b^{2-2\alpha }M^{2} \operatorname{Tr}Q \vartheta (r) \Vert N \Vert _{L^{ \frac{1}{2\alpha _{1}-1}}} \frac{1}{\Gamma ^{2}(\alpha +1)} \frac{\lambda ^{(1+c)(2-2\alpha _{1})}}{(1+c)^{2-2\alpha _{1}}} \\ & \quad\quad {} +4\alpha ^{2} c_{0}H(2H-1)b^{2H+1-2\alpha }M^{2} \frac{1}{\Gamma ^{2}(\alpha +1)} \frac{\lambda ^{(1+c)(2-2\alpha _{1})}}{(1+c)^{2-2\alpha _{1}}} \\ & \quad\quad {} \times \biggl( \int _{0}^{\lambda } \bigl\Vert \sigma (s) \bigr\Vert ^{ \frac{2}{2\alpha _{1}-1}}\,ds \biggr)^{2\alpha _{1}-1}, \end{aligned}$$

where we have used the equality

$$ \int _{0}^{\infty }\theta ^{\xi }\phi _{\alpha }(\theta )\,d\theta = \int _{0}^{ \infty }\frac{1}{\theta ^{\alpha \xi }}\psi _{\alpha }( \theta )\,d\theta = \frac{\Gamma (1+\xi )}{\Gamma (1+\alpha \xi )}, \quad \xi \in [0,1]. $$

The right-hand side of the above inequality tends to zero as \(\lambda ,\delta \rightarrow 0\). So we can deduce that \(\Vert (\Psi _{2}x)(t)-(\Psi _{2}^{\lambda ,\delta }x)(t)\Vert _{C_{\alpha }} \rightarrow 0\) as \(\lambda ,\delta \rightarrow 0^{+}\) which enables us to claim that there are relatively compact sets arbitrarily close to the set \(V(t)=\{(\Psi _{2}x)(t), x\in B_{r}\}\). Hence, \(V(t)=\{(\Psi _{2}x)(t), x\in B_{r}\}\) is relatively compact in X.

We deduce, from Claims 1–3 and the Arzola–Ascoli theorem, that \(\Psi _{2}\) is a completely continuous map. Using Krasnoselskii’s fixed point theorem, we claim that the operator equation \(\Psi x = \Psi _{1}x+\Psi _{2}x\) has a fixed point on \(B_{r}\) which is a mild solution for system (1.1). The proof is complete. □

To give our last existence theorem, we require the following hypotheses:

(\(\mathrm{H}_{0}\)):

\(S(t)\) is continuous in the uniform operator topology for \(t\geq 0\), and \(\{S(t)\}_{t\geq 0}\) is uniformly bounded, i.e., there exists \(M\geq 1\) such that \(\sup_{t\in [0,+\infty )}\vert S(t)\vert \leq M\);

(\(\mathrm{H}_{6}\)):

there exists positive constant L such that for any \(x_{1},x_{2}\in C_{\alpha }(J,X)\), we have \(E\Vert g(x_{1})-g(x_{2})\Vert ^{2}\leq L\Vert x_{1}-x_{2}\Vert _{C_{\alpha }}\);

(\(\mathrm{H}_{7}\)):

there exists a function \(N_{1}(t)\in L^{\frac{1}{2\alpha _{1}-1}}(J)\), \(\alpha _{1}\in [ \frac{1}{2},\alpha )\), such that for any \(x,y\in X\), \(t\in J\), we have

$$ E \bigl\Vert F \bigl(t,x(t) \bigr)-F \bigl(t,y(t) \bigr) \bigr\Vert ^{2}\leq N_{1}(t)\cdot \Vert x-y \Vert _{C_{\alpha }}. $$

For convenience, let

$$\begin{aligned} M{'} =&4b^{2(1-\alpha )}\frac{M^{2}}{\Gamma ^{2}(\alpha )}L+4b^{2(1- \alpha )}M^{2}_{0}L+4b^{2(1-\alpha +\alpha \beta )}K^{2}( \alpha , \beta )L \\ & {} +4b^{2(1-\alpha )}\operatorname{Tr}Q\frac{M^{2}}{\Gamma ^{2}(\alpha )} \Lambda \Vert N_{1} \Vert _{L^{\frac{1}{2\alpha _{1}-1}}}. \end{aligned}$$

To end this section, we shall proceed with our last existence and uniqueness theorem for system (1.1) based on the Banach contraction principle.

Theorem 3.2

Assume that hypotheses (\(\mathrm{H}_{0}\)), (\(\mathrm{H}_{2}\))(\(\mathrm{H}_{7}\)) hold, then system (1.1) has a unique mild solution on \(B_{r}\) provided that \(M{'}<1\).

Proof

Define operator Ψ as in Theorem 3.1. Then by similar arguments employed in Theorem 3.1, we can get that operator Ψ maps \(B_{r}\) into itself, where \(B_{r}\) is defined as in Theorem 3.1.

Moreover, we have

$$\begin{aligned}& \bigl\Vert (\Psi x) (t)-(\Psi y) (t) \bigr\Vert ^{2}_{C_{\alpha }} \\& \quad =\sup_{t\in J{'}}t^{2(1-\alpha )}E \bigl\Vert (\Psi x) (t)-( \Psi y) (t) \bigr\Vert ^{2} \\& \quad \leq 4\sup_{t\in J{'}}t^{2(1-\alpha )}E \bigl\Vert \mathcal{P}_{ \alpha }(t) \bigl[g(x)-g(y) \bigr] \bigr\Vert ^{2} \\& \quad \quad {} +4\sup_{t\in J{'}}t^{2(1-\alpha )}E \bigl\Vert h \bigl(t,x(t) \bigr)-h \bigl(t,y(t) \bigr) \bigr\Vert ^{2} \\& \quad \quad {} +4\sup_{t\in J{'}}t^{2(1-\alpha )}E \biggl\Vert \int _{0}^{t}(t-s)^{ \alpha -1}A \mathcal{P}_{\alpha }(t-s) \bigl[h \bigl(s,x(s) \bigr)-h \bigl(s,y(s) \bigr) \bigr]\,ds \biggr\Vert ^{2} \\& \quad \quad {} +4\sup_{t\in J{'}}t^{2(1-\alpha )}E \biggl\Vert \int _{0}^{t}(t-s)^{ \alpha -1} \mathcal{P}_{\alpha }(t-s) \bigl[F \bigl(s,x(s) \bigr)-F \bigl(s,y(s) \bigr) \bigr]\,d \omega (s) \biggr\Vert ^{2} \\& \quad \leq 4\sup_{t\in (0,b]}t^{2(1-\alpha )} \frac{M^{2}}{\Gamma ^{2}(\alpha )}E \bigl\Vert g(x)-g(y) \bigr\Vert ^{2} \\& \quad \quad {} +4\sup_{t\in J{'}}t^{2(1-\alpha )} \bigl\Vert A^{-\beta } \bigr\Vert ^{2}E \bigl\Vert A^{ \beta }h \bigl(t,x(t) \bigr)-A^{\beta }h \bigl(t,y(t) \bigr) \bigr\Vert ^{2} \\& \quad \quad {} +4\sup_{t\in J{'}}t^{2(1-\alpha )} \int _{0}^{t} \bigl\Vert (t-s)^{ \alpha -1}A^{1-\beta }{P}_{\alpha }(t-s) \bigr\Vert \,ds \\& \quad \quad {} \times \int _{0}^{t}(t-s)^{\alpha -1}A^{1-\beta } \mathcal{P}_{ \alpha }(t-s)E \bigl\Vert A^{\beta }h \bigl(s,x(s) \bigr)-A^{\beta }h \bigl(s,y(s) \bigr) \bigr\Vert ^{2}\,ds \\& \quad \quad {} +4\sup_{t\in (0,b]}\operatorname{Tr}Q \frac{M^{2}}{\Gamma ^{2}(\alpha )} \int _{0}^{t}(t-s)^{2\alpha -2}E \bigl\Vert F \bigl(s,x(s) \bigr)-F \bigl(s,y(s) \bigr) \bigr\Vert ^{2}\,ds \\& \quad \leq 4b^{2(1-\alpha )}\frac{M^{2}}{\Gamma ^{2}(\alpha )}L \Vert x-y \Vert _{C_{ \alpha }}+4b^{2(1-\alpha )}M^{2}_{0}L \Vert x-y \Vert _{C_{\alpha }} \\& \quad \quad {} +4b^{2(1-\alpha +\alpha \beta )}K^{2}(\alpha ,\beta )L \Vert x-y \Vert _{C_{ \alpha }} \\& \quad \quad {} +4b^{2(1-\alpha )}\operatorname{Tr}Q\frac{M^{2}}{\Gamma ^{2}(\alpha )} \frac{b^{(1+c)(2-2\alpha _{1})}}{(1+c)^{2-2\alpha _{1}}} \Vert N_{1} \Vert _{L^{ \frac{1}{2\alpha _{1}-1}}} \Vert x-y \Vert _{C_{\alpha }} \\& \quad = \biggl[4b^{2(1-\alpha )}\frac{M^{2}}{\Gamma ^{2}(\alpha )}L+4b^{2(1- \alpha )}M^{2}_{0}L+4b^{2(1-\alpha +\alpha \beta )}K^{2}( \alpha , \beta )L \\& \quad\quad {} +4b^{2(1-\alpha )}\operatorname{Tr}Q\frac{M^{2}}{\Gamma ^{2}(\alpha )} \Lambda \Vert N_{1} \Vert _{L^{\frac{1}{2\alpha _{1}-1}}} \biggr] \Vert x-y \Vert _{C_{ \alpha }} \\& \quad < \Vert x-y \Vert _{C_{\alpha }}. \end{aligned}$$

Hence, the Banach contraction principle implies that Ψ has a unique fixed point in \(B_{r}\) which is a mild solution for system (1.1). This completes the proof. □

4 An example

As an application, we present an example to illustrate our results. Consider the following fractional stochastic evolution equation driven by both fBm and Wiener process:

$$\begin{aligned} \textstyle\begin{cases} {}^{L}\mathcal{D}^{\frac{3}{4}}[u(t,z)-\int _{0}^{\pi }W(z,y)u(t,y)\,dy]= u_{zz}(t,z)+ \hat{F}(t,u(t)(z)\frac{d\omega (t)}{dt}, \\ \hphantom{{}^{L}\mathcal{D}^{\frac{3}{4}}[u(t,z)-\int _{0}^{\pi }W(z,y)u(t,y)\,dy]=} {} +\hat{\sigma }(t,u(t)(z) \frac{dB_{Q}^{H}(t)}{dt}, \quad t\in (0,b], z\in [0,\pi ], \\ u(t,0)=u(t,\pi )=0, \quad t\in J=[0,b], \\ \mathcal{I}^{\frac{1}{4}}(u(t,z)-\sum_{i=1}^{n}\int _{0}^{ \pi }k(z,y)u(t_{i},y)\,dy)=u_{0}(z), \quad z\in [0,\pi ], \end{cases}\displaystyle \end{aligned}$$
(4.1)

where \({}^{L}\mathcal{D}^{\frac{3}{4}}\) denotes the Riemann–Liouville fractional derivative of order \(\frac{3}{4}\), \(\mathcal{I}^{\frac{1}{4}}\) is a Riemann–Liouville integral of order \(\frac{1}{4}\), n is a positive integer, \(0 < t_{0} < t_{1} < \cdots < t_{n} < b\), \(z\in [0,\pi ]\).

To write the above system (4.1) into the abstract form of (1.1), we choose the space \(X=L^{2}[0,\pi ]\). Next we define an operator A by \(Av=v{''}\) with the domain \(D(A)=\{v\in X:v,v{'}\text{ absolutely continuous}, v{''}\in X,v(0)=v(\pi )=0\}\). Then A is a generator of a strongly continuous semigroup \(\{S(t)_{t\geq 0}\}\) which, as we know, is compact, analytic, and self-adjoint.

Moveover, from the previous work [25], A has a discrete spectrum, the eigenvalues of A are \(-n^{2},n\in N\) with corresponding orthogonal eigenvectors \(e_{n}(z)=\sqrt{\frac{2}{\pi }} \sin (nz)\). Then \(Az=\sum_{n=1}^{\infty }n^{2}\langle z,e_{n}\rangle e_{n}\). On the other hand, we know that

  1. (i)

    for each \(v\in X\), \(S(t)v=\sum_{n=1}^{\infty }e^{-n^{2}t}\langle v,e_{n} \rangle e_{n}\), in addition, \(S(\cdot )\) is a uniformly stable semigroup and \(\Vert S(t)\Vert \leq e^{-t}\);

  2. (ii)

    for each \(v\in X\), \(A^{-\frac{1}{2}}v=\sum_{n=1}^{\infty }\frac{1}{n} \langle v,e_{n}\rangle e_{n}\) and \(\Vert A^{-\frac{1}{2}}\Vert ^{2}=1\);

  3. (iii)

    the operator \(A^{\frac{1}{2}}\) is given by \(A^{\frac{1}{2}}v=\sum_{n=1}^{\infty }n\langle v,e_{n} \rangle e_{n}\in X\) on the space \(D(A^{\frac{1}{2}})=\{v(\cdot )\in X,\sum_{n=1}^{\infty } \langle v,e_{n}\rangle e_{n}\in X\}\).

Letting \((W_{h}v)(z)=\int _{0}^{\pi }W(z,y)v(y)\,dy\), for \(v\in E=L^{2}([0,\pi ],\mathbb{R})\), \(z\in [0,\pi ]\), we assume that the following assumptions hold:

\((\bar{a})\):

\(\omega (s)\) denotes a one-dimensional standard Brownian motion;

\((\bar{b})\):

the function \(W(z,y),z,y\in [0,\pi ]\) is measurable and

$$ \int _{0}^{\pi } \int _{0}^{\pi }W^{2}(z,y)\,dy\,dz< \infty ; $$
\((\bar{c})\):

the function \(\partial _{z}W(z,y)\) is measurable, \(W(0,y)=W(\pi ,y)=0\), and

$$ \bar{\Lambda }= \biggl( \int _{0}^{\pi } \int _{0}^{\pi } \bigl(\partial _{z}W(z,y) \bigr)^{2}\,dy\,dz \biggr)^{ \frac{1}{2}}< L< \infty . $$

Note that \((\bar{c})\) enables us to show that \(W_{h}\) is a bounded linear operator on X. Furthermore, \(W_{h}(v)\in D(A^{\frac{1}{2}})\), and \(\Vert A^{\frac{1}{2}}W_{h}\Vert _{L^{2}[0,\pi ]}<\infty \). Indeed, the definition of \(W_{h}\) and (ii) yield that

$$ \bigl\langle W_{h}(v),e_{n} \bigr\rangle = \int _{0}^{\pi }e_{n}(z) \biggl( \int _{0}^{\pi }W(z,y)v(y)\,dy \biggr)\,dz= \frac{1}{n}\sqrt{\frac{2}{\pi }} \bigl\langle \bar{W}(v),\cos (nz) \bigr\rangle , $$

where is defined by

$$ \bigl(\bar{W}(v) \bigr) (z)= \int _{0}^{\pi }W_{z}(z,y)v(y)\,dy. $$

We know from \((\bar{b})\) that \(\bar{W}:X\rightarrow X\) is a bounded linear operator with \(\Vert \bar{W}\Vert _{L^{2}[0.b]}\leq \bar{\Lambda }\). Hence we can write \(\Vert A^{\frac{1}{2}}W_{h}(v)\Vert ^{2}_{L^{2}[0,\pi ]}=\Vert \bar{W}(v)\Vert ^{2}_{L^{2}[0, \pi ]}\).

  1. (iv)

    For the function \(\hat{F} : [0, b] \times [0,\pi ] \rightarrow [0, \pi ]\) the following conditions are satisfied:

    1. (1)

      for each \(s \in [0, b], \hat{F}( s,\cdot )\) is continuous, and for each \(u\in X, \hat{F}(\cdot ,u )\) is measurable;

    2. (2)

      there exist a function \(N(t)\in L^{\frac{1}{2\alpha _{1}-1}}(J)\), \(\alpha _{1}\in [\frac{1}{2}, \alpha )\) and a continuous nondecreasing function \(\vartheta :[0,\infty )\to (0,\infty )\) such that for any \((t,u)\in J\times X\), we have \(E\Vert F(t,u(t))\Vert ^{2}\leq N(t)\times \vartheta (\Vert u\Vert _{C_{1-\alpha }})\), \(\liminf_{r\rightarrow \infty }\frac{\vartheta (r)}{r}\,ds= \Theta <\infty \).

Define the fractional Brownian motion in Y by

$$ B_{Q}^{H}(t) =\sum_{n=1}^{\infty } \sqrt{(}\lambda _{n})B_{n}^{H}(t)e_{n}, $$

where \(H \in (\frac{1}{2}, 1)\) and \(\{B^{H}_{n}, n\in N\}\) is a sequence of one-dimensional fractional Brownian motions which are mutually independent. Let us assume that the function \(\hat{\sigma } : [0,+\infty ) \rightarrow \mathcal{L}_{2}^{0}(L^{2}([0, 1]), L^{2}([0, 1]))\) satisfies

$$ \int _{0}^{b} \bigl\Vert \hat{\sigma }(s) \bigr\Vert _{L_{0}^{2}}^{ \frac{2}{2\alpha _{1}-1}}\,ds< \infty , \quad \forall b>0. $$

Letting \(u(t)(z)=u(t,z)\), \(t\in J\), \(z\in [0,\pi ]\), we define \(h:[0, b ]\times X\rightarrow X \), \(F:[0, b ]\times X\rightarrow L (K,X)\) and \(g: E\rightarrow X \) by \(h(t,u) = W_{h}(u) \), \(\hat{F}(s,u)(z) = F(s,u(z))\), \(g(u) = \sum_{i=0}^{p}\bar{Q}u(t_{i})\) and \(\sigma (t)=\hat{\sigma }(t)\), respectively, where

$$ \bar{Q}(u)= \int _{0}^{\pi }k(y,z)u(y)\,dy. $$

With the above choices of A, F, h, σ, system (4.1) can be seen as an abstract form of system (1.1). On the other hand, suppose that the assumptions of Theorem 3.1 hold. Thus, using Theorem 3.1, we claim that system (4.1) admits a mild solution on \([0, b]\) under the above additional assumptions.

5 Conclusion

In this paper, we have considered a class of Riemann–Liouville fractional stochastic evolution equations. In particular, the fixed point technique, fractional calculus, and stochastic analysis were used for achieving the sufficient conditions to ensure the existence of mild solutions of Riemann–Liouville fractional stochastic evolution equations driven by Wiener process and fBm. We last gave an illustrative example. Our future work will address the explosive solutions of fractional Navier–Stokes stochastic differential equations driven by fBm and multiplicative noise.

Availability of data and materials

Not applicable.

References

  1. Ahmed, H.M., El-Borai, M.M.: Hilfer fractional stochastic integro-differential equations. Appl. Math. Comput. 331(1), 182–189 (2018)

    MathSciNet  MATH  Google Scholar 

  2. Byszewski, L., Lakshmikantham, V.: Theorem about the existence and uniqueness of a solution of a nonlocal abstract Cauchy problem in a Banach space. Appl. Anal. 40(1), 11–19 (1991)

    Article  MathSciNet  MATH  Google Scholar 

  3. Cui, J., Yan, L.: Existence result for fractional neutral stochastic integro-differential equations with infinite delay. J. Phys. A, Math. Theor. 44(33), 335201 (2011)

    Article  MathSciNet  Google Scholar 

  4. Deng, S.F., Shu, X.B., Mao, J.Z.: Existence and exponential stability for impulsive neutral stochastic functional differential equations driven by fBm with noncompact semigroup via Monch fixed point. J. Math. Anal. Appl. 467(1), 398–420 (2018)

    Article  MathSciNet  MATH  Google Scholar 

  5. Furati, K.M., Kassim, M.D., Tatar, N.e-.: Existence and uniqueness for a problem involving Hilfer factional derivative. Comput. Math. Appl. 64(6), 1612–1626 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  6. Gu, H.B., Trujillo, J.J.: Existence of mild solution for evolution equation with Hilfer fractional derivative. Appl. Math. Comput. 257(1), 344–354 (2015)

    MathSciNet  MATH  Google Scholar 

  7. Hilfer, R.: Applications of Fractional Calculus in Physics. World Scientific, Singapore (2000)

    Book  MATH  Google Scholar 

  8. Kilbas, A.A., Srivastava, H.M., Trujillo, J.J.: Theory and Application of Fractional Differential Equations. North-Holland Mathematics Studies, vol. 204. Elsevier, Amsterdam (2006)

    MATH  Google Scholar 

  9. Lakhel, E., McKibben, M.A.: Existence of solutions for fractional neutral functional differential equations driven by fBm with infinite delay. Stochastics 90(3), 313–329 (2018)

    Article  MathSciNet  Google Scholar 

  10. Li, K.X., Peng, J.G., Jia, J.X.: Cauchy problems for fractional differential equations with Riemann–Liouville fractional derivatives. J. Funct. Anal. 263(2), 476–510 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  11. Lin, A., Hu, L.: Existence results for impulsive neutral stochastic functional integro-differential inclusions with nonlocal initial conditions. Comput. Math. Appl. 59(1), 64–73 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  12. Liu, Y.L., Lv, J.Y.: Existence results for Riemann–Liouville fractional neutral evolution equations. Adv. Differ. Equ. 2014(1), 83 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  13. Liu, Z.H., Li, X.W.: Existence and uniqueness of solutions for the nonlinear impulsive fractional differential equations. Commun. Nonlinear Sci. Numer. Simul. 18(6), 1362–1373 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  14. Mainardi, F.: Fractional Calculus: Some Basic Problems in Continuum and Statistical Mechanics. CISM Courses and Lectures, vol. 378. Springer, Vienna (1997)

    MATH  Google Scholar 

  15. Miller, K.S., Ross, B.: An Introduction to the Fractional Calculus and Differential Equations. Wiley, New York (1993)

    MATH  Google Scholar 

  16. Mophou, G.M.: Existence and uniqueness of mild solutions to impulsive fractional differential equations. Nonlinear Anal. TMA 72(3), 1604–1615 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  17. Podlubny, I.: Fractional Differential Equations. Academic Press, San Diego (1999)

    MATH  Google Scholar 

  18. Sakthivel, R., Revathi, P., Ren, Y.: Existence of solutions for nonlinear fractional stochastic differential equations. Nonlinear Anal. TMA 81(1), 70–86 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  19. Shu, X.B., Lai, Y., Chen, Y.: The existence of mild solutions for impulsive fractional partial differential equations. Nonlinear Anal. TMA 74(5), 2003–2011 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  20. Wang, R.N., Chen, D.H., Xiao, T.J.: Abstract fractional Cauchy problems with almost sectorial operators. J. Differ. Equ. 252(1), 202–235 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  21. Xu, L.P., Li, Z.: Stochastic fractional evolution equations with fractional Brownian motion and infinite delay. Appl. Math. Comput. 336(1), 36–46 (2018)

    MathSciNet  MATH  Google Scholar 

  22. Yang, M., Wang, Q.R.: Approximate controllability of Riemann–Liouville fractional differential inclusions. Appl. Math. Comput. 274(1), 267–281 (2016)

    MathSciNet  MATH  Google Scholar 

  23. Zhou, Y.: Basic Theory of Fractional Differential Equations. World Scientific, Singapore (2014)

    Book  MATH  Google Scholar 

  24. Zhou, Y.: Attractivity for fractional evolution equations with almost sectorial operators. Fract. Calc. Appl. Anal. 21(3), 786–800 (2018)

    Article  MathSciNet  MATH  Google Scholar 

  25. Zhou, Y., Jiao, F.: Existence of mild solutions for fractional neutral evolution equations. Comput. Math. Appl. 59(3), 1063–1077 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  26. Zhou, Y., Zhang, L., Shen, X.H.: Existence of mild solutions for fractional evolution equations. J. Integral Equ. Appl. 25(4), 557–585 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  27. Zou, G.A.: A Galerkin finite element method for time-fractional stochastic heat equation. Comput. Math. Appl. 75(11), 4135–4150 (2018)

    Article  MathSciNet  MATH  Google Scholar 

  28. Zou, G.A., Wang, B.: Solitary wave solutions for nonlinear fractional Schrödinger equation in Gaussian nonlocal media. Appl. Math. Lett. 88(1), 50–57 (2019)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Funding

This work is supported by National Natural Science Foundation of China (Grant Nos. 12001393, 11961069), Natural Science Foundation of Shanxi (201901D211103), Natural Science Foundation of Xinjiang (2019D01A71), Scientific Research Programs of Colleges in Xinjiang (XJEDU2018Y033), Outstanding Young Science and technology personnel Training program of Xinjiang(2019Q022).

Author information

Authors and Affiliations

Authors

Contributions

All authors have contributed equally. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Haibo Gu.

Ethics declarations

Competing interests

The authors declare that they have no competing interests.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yang, M., Gu, H. Riemann–Liouville fractional stochastic evolution equations driven by both Wiener process and fractional Brownian motion. J Inequal Appl 2021, 8 (2021). https://doi.org/10.1186/s13660-020-02541-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13660-020-02541-3

Keywords