# Limit distribution for a semi-Markovian random walk with Weibull distributed interference of chance

- Tülay Kesemen
^{1}Email author, - Rovshan Aliyev
^{2, 3}and - Tahir Khaniyev
^{3, 4}

**2013**:134

https://doi.org/10.1186/1029-242X-2013-134

© Kesemen et al.; licensee Springer 2013

**Received: **23 November 2012

**Accepted: **12 March 2013

**Published: **29 March 2013

## Abstract

In this paper, a semi-Markovian random walk with a discrete interference of chance $(X(t))$ is considered. In this study, it is assumed that the sequence of random variables $\{{\zeta}_{n}\}$, $n=1,2,\dots $ , which describes the discrete interference of chance, forms an ergodic Markov chain with the Weibull stationary distribution. Under this assumption, the ergodic theorem for the process $X(t)$ is discussed. Then the weak convergence theorem is proved for the ergodic distribution of the process $X(t)$ and the limit form of the ergodic distribution is derived.

**MSC:**60G50, 60K15, 60F99.

### Keywords

semi-Markovian random walk discrete interference of chance ergodic distribution weak convergence asymptotic expansion ladder variables## 1 Introduction

Many interesting problems of stochastic finance, mathematical biology, reliability, queuing, stochastic inventory and mathematical insurance can be expressed by means of random walk processes. Some important studies on this topic exist in literature (see, for example, Aliyev *et al.* [1–3]; Alsmeyer [4]; Borovkov [5]; Khaniyev *et al.* [8, 9]; Lotov [10]; Rogozin [11]; Skorohod and Slobodenyuk [12]; Spitzer [13]*etc.*).

Note that in the studies of Khaniyev *et al.* [9] and Aliyev *et al.* [1, 2], the random variables ${\zeta}_{n}$, $n=1,2,3,\dots $ , which describe the discrete interference of chance, have exponential, gamma and triangular distribution, respectively, and stationary moments of the ergodic distribution of a semi-Markovian random walk process have been investigated. Moreover, Aliyev *et al.* [3] and Khaniyev and Atalay [8] investigated a weak convergence theorem for the ergodic distribution of the renewal-reward process when the random variables ${\zeta}_{n}$, $n=1,2,3,\dots $ , have gamma and triangular distribution, respectively. In this study, unlike Aliyev *et al.* [1–3] and Khaniyev *et al.* [8, 9], we assume that the random variables ${\zeta}_{n}$, $n=1,2,3,\dots $ , which describe the discrete interference of chance, are independent and identically distributed random variables with the Weibull distribution, and the weak convergence theorem is proved for the ergodic distribution of a semi-Markovian random walk process, and the limit distribution is derived for the ergodic distribution of the considered process.

This process might be useful in the following situation.

### The model

Consider a stochastic model, which can be used in the field of insurance. This model can be described as follows.

Suppose that the amount of initial capital of an insurance company is equal to $z\in (0,\mathrm{\infty})$. Assume that the premiums and claims arrive at the insurance company randomly at the times ${T}_{n}={\sum}_{i=1}^{n}{\xi}_{i}$, $n\ge 1$, here ${\xi}_{i}$, $i\ge 1$, are the random time intervals between two successive claims and premiums. Level of total capital of the company fluctuates in accordance with $\{-{\eta}_{n}\}$, $n\ge 1$. The random variable ${\eta}_{n}$ expresses difference of claims and premiums, which can take both positive and negative values. The amount of the total capital of the insurance company continues its variation until a random time ${\tau}_{1}$ which is the time at which the capital level first falls below zero. When the above conditions take place, the amount of the company’s capital increases immediately to the level ${\zeta}_{1}$, which is a random variable having a certain distribution in the interval $(0,\mathrm{\infty})$. Thus, the first period is completed. Then the insurance company keeps working in a way similar to the previous period with a new initial capital ${\zeta}_{1}$ and so on.

Denote the stochastic process expressed this model mathematically by $X(t)$. Thus, the amount of capital of the insurance company at each time t is represented by the process $X(t)$. The process $X(t)$ is known to be as a semi-Markovian random walk process with a discrete interference of chance.

We now proceed to a mathematical construction of the process $X(t)$.

## 2 Mathematical construction of the process $X(t)$

*i.e.*,

and $inf\{\mathrm{\varnothing}\}=+\mathrm{\infty}$ is stipulated.

Let ${\tau}_{0}=0$, ${\tau}_{1}\equiv \tau (z)={T}_{N(z)}={\sum}_{i=1}^{N(z)}{\xi}_{i}$, $z\ge 0$; ${\tau}_{n}={T}_{{N}_{1}+\cdots +{N}_{n}}$, $n\ge 2$, and define $\nu (t)$ as $\nu (t)=max\{n\ge 0:{T}_{n}\le t\}$.

if ${\tau}_{n}\le t<{\tau}_{n+1}$, $n=0,1,2,\dots $ ; ${\zeta}_{0}\equiv z\in (0,\mathrm{\infty})$.

Note that the process $X(t)$ describes the amount of the total capital of an insurance company at any time $t\ge 0$.

The main purpose of this study is to prove the weak convergence theorem for the ergodic distribution of the process $X(t)$, as $\lambda \to 0$. For this aim, we first discuss the ergodicity of the process $X(t)$.

## 3 The ergodicity of the process $X(t)$

State the following proposition on the ergodicity of the process $X(t)$.

**Proposition 3.1** (Ergodic theorem [1])

*Let the initial sequences of the random variables*$\{{\xi}_{n}\}$, $\{{\eta}_{n}\}$

*and*$\{{\zeta}_{n}\}$, $n\ge 1$,

*satisfy the following supplementary conditions*:

*Then the process*$X(t)$

*is ergodic*,

*and for any bounded measurable function*$f(x)$; $(f:[0,\mathrm{\infty})\to R)$,

*the following relation holds with probability one*:

*Here*,

*ζ*

*is a random variable with a distribution function*$\pi (z)$

*and*

*Proof* The process $X(t)$ belongs to a wide class of processes which is called ‘The class of semi-Markov processes with a discrete interference of chance’ in literature. General ergodic theorem of type ‘Smith’s key renewal theorem’ exists in literature for this class (see, Gihman and Skorohod [7], p.243). It is not difficult to show that the assumptions of the general ergodic theorem are satisfied under the conditions of Proposition 3.1. Therefore, the ergodicity of the process $X(t)$ is derived by using this general ergodic theorem. □

**Corollary 3.1**

*The ergodic distribution function*$({Q}_{X}(x))$

*of the process*$X(t)$

*can be written as follows*:

*Proof* Substituting the indicator function instead of the $f(x)$ in Eq. (1), we can obtain Eq. (2). □

Now we define the characteristic function of the ergodic distribution of the process $X(t)$ as follows: ${\phi}_{X}(u)\equiv {lim}_{t\to \mathrm{\infty}}E\{exp(iuX(t))\}$, $u\in R$.

**Corollary 3.2**

*The characteristic function*$({\phi}_{X}(u))$

*of the ergodic distribution of the process*$X(t)$

*can be represented as follows*:

Using the basic identity for the random walks (see, Feller [6], p.514), from Eq. (3) we obtain the following lemma.

**Lemma 3.1**

*Let the conditions of Proposition*3.1

*be satisfied*.

*Then*,

*for each*$u\in R/\{0\}$,

*the characteristic function*${\phi}_{X}(u)$

*of the ergodic distribution of the process*$X(t)$

*can be expressed by means of the characteristics of the pair*$(N(z),{S}_{N(z)})$

*and the random variable*${\eta}_{1}$

*as follows*:

*where* $EN(\zeta )\equiv \alpha {\lambda}^{\alpha}{\int}_{0}^{\mathrm{\infty}}{z}^{\alpha -1}{e}^{-{(\lambda z)}^{\alpha}}EN(z)\phantom{\rule{0.2em}{0ex}}dz$; ${\phi}_{{S}_{N(z)}}(-u)=Eexp(-iu{S}_{N(z)})$; ${\phi}_{\eta}(-u)=Eexp(-iu{\eta}_{1})$.

## 4 Weak convergence theorem for the ergodic distribution of the process $X(t)$

In this section, we use the ladder variables of the random walk ${S}_{n}={\sum}_{i=1}^{n}{\eta}_{i}$, $n\ge 1$, with the initial state ${S}_{0}=0$. Let ${\nu}_{1}^{+}=min\{n\ge 1:{S}_{n}>0\}$, ${\chi}_{1}^{+}={S}_{{\nu}_{1}^{+}}={\sum}_{i=1}^{{\nu}_{1}^{+}}{\eta}_{i}$.

*i.e.*,

where ${F}_{+}^{\ast n}(x)$ is *n*-fold convolution of the distribution function ${F}_{+}(x)\equiv P\{{\chi}_{1}^{+}\le x\}$.

Our aim is to prove the weak convergence theorem for the ergodic distribution as $E(\zeta )\to \mathrm{\infty}$. For the Weibull distribution, it is known that $E(\zeta )=\frac{\mathrm{\Gamma}(1+(1/\alpha ))}{\lambda}$. In this study, *α* will be fixed. Therefore while $E(\zeta )\to \mathrm{\infty}$, the parameter *λ* should converge to zero. Hence, we need to give the following lemma first.

**Lemma 4.1**

*Let*$g(x)$ ($g:{R}^{+}\to R$)

*be a measurable and bounded function*,

*and let*${lim}_{x\to \mathrm{\infty}}g(x)=0$.

*Then*,

*for each*$\alpha >1$,

*the following asymptotic relationship holds*:

*Proof*Under the conditions of Lemma 4.1, for any $\epsilon >0$, there exists $m(\epsilon )>0$ such that for any $x\ge m(\epsilon )$, the inequality $|g(x)|<\epsilon $ holds. Choose $b>0$, such that ${\int}_{0}^{b}{e}^{-t}\phantom{\rule{0.2em}{0ex}}dt<\epsilon $. The function $g(x)$ is bounded. Therefore, for any $\lambda <\frac{{b}^{1/\alpha}}{m(\epsilon )}$, we have

where $M={max}_{x\ge 0}|g(x)|$.

Since *M* is finite and $\epsilon >0$ is an arbitrary positive number, the proof of Lemma 4.1 is completed. □

We can give the following lemma, which has a similar proof to that of Lemma 4.1.

**Lemma 4.2**

*Let*$g(x)$

*be defined as in Lemma*4.1

*and the function*${R}_{n}(x)$

*be defined as*${R}_{n}(x)\equiv {x}^{n}g(x)$, $n=-1,0,1,2,\dots $ .

*Then*,

*for each*$\alpha >1$,

*the following asymptotic relationship is true*,

*as*$\lambda \to 0$:

For the investigation of the asymptotic behavior of the ergodic distribution of the process $X(t)$ as $\lambda \to 0$, we define the auxiliary process ${W}_{\lambda}(t)$ as ${W}_{\lambda}(t)\equiv \lambda X(t)$ and investigate the asymptotic behavior of its ergodic distribution function. It is easily seen that the process ${W}_{\lambda}(t)$ is a linear transform of $X(t)$. Therefore, from Proposition 3.1, it is immediately follows that the process ${W}_{\lambda}(t)$ is also ergodic under the conditions of Proposition 3.1. Let us denote the characteristic function of the ergodic distribution of ${W}_{\lambda}(t)$ by ${\phi}_{{w}_{\lambda}}(u)$ and formulate the following statement.

**Theorem 4.1**

*Let the conditions of Proposition*3.1

*be satisfied*.

*Then*,

*for each*$x>0$

*and for all*$\alpha >1$,

*the family of ergodic distribution functions*${Q}_{{W}_{\lambda}}(x)\equiv {lim}_{t\to \mathrm{\infty}}P\{{W}_{\lambda}(t)\le x\}$

*of the process*${W}_{\lambda}(t)$

*weakly converges to a limit distribution function*$G(x)$

*as follows*,

*when*$\lambda \to 0$:

*where* $\mathrm{\Gamma}(\alpha )={\int}_{0}^{\mathrm{\infty}}{t}^{\alpha -1}{e}^{-t}\phantom{\rule{0.2em}{0ex}}dt$ *is Euler’s gamma function*.

Note that $G(x)$ is the limit distribution of a ‘residual waiting time’ (see, Feller [6], p.368).

*Proof*From Eq. (4) it is easily seen that the characteristic function of the process ${W}_{\lambda}(t)$ can be written as follows:

where $J(\alpha ,\lambda )=\alpha {\lambda}^{\alpha}{\int}_{0}^{\mathrm{\infty}}{x}^{\alpha -1}{e}^{-{(\lambda x)}^{\alpha}}g(x)\phantom{\rule{0.2em}{0ex}}dx$.

where ${\phi}_{\alpha ,1}(u)$ is the characteristic function of the Weibull distribution with parameter $(\alpha ,1)$.

Now we can investigate the asymptotic behavior of ${I}_{3}(\alpha ,\lambda )$ as $\lambda \to 0$.

The conditions $E{\eta}_{1}>0$ and $E{\eta}_{1}^{2}<\mathrm{\infty}$ ensure that ${\mu}_{2}\equiv E{({\chi}_{1}^{+})}^{2}$ is finite.

where ${\overline{S}}_{N(x)}\equiv {S}_{N(x)}-x$, ${\mu}_{k}=E{({\chi}_{1}^{+})}^{k}$, $k=1,2$.

It means that the family of characteristic functions $\{{\phi}_{{W}_{\lambda}}(u)\}$ converges to a limit characteristic function $\frac{{\phi}_{\alpha ,1}(u)-1}{iu\mathrm{\Gamma}(1+1/\alpha )}$. Here ${\phi}_{\alpha ,1}(u)$ is the characteristic function of the Weibull distribution with parameter $(\alpha ,1)$.

*i.e.*,

This completes the proof of Theorem 4.1. □

Note that $G(x)$ is the limit distribution for the ‘residual waiting time’ generating by the sequence $\{{\zeta}_{n}\}$ (see, Feller [6], p.386).

## 5 Conclusion

In this paper, a semi-Markovian random walk with a discrete interference of chance $(X(t))$ is considered and the ergodic theorem for this process is discussed under some conditions. Finally, the weak convergence theorem is proved for the ergodic distribution of the process ${W}_{\lambda}(t)\equiv \lambda X(t)$, and the limit form of the ergodic distribution $G(x)$ is established. Note that $G(x)$ is a limit distribution of a residual waiting time of a renewal process generated by the random variables having the Weibull distribution with parameters $(\alpha ,1)$. In the terms of insurance, here we derived the explicit form of the limit distribution of the amount of the capital of an insurance company which is working for a long time as $E(\zeta )\to \mathrm{\infty}$.

## Declarations

### Acknowledgements

Dedicated to Professor Hari M Srivastava.

## Authors’ Affiliations

## References

- Aliyev RT, Khaniyev TA, Kesemen T: Asymptotic expansions for the moments of a semi-Markovian random walk with gamma distributed interference of chance.
*Commun. Stat., Theory Methods*2010, 39: 130–143.MathSciNetView ArticleGoogle Scholar - Aliyev R, Kucuk Z, Khaniyev T: Three-term asymptotic expansions for the moments of the random walk with triangular distributed interference of chance.
*Appl. Math. Model.*2010, 34(11):3599–3607. 10.1016/j.apm.2010.03.009MathSciNetView ArticleGoogle Scholar - Aliyev RT, Khaniyev TA, Bekar NO: Weak convergence theorem for the ergodic distribution of the renewal-reward with gamma distributed interference of chance.
*Theory Stoch. Process.*2009, 15(31)(2):42–53.MathSciNetGoogle Scholar - Alsmeyer G: Some relations between harmonic renewal measure and certain first passage times.
*Stat. Probab. Lett.*1991, 12(1):19–27. 10.1016/0167-7152(91)90160-SMathSciNetView ArticleGoogle Scholar - Borovkov AA:
*Stochastic Process in Queuing Theory*. Springer, New York; 1976.View ArticleGoogle Scholar - Feller W:
*Introduction to Probability Theory and Its Applications II*. Wiley, New York; 1971.Google Scholar - Gihman II, Skorohod AV:
*Theory of Stochastic Processes II*. Springer, Berlin; 1975.View ArticleGoogle Scholar - Khaniyev TA, Atalay KD:On the weak convergence theorem for the ergodic distribution for an inventory model of type $(s,S)$.
*Hacet. J. Math. Stat.*2010, 39(4):599–611.MathSciNetGoogle Scholar - Khaniyev TA, Kesemen T, Aliyev RT, Kokangul A: Asymptotic expansions for the moments of a semi-Markovian random walk with exponential distributed interference of chance.
*Stat. Probab. Lett.*2008, 78(6):785–793. 10.1016/j.spl.2007.09.045MathSciNetView ArticleGoogle Scholar - Lotov VI: On some boundary crossing problems for Gaussian random walks.
*Ann. Probab.*1996, 24(4):2154–2171.MathSciNetView ArticleGoogle Scholar - Rogozin BA: On the distribution of the first jump.
*Theory Probab. Appl.*1964, 9(3):498–545.MathSciNetView ArticleGoogle Scholar - Skorohod AV, Slobodenyuk NP:
*Limit Theorems for the Random Walks*. Naukova Dumka, Kiev; 1970.Google Scholar - Spitzer F:
*Principles of Random Walks*. Van Nostrand, Princeton; 1964.View ArticleGoogle Scholar

## Copyright

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.