Asymptotic properties of least squares estimation for a new fuzzy autoregressive model

The time series forecasting investigates the relations on the sequential set of past data measured over time to forecast the future values. The area has been widely studied, and traditional forecasting is frequently conducted by statistical tools like regression analysis, moving average, integrated moving average, and autoregressive integrated moving average.

However, the deficiencies of traditional forecasting methods are that they cannot deal with forecasting problems in which historical data are linguistic values. In order to overcome the drawback of the traditional forecasting methods, in [1], Song and Chissom proposed the concepts of fuzzy time series to investigate the forecasting problem in which historical data are linguistic values. In [2] and [3], they proposed two fuzzy time series models to study the forecasting problems of enrollments of the University of Alabama. Some researchers such as [4, 5], and [6] have also proposed new fuzzy time series models to improve Song’s model. These fuzzy time series models have been applied to various practical questions such as temperature by Chen & Hwang [7], the stock index by Huarng [8], Huarng & Yu [9, 10], and Yu [11, 12]etc.

In particular, Ozawa [13] proposed a fuzzy auto-regressive (AR) model to forecast the data of living expenditure of workers’ household in Japan, where the identification and the estimation of its model and the model parameters are optimized by the linear programming problem under some conditions. Moreover, Niimura [14] presented a fuzzy auto-regressive model to estimate uncertain electricity market prices in deregulated industry environment, and parameters are also obtained by solving linear programming problems.

where $X_0$ is a constant triangular fuzzy number, $X_t$ are random fuzzy variables which are expressed by ${(x_t,{\xi }_t^l,{\xi }_t^r)}_{\mathrm{△}}$ with crisp random variables $x_t$, ${\xi }_t^l$, ${\xi }_t^r$, ${\mathrm{\Phi }}_t={({\epsilon }_t,{\theta }_t^l,{\theta }_t^r)}_{\mathrm{△}}$ are the fuzzy random errors, and $|\alpha |<1$ is unknown regression crisp parameter to be estimated on the basis of fuzzy observations $X_t$. Obviously, our model is different from the models that are discussed above. Moreover, this paper is devoted to the parameter estimation of the model and sets out the asymptotic properties of the estimation.

The rest of this paper is organized as follows. Section 2 briefly introduces the literature related to fuzzy sets, fuzzy numbers, and triangular fuzzy numbers (TFN), fuzzy time series. In Section 3, a fuzzy least squares estimation is proposed to estimate parameter α. The behaviors of the present estimator are investigated in Section 4, and the proofs of the theorems are given in Section 5. Finally, in Section 6, we deal with the test of the method through simulation studies.

In this section, we introduce some basic definitions regarding fuzzy number and fuzzy time series as well as some basic fuzzy theories.

In 1965, Zadeh [16] first introduced the concept of a fuzzy set for modeling the vagueness type of uncertainty. A fuzzy set A defined on the universe X is characterized by a membership function such that ${\mu }_A(x):x\to [0,1]$. The support of A, say $sup(A)$, is defined by the set $\{x\in X\mid {\mu }_A(x)>0\}$. For any $\alpha \in (0,1]$, the crisp set $A_{\alpha }=\{x\in X\mid {\mu }_A(x)>\alpha \}$ is called the α-cut of .

A fuzzy subset of the set of real numbers R with a membership function ${\mu }_A$ is called a fuzzy number if

1. (1)

   A is normal, i.e., there exists $x\in R$ such that ${\mu }_A(x)=1$.

    
2. (2)

   ${\mu }_A$ is upper semi-continuous.

    
3. (3)

   $sup(A)$ is compact.

    
4. (4)

   A is a convex fuzzy set, i.e., ${\mu }_A(\lambda x+(1-\lambda )y)\ge min({\mu }_A(x),{\mu }_A(y))$ for all $x,y\in R$ and $\lambda \in [0,1]$.

    

where $L:R^{+}\to [0,1]$ and $R:R^{+}\to [0,1]$ are fixed left-continuous and non-increasing functions with $L(0)=R(0)=1$, and $R^{+}$ denotes the set of nonnegative real numbers. L and R are called left and right shape functions, m the mode of A, and $l,r>0$ are the left/right spread of A. We abbreviate an LR-fuzzy number by $A={(m,l,r)}_{LR}$ and denote the set of all LR-fuzzy numbers by ${\mathcal{F}}_{LR}(R^1)$. If $L(x)=R(x)={[1-x]}^{+}$, then $A={(m,l,r)}_{LR}$ is called a triangular fuzzy number and is denoted by $A={(m,l,r)}_{\mathrm{△}}$. The set of all triangular fuzzy numbers is denoted by $\mathcal{T}(R^1)$. A linear structure is defined on $\mathcal{T}(R^1)$ by

where $X={(x,{\xi }^l,{\xi }^r)}_{\mathrm{△}}$ and $Y={(y,{\eta }^l,{\eta }^r)}_{\mathrm{△}}$ are two triangular fuzzy numbers in $\mathcal{T}(R^1)$.

which is defined by Kim et al. [15]. By using this modified metric, they have obtained the asymptotic theory of least squares estimator in a fuzzy linear regression model.

Based upon the fuzzy set theory, fuzzy time series models have been defined and studied by Song and Chissom [1]. Let $Y(t)$ ($t=\dots ,0,1,2,\dots$) be a subset of $R^1$ in which the universe of fuzzy sets $f_i(t)$ ($i=1,2,\dots ,m$) is defined and let $\mathbf{F}(\mathbf{t})$ be a collection of $f_i(t)$ ($i=1,2,\dots ,m$). Then $\mathbf{F}(\mathbf{t})$ is called a fuzzy time series on $Y(t)$ ($t=\dots ,0,1,2,\dots$).

It can be seen from the above definition that $\mathbf{F}(\mathbf{t})$ is a collection of $f_i(t)$ ($i=1,2,\dots ,m$) which are fuzzy sets defined on $R^1$ for a given $t\in T$. The main difference between the traditional time series and the fuzzy time series is that the former has numerical values as its observations, while the latter has fuzzy sets as its observations. One of the application areas of fuzzy time series is the forecasting problems under a fuzzy environment in which no numerical historical data are available but linguistic ones.

The solution of equation (3.2) is termed the fuzzy least squares estimation (FLSE) of α and denoted by $\hat{\alpha }$.

Note that if observations $\{X_t,t=0,1,\dots ,T\}$ of model (1.1) are crisp, i.e., ${\xi }_t^r={\xi }_t^l=0$, ${\theta }_t^l={\theta }_t^r=0$, then equation (3.2) and estimator (3.3) coincide with the classical least squares method.

In this section, we discuss the properties of the estimator. In order to obtain these properties, we need the following assumptions:

(A1) $\{({\epsilon }_t,{\theta }_t^l,{\theta }_t^r):t=1,2,\dots \}$ is a sequence of independent and identically distributed random vectors.

(A2) $E[{\epsilon }_t]=0$, $E[{\theta }_t^l]=E[{\theta }_t^r]$.

(A3) $Var[{\epsilon }_t]+Var[{\theta }_t^r]+Var[{\theta }_t^l]<\mathrm{\infty }$.

The following two lemmas are given by Diananda [18].

Lemma 4.1 Let $y_1,y_2,\dots$ , be a sequence of random variables such that the distribution of $(y_{t+t_1},y_{t+t_2},\dots ,y_{t+t_n})$ is independent of t for every $0\le t_1<t_2<\cdots <t_n$ and n and such that this collection is independent of $(y_{s+s_1},y_{s+s_2},\dots ,y_{s+s_p})$ for every $0\le s_1<s_2<\cdots <s_p$ and p if $s>t+t_n+m$. Assume $E{y}_t=0$, $E{y}_t^2<\mathrm{\infty }$, where p and m are positive integers. Then ${\sum }_{t=1}^T{y}_t/\sqrt{T}$ has a limiting normal distribution with mean 0 and variance $E{y}_1^2+2E{y}_1{y}_2+\cdots +2E{y}_1{y}_{m+1}$.

Lemma 4.2 Suppose that $\{H_T\}$, $\{Z_{T,S}\}$, $\{X_{T,S}\}$ are sequences of random variables. Let $H_T=Z_{T,S}+X_{T,S}$, $T=1,2,\dots$ , $S=1,2,\dots$ such that $E{X}_{T,S}^2\le M_S$, ${lim}_{S\to \mathrm{\infty }}{M}_S=0$, $P\{Z_{T,S}\le z\}=F_{T,S}(z)\to F_S(z)$, as $T\to \mathrm{\infty }$, ${lim}_{S\to \mathrm{\infty }}{F}_S(z)=F(z)$ at every continuity point. Then ${lim}_{T\to \mathrm{\infty }}P\{H_T\le z\}=F(z)$ at every continuity point of $F(z)$.

Now, we state our main results in the following theorems.

Theorem 4.1 Under the conditions of (A1)-(A3), let $M_T={\sum }_{t=1}^T{W}_t{W}_{t-1}-\alpha {\sum }_{t=1}^T{W}_{t-1}^2$. Then $M_T/\sqrt{T}\stackrel{L}{\to }N(0,{\sigma }^4/(1-{\alpha }^2))$, as $T\to \mathrm{\infty }$, where ${\sigma }^2=Var[{\epsilon }_t+({\theta }_t^r-{\theta }_t^l)/3]$, the notation $\stackrel{L}{\to }$ stands for convergence in distribution.

Theorem 4.2 Under the conditions of (A1)-(A3), let $B_T={\sum }_{t=1}^T{W}_{t-1}^2$. Then $B_T/T\stackrel{p}{\to }{\sigma }^2/(1-{\alpha }^2)$, as $T\to \mathrm{\infty }$, where ${\sigma }^2=Var[{\epsilon }_t+({\theta }_t^r-{\theta }_t^l)/3]$, where the notation $\stackrel{p}{\to }$ stands for convergence in probability.

Theorem 4.3 Under the conditions of (A1)-(A3), we have $\sqrt{T}(\hat{\alpha }-\alpha )\stackrel{L}{\to }N(0,1-{\alpha }^2)$ as $T\to \mathrm{\infty }$.

In this section, we give the proofs of the theorems.

Proof of Theorem 4.1 By (3.1) we have

Note that for all $|\alpha |<1$,

Let

Since $H_T$ is a linear combination of terms $u_t{u}_s$ ($t\ne s$), and each term is uncorrelated with other terms, we have

(5.3)

(5.4)

Then

Thus, combining Lemma 4.1, we prove (5.5). The theorem follows from (5.1)-(5.5) and Lemma 4.2. □

Proof of Theorem 4.2

Further, from

This, together with (5.6)-(5.9), completes the proof. □

Proof of Theorem 4.3

With the application of Slusky’s theorem and Theorems 4.1 and 4.2, we prove Theorem 4.3. □

In this section, we conduct some simulations to show the finite performance of the proposed method. The simulation uses the fuzzy autoregressive model (1.1).

From Table 1, we see that the estimation procedure works very well. For different sample sizes and different parameters, the average mean squared errors of $\hat{\alpha }$ are very small, and the average mean squared error of $\hat{\alpha }$ decreases as sample size increases. Furthermore, we also find that for the same sample size, the average mean squared error of $\hat{\alpha }$ decreases as the absolute value of the parameter becomes large.

In the second simulation, we illustrate the performance of the forecast procedure proposed above. We compare model (1.1) with the ordinary autoregressive model $X_t=\alpha X_{t-1}+{\epsilon }_t$, where ${\epsilon }_t$ is error sequence.

In this paper, we introduce a new fuzzy autoregressive model. The model can be considered as an extension of the standard autoregressive model since crisp values can be treated as degenerated fuzzy numbers. Least squares estimation is derived, and the asymptotic distribution of the proposed estimator is established. This estimation procedure is well defined because if we use crisp data instead of fuzzy observations, then our estimation reduces to the classical estimation. The simulation results indicate that the least squares estimation performs very well.

It should be noted that we here discuss the first-order autoregressive model with triangular fuzzy data. Further research needs to be undertaken to discover the analogous results for other models, such as the unstable first-order autoregressive model or high-order autoregressive model, with more complicated metrics and/or other types of fuzzy data. It is also interesting to consider the problem of testing hypotheses about the parameters in these models.