 Research
 Open Access
 Published:
Asymptotic properties of least squares estimation for a new fuzzy autoregressive model
Journal of Inequalities and Applications volume 2013, Article number: 56 (2013)
Abstract
In this paper, we extend the standard autoregressive model to the case where the explanatory and response variables are random fuzzy variables. The fuzzy leastsquares estimators (FLSE) of the model parameters are derived and their asymptotic properties are established. A simulation is conducted to evaluate our method, and it is found that the proposed method provides a better performance.
AMS Subject Classification:94D05, 62F12.
1 Introduction
The time series forecasting investigates the relations on the sequential set of past data measured over time to forecast the future values. The area has been widely studied, and traditional forecasting is frequently conducted by statistical tools like regression analysis, moving average, integrated moving average, and autoregressive integrated moving average.
However, the deficiencies of traditional forecasting methods are that they cannot deal with forecasting problems in which historical data are linguistic values. In order to overcome the drawback of the traditional forecasting methods, in [1], Song and Chissom proposed the concepts of fuzzy time series to investigate the forecasting problem in which historical data are linguistic values. In [2] and [3], they proposed two fuzzy time series models to study the forecasting problems of enrollments of the University of Alabama. Some researchers such as [4, 5], and [6] have also proposed new fuzzy time series models to improve Song’s model. These fuzzy time series models have been applied to various practical questions such as temperature by Chen & Hwang [7], the stock index by Huarng [8], Huarng & Yu [9, 10], and Yu [11, 12]etc.
In particular, Ozawa [13] proposed a fuzzy autoregressive (AR) model to forecast the data of living expenditure of workers’ household in Japan, where the identification and the estimation of its model and the model parameters are optimized by the linear programming problem under some conditions. Moreover, Niimura [14] presented a fuzzy autoregressive model to estimate uncertain electricity market prices in deregulated industry environment, and parameters are also obtained by solving linear programming problems.
Furthermore, the uncertainty of observations or the uncertainty of the model have been treated as having a stochastic error, and we generally analyze those data or system with the stochastic approach. In fact, Kim et al. [15] pointed out that two different kinds of uncertainty, vagueness and randomness, coexist within a model. Randomness resulting from measurement errors and fuzziness resulting from system fuzziness are two different kinds of uncertainty. Therefore, he extended the standard linear regression model to include specific cases where the observations are vague or even linguistic. In this paper, we further discover the analogous results for autoregressive models in time series analysis. Consider the following new fuzzy autoregressive model:
where {X}_{0} is a constant triangular fuzzy number, {X}_{t} are random fuzzy variables which are expressed by {({x}_{t},{\xi}_{t}^{l},{\xi}_{t}^{r})}_{\mathrm{\u25b3}} with crisp random variables {x}_{t}, {\xi}_{t}^{l}, {\xi}_{t}^{r}, {\mathrm{\Phi}}_{t}={({\epsilon}_{t},{\theta}_{t}^{l},{\theta}_{t}^{r})}_{\mathrm{\u25b3}} are the fuzzy random errors, and \alpha <1 is unknown regression crisp parameter to be estimated on the basis of fuzzy observations {X}_{t}. Obviously, our model is different from the models that are discussed above. Moreover, this paper is devoted to the parameter estimation of the model and sets out the asymptotic properties of the estimation.
The rest of this paper is organized as follows. Section 2 briefly introduces the literature related to fuzzy sets, fuzzy numbers, and triangular fuzzy numbers (TFN), fuzzy time series. In Section 3, a fuzzy least squares estimation is proposed to estimate parameter α. The behaviors of the present estimator are investigated in Section 4, and the proofs of the theorems are given in Section 5. Finally, in Section 6, we deal with the test of the method through simulation studies.
2 Preliminaries
In this section, we introduce some basic definitions regarding fuzzy number and fuzzy time series as well as some basic fuzzy theories.
In 1965, Zadeh [16] first introduced the concept of a fuzzy set for modeling the vagueness type of uncertainty. A fuzzy set A defined on the universe X is characterized by a membership function such that {\mu}_{A}(x):x\to [0,1]. The support of A, say sup(A), is defined by the set \{x\in X\mid {\mu}_{A}(x)>0\}. For any \alpha \in (0,1], the crisp set {A}_{\alpha}=\{x\in X\mid {\mu}_{A}(x)>\alpha \} is called the αcut of .
A fuzzy subset of the set of real numbers R with a membership function {\mu}_{A} is called a fuzzy number if

(1)
A is normal, i.e., there exists x\in R such that {\mu}_{A}(x)=1.

(2)
{\mu}_{A} is upper semicontinuous.

(3)
sup(A) is compact.

(4)
A is a convex fuzzy set, i.e., {\mu}_{A}(\lambda x+(1\lambda )y)\ge min({\mu}_{A}(x),{\mu}_{A}(y)) for all x,y\in R and \lambda \in [0,1].
Of extreme interest to us is the LRfuzzy number whose membership function is defined as follows:
where L:{R}^{+}\to [0,1] and R:{R}^{+}\to [0,1] are fixed leftcontinuous and nonincreasing functions with L(0)=R(0)=1, and {R}^{+} denotes the set of nonnegative real numbers. L and R are called left and right shape functions, m the mode of A, and l,r>0 are the left/right spread of A. We abbreviate an LRfuzzy number by A={(m,l,r)}_{LR} and denote the set of all LRfuzzy numbers by {\mathcal{F}}_{LR}({R}^{1}). If L(x)=R(x)={[1x]}^{+}, then A={(m,l,r)}_{LR} is called a triangular fuzzy number and is denoted by A={(m,l,r)}_{\mathrm{\u25b3}}. The set of all triangular fuzzy numbers is denoted by \mathcal{T}({R}^{1}). A linear structure is defined on \mathcal{T}({R}^{1}) by
Furthermore, Diamond [17] gave a metric d on the space \mathcal{T}({R}^{1}) of all triangular fuzzy numbers by
where X={(x,{\xi}^{l},{\xi}^{r})}_{\mathrm{\u25b3}} and Y={(y,{\eta}^{l},{\eta}^{r})}_{\mathrm{\u25b3}} are two triangular fuzzy numbers in \mathcal{T}({R}^{1}).
In this paper, we will use the modified metric
which is defined by Kim et al. [15]. By using this modified metric, they have obtained the asymptotic theory of least squares estimator in a fuzzy linear regression model.
Based upon the fuzzy set theory, fuzzy time series models have been defined and studied by Song and Chissom [1]. Let Y(t) (t=\dots ,0,1,2,\dots) be a subset of {R}^{1} in which the universe of fuzzy sets {f}_{i}(t) (i=1,2,\dots ,m) is defined and let \mathbf{F}(\mathbf{t}) be a collection of {f}_{i}(t) (i=1,2,\dots ,m). Then \mathbf{F}(\mathbf{t}) is called a fuzzy time series on Y(t) (t=\dots ,0,1,2,\dots).
It can be seen from the above definition that \mathbf{F}(\mathbf{t}) is a collection of {f}_{i}(t) (i=1,2,\dots ,m) which are fuzzy sets defined on {R}^{1} for a given t\in T. The main difference between the traditional time series and the fuzzy time series is that the former has numerical values as its observations, while the latter has fuzzy sets as its observations. One of the application areas of fuzzy time series is the forecasting problems under a fuzzy environment in which no numerical historical data are available but linguistic ones.
3 Fuzzy least squares estimators
In this section, we first present an estimator of parameter. Suppose then that we have observations \{{X}_{t},t=0,1,\dots ,T\} from model (1.1). We are interested in estimating α by trying to minimize the conditional sum of squares
Recalling the definition of the linear structure on \mathcal{T}({R}^{1}), we have
This implies
The estimation is actually obtained by solving the following least squares equation:
The solution of equation (3.2) is termed the fuzzy least squares estimation (FLSE) of α and denoted by \stackrel{\u02c6}{\alpha}.
Let
Then
Note that if observations \{{X}_{t},t=0,1,\dots ,T\} of model (1.1) are crisp, i.e., {\xi}_{t}^{r}={\xi}_{t}^{l}=0, {\theta}_{t}^{l}={\theta}_{t}^{r}=0, then equation (3.2) and estimator (3.3) coincide with the classical least squares method.
4 Asymptotic normality and forecasting
In this section, we discuss the properties of the estimator. In order to obtain these properties, we need the following assumptions:
(A1) \{({\epsilon}_{t},{\theta}_{t}^{l},{\theta}_{t}^{r}):t=1,2,\dots \} is a sequence of independent and identically distributed random vectors.
(A2) E[{\epsilon}_{t}]=0, E[{\theta}_{t}^{l}]=E[{\theta}_{t}^{r}].
(A3) Var[{\epsilon}_{t}]+Var[{\theta}_{t}^{r}]+Var[{\theta}_{t}^{l}]<\mathrm{\infty}.
The following two lemmas are given by Diananda [18].
Lemma 4.1 Let {y}_{1},{y}_{2},\dots , be a sequence of random variables such that the distribution of ({y}_{t+{t}_{1}},{y}_{t+{t}_{2}},\dots ,{y}_{t+{t}_{n}}) is independent of t for every 0\le {t}_{1}<{t}_{2}<\cdots <{t}_{n} and n and such that this collection is independent of ({y}_{s+{s}_{1}},{y}_{s+{s}_{2}},\dots ,{y}_{s+{s}_{p}}) for every 0\le {s}_{1}<{s}_{2}<\cdots <{s}_{p} and p if s>t+{t}_{n}+m. Assume E{y}_{t}=0, E{y}_{t}^{2}<\mathrm{\infty}, where p and m are positive integers. Then {\sum}_{t=1}^{T}{y}_{t}/\sqrt{T} has a limiting normal distribution with mean 0 and variance E{y}_{1}^{2}+2E{y}_{1}{y}_{2}+\cdots +2E{y}_{1}{y}_{m+1}.
Lemma 4.2 Suppose that \{{H}_{T}\}, \{{Z}_{T,S}\}, \{{X}_{T,S}\} are sequences of random variables. Let {H}_{T}={Z}_{T,S}+{X}_{T,S}, T=1,2,\dots , S=1,2,\dots such that E{X}_{T,S}^{2}\le {M}_{S}, {lim}_{S\to \mathrm{\infty}}{M}_{S}=0, P\{{Z}_{T,S}\le z\}={F}_{T,S}(z)\to {F}_{S}(z), as T\to \mathrm{\infty}, {lim}_{S\to \mathrm{\infty}}{F}_{S}(z)=F(z) at every continuity point. Then {lim}_{T\to \mathrm{\infty}}P\{{H}_{T}\le z\}=F(z) at every continuity point of F(z).
Now, we state our main results in the following theorems.
Theorem 4.1 Under the conditions of (A1)(A3), let {M}_{T}={\sum}_{t=1}^{T}{W}_{t}{W}_{t1}\alpha {\sum}_{t=1}^{T}{W}_{t1}^{2}. Then {M}_{T}/\sqrt{T}\stackrel{L}{\to}N(0,{\sigma}^{4}/(1{\alpha}^{2})), as T\to \mathrm{\infty}, where {\sigma}^{2}=Var[{\epsilon}_{t}+({\theta}_{t}^{r}{\theta}_{t}^{l})/3], the notation \stackrel{L}{\to} stands for convergence in distribution.
Theorem 4.2 Under the conditions of (A1)(A3), let {B}_{T}={\sum}_{t=1}^{T}{W}_{t1}^{2}. Then {B}_{T}/T\stackrel{p}{\to}{\sigma}^{2}/(1{\alpha}^{2}), as T\to \mathrm{\infty}, where {\sigma}^{2}=Var[{\epsilon}_{t}+({\theta}_{t}^{r}{\theta}_{t}^{l})/3], where the notation \stackrel{p}{\to} stands for convergence in probability.
Theorem 4.3 Under the conditions of (A1)(A3), we have \sqrt{T}(\stackrel{\u02c6}{\alpha}\alpha )\stackrel{L}{\to}N(0,1{\alpha}^{2}) as T\to \mathrm{\infty}.
Suppose that we have observations \{{X}_{t},t=0,1,\dots ,T\} from model (1.1). Based on the estimator of \stackrel{\u02c6}{\alpha}, we can obtain the following forecasting procedure:

1.
Onestep forecasting: {\stackrel{\u02c6}{X}}_{T+1}=\stackrel{\u02c6}{\alpha}{X}_{T};

2.
Twostep forecasting: {\stackrel{\u02c6}{X}}_{T+2}=\stackrel{\u02c6}{\alpha}{X}_{T+1};

3.
nstep forecasting: {\stackrel{\u02c6}{X}}_{T+n}=\stackrel{\u02c6}{\alpha}{X}_{T+n1}.
5 Proofs of the theorems
In this section, we give the proofs of the theorems.
Proof of Theorem 4.1 By (3.1) we have
Note that for all \alpha <1,
Let {u}_{t}={\epsilon}_{t}+({\theta}_{t}^{r}{\theta}_{t}^{l})/3, then
This means that
Because the last term has mean 0 and variance {W}_{0}^{2}{\sigma}^{2}(1{\alpha}^{2T})/(1{\alpha}^{2}), using Chebyshev’s inequality, we have
Let
Since {H}_{T} is a linear combination of terms {u}_{t}{u}_{s} (t\ne s), and each term is uncorrelated with other terms, we have
In what follows, we prove that
Further, let
Note that {Z}_{T,S}^{\ast} and {Z}_{T,S} have the same limiting distribution as T\to \mathrm{\infty}. Next, we show that
Now, let
Then
Thus, combining Lemma 4.1, we prove (5.5). The theorem follows from (5.1)(5.5) and Lemma 4.2. □
Proof of Theorem 4.2
Note that
It is easy to see that
Because E({B}_{{T}_{3}}/T)=0 and E{({B}_{{T}_{3}}/T)}^{2}\le 4{W}_{0}^{2}{\sigma}^{2}{\alpha}^{2}/(T{(1{\alpha}^{2})}^{2}), we have
Further, from
similarly, we get
Lastly, we will show that {B}_{{T}_{1}}/T\stackrel{p}{\to}{\sigma}^{2}/(1{\alpha}^{2}). Observe that
Since this is a nonnegative random variable with expected value
using Markov’s inequality, we have
Further, by the law of large numbers, we get
Then it holds that
This, together with (5.6)(5.9), completes the proof. □
Proof of Theorem 4.3
Note that
With the application of Slusky’s theorem and Theorems 4.1 and 4.2, we prove Theorem 4.3. □
6 Simulation results
In this section, we conduct some simulations to show the finite performance of the proposed method. The simulation uses the fuzzy autoregressive model (1.1).
In the first simulation, we evaluate the finite sample performance of \stackrel{\u02c6}{\alpha}. The modes and spreads of fuzzy random errors {\mathrm{\Phi}}_{t} are chosen as random samples from normal and uniform distributions, N(0,1), U[0,0.5], respectively. To assess the sensitivity of the estimates to sample size and parameter, simulations are conducted for different parameter values and sample sizes. In different simulations, we set α equal to −0.8, −0.6, −0.4, −0.2, 0.2, 0.4, 0.6, and 0.8, respectively. Moreover, the sample sizes used are 50, 100, 300, and 500. For a particular sample size, 1,000 different sets of data were generated. For each data set, we estimate the parameter α by the proposed estimator in (3.3) and report the average estimates and average mean squared error (MMSE) over 1000 simulations. The results are presented in Table 1.
From Table 1, we see that the estimation procedure works very well. For different sample sizes and different parameters, the average mean squared errors of \stackrel{\u02c6}{\alpha} are very small, and the average mean squared error of \stackrel{\u02c6}{\alpha} decreases as sample size increases. Furthermore, we also find that for the same sample size, the average mean squared error of \stackrel{\u02c6}{\alpha} decreases as the absolute value of the parameter becomes large.
In the second simulation, we illustrate the performance of the forecast procedure proposed above. We compare model (1.1) with the ordinary autoregressive model {X}_{t}=\alpha {X}_{t1}+{\epsilon}_{t}, where {\epsilon}_{t} is error sequence.
Firstly, we produce 50 samples {X}_{1},{X}_{2},\dots ,{X}_{50} of model (1.1). Then by using the first 30 samples {X}_{1},{X}_{2},\dots ,{X}_{30}, we can obtain the estimator \stackrel{\u02c6}{\alpha}. We forecast {X}_{31},{X}_{2},\dots ,{X}_{50}. The modes and spreads of the fuzzy random errors {\mathrm{\Phi}}_{t} are chosen as random samples from normal and uniform distributions, N(0,4), U[0,5], respectively. For the ordinary autoregressive model, we only forecast modal values based on the above fuzzy data. We compare the square sum of the forecast error (SSFE) of modal values. The results are presented in Table 2, and the figures in parentheses are those for model (1.1). From Table 2, we can see that model (1.1) has less forecast error than the ordinary autoregressive model.
7 Conclusions
In this paper, we introduce a new fuzzy autoregressive model. The model can be considered as an extension of the standard autoregressive model since crisp values can be treated as degenerated fuzzy numbers. Least squares estimation is derived, and the asymptotic distribution of the proposed estimator is established. This estimation procedure is well defined because if we use crisp data instead of fuzzy observations, then our estimation reduces to the classical estimation. The simulation results indicate that the least squares estimation performs very well.
It should be noted that we here discuss the firstorder autoregressive model with triangular fuzzy data. Further research needs to be undertaken to discover the analogous results for other models, such as the unstable firstorder autoregressive model or highorder autoregressive model, with more complicated metrics and/or other types of fuzzy data. It is also interesting to consider the problem of testing hypotheses about the parameters in these models.
References
Song Q, Chissom BS: Fuzzy time series and its models. Fuzzy Sets Syst. 1993, 54: 269–277. 10.1016/01650114(93)90372O
Song Q, Chissom BS: Forecasting enrollments with fuzzy time series  part I. Fuzzy Sets Syst. 1993, 54: 1–9. 10.1016/01650114(93)90355L
Song Q, Chissom BS: Forecasting enrollments with fuzzy time series  part II. Fuzzy Sets Syst. 1994, 62: 1–8. 10.1016/01650114(94)900671
Chen SM: Forecasting enrollments based on fuzzy time series. Fuzzy Sets Syst. 1996, 81: 311–319. 10.1016/01650114(95)002200
Hwang JR, Chen SM, Lee CH: Handling forecasting problems using fuzzy time series. Fuzzy Sets Syst. 1998, 100: 217–228. 10.1016/S01650114(97)001218
Sullivan J, Woodall WH: A comparison of fuzzy forecasting and Markov modeling. Fuzzy Sets Syst. 1994, 64: 279–293. 10.1016/01650114(94)90152X
Chen SM, Hwang JR: Temperature prediction using fuzzy time series. IEEE Trans. Syst. Man Cybern., Part B, Cybern. 2000, 30: 263–275. 10.1109/3477.836375
Huarng K: Heuristic models of fuzzy time series for forecasting. Fuzzy Sets Syst. 2001, 123: 369–386. 10.1016/S01650114(00)000932
Huarng K, Yu HK: A Type 2 fuzzy time series model for stock index forecasting. Phys. A, Stat. Mech. Appl. 2005, 353: 445–462.
Huarng K, Yu HK: The application of neural networks to forecast fuzzy time series. Phys. A, Stat. Mech. Appl. 2006, 363: 481–491. 10.1016/j.physa.2005.08.014
Yu HK: A refined fuzzy timeseries model for forecasting. Phys. A, Stat. Mech. Appl. 2005, 346: 657–681. 10.1016/j.physa.2004.07.024
Yu HK: Weighted fuzzy time series models for TAIEX forecasting. Phys. A, Stat. Mech. Appl. 2005, 349: 609–624. 10.1016/j.physa.2004.11.006
Ozawa K, Watanabe T, Kanke M: Fuzzy autoregressive model and its applications. 1997 First International Conference on KnowledgeBased Intelligent Electronic Systems 1997, 112–117.
Niimura T, Ko HS, Ozawa K: A dayahead electricity price prediction based on a fuzzyneuro autoregressive model in a deregulated electricity market. 2. Proceedings of the 2002 International Joint Conference on Neural Networks 2002, 1362–1366.
Kim HK, Yoon JH, Li Y: Asymptotic properties of least squares estimation with fuzzy observations. Inf. Sci. 2008, 178: 439–451. 10.1016/j.ins.2007.07.010
Zadeh LA, Klir GJ, Yuan B: Fuzzy Sets, Fuzzy Logic, and Fuzzy Systems: Selected Papers. World Scientific, Singapore; 1996.
Diamond P: Fuzzy least squares. Inf. Sci. 1998, 46: 141–157.
Diananda PH: Some probability limit theorems with statistical applications. Proc. Camb. Philos. Soc. 1953, 49: 239–246. 10.1017/S0305004100028334
Acknowledgements
This work is supported by the Science and Technology Development Program of Jilin Province (201201082).
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
The first author, who is a PhD, and the second author jointly worked on deriving the results. Both authors read and approved the final manuscript.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Zhao, ZW., Peng, CX. Asymptotic properties of least squares estimation for a new fuzzy autoregressive model. J Inequal Appl 2013, 56 (2013). https://doi.org/10.1186/1029242X201356
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/1029242X201356
Keywords
 fuzzy random variables
 fuzzy numbers
 fuzzy least squares estimation
 fuzzy autoregressive model
 fuzzy set