- Open Access
Asymptotic properties of least squares estimation for a new fuzzy autoregressive model
© Zhao and Peng; licensee Springer 2013
- Received: 27 October 2012
- Accepted: 1 February 2013
- Published: 18 February 2013
In this paper, we extend the standard autoregressive model to the case where the explanatory and response variables are random fuzzy variables. The fuzzy least-squares estimators (FLSE) of the model parameters are derived and their asymptotic properties are established. A simulation is conducted to evaluate our method, and it is found that the proposed method provides a better performance.
AMS Subject Classification:94D05, 62F12.
- fuzzy random variables
- fuzzy numbers
- fuzzy least squares estimation
- fuzzy autoregressive model
- fuzzy set
The time series forecasting investigates the relations on the sequential set of past data measured over time to forecast the future values. The area has been widely studied, and traditional forecasting is frequently conducted by statistical tools like regression analysis, moving average, integrated moving average, and autoregressive integrated moving average.
However, the deficiencies of traditional forecasting methods are that they cannot deal with forecasting problems in which historical data are linguistic values. In order to overcome the drawback of the traditional forecasting methods, in , Song and Chissom proposed the concepts of fuzzy time series to investigate the forecasting problem in which historical data are linguistic values. In  and , they proposed two fuzzy time series models to study the forecasting problems of enrollments of the University of Alabama. Some researchers such as [4, 5], and  have also proposed new fuzzy time series models to improve Song’s model. These fuzzy time series models have been applied to various practical questions such as temperature by Chen & Hwang , the stock index by Huarng , Huarng & Yu [9, 10], and Yu [11, 12]etc.
In particular, Ozawa  proposed a fuzzy auto-regressive (AR) model to forecast the data of living expenditure of workers’ household in Japan, where the identification and the estimation of its model and the model parameters are optimized by the linear programming problem under some conditions. Moreover, Niimura  presented a fuzzy auto-regressive model to estimate uncertain electricity market prices in deregulated industry environment, and parameters are also obtained by solving linear programming problems.
where is a constant triangular fuzzy number, are random fuzzy variables which are expressed by with crisp random variables , , , are the fuzzy random errors, and is unknown regression crisp parameter to be estimated on the basis of fuzzy observations . Obviously, our model is different from the models that are discussed above. Moreover, this paper is devoted to the parameter estimation of the model and sets out the asymptotic properties of the estimation.
The rest of this paper is organized as follows. Section 2 briefly introduces the literature related to fuzzy sets, fuzzy numbers, and triangular fuzzy numbers (TFN), fuzzy time series. In Section 3, a fuzzy least squares estimation is proposed to estimate parameter α. The behaviors of the present estimator are investigated in Section 4, and the proofs of the theorems are given in Section 5. Finally, in Section 6, we deal with the test of the method through simulation studies.
In this section, we introduce some basic definitions regarding fuzzy number and fuzzy time series as well as some basic fuzzy theories.
In 1965, Zadeh  first introduced the concept of a fuzzy set for modeling the vagueness type of uncertainty. A fuzzy set A defined on the universe X is characterized by a membership function such that . The support of A, say , is defined by the set . For any , the crisp set is called the α-cut of .
A is normal, i.e., there exists such that .
is upper semi-continuous.
A is a convex fuzzy set, i.e., for all and .
where and are two triangular fuzzy numbers in .
which is defined by Kim et al. . By using this modified metric, they have obtained the asymptotic theory of least squares estimator in a fuzzy linear regression model.
Based upon the fuzzy set theory, fuzzy time series models have been defined and studied by Song and Chissom . Let () be a subset of in which the universe of fuzzy sets () is defined and let be a collection of (). Then is called a fuzzy time series on ().
It can be seen from the above definition that is a collection of () which are fuzzy sets defined on for a given . The main difference between the traditional time series and the fuzzy time series is that the former has numerical values as its observations, while the latter has fuzzy sets as its observations. One of the application areas of fuzzy time series is the forecasting problems under a fuzzy environment in which no numerical historical data are available but linguistic ones.
The solution of equation (3.2) is termed the fuzzy least squares estimation (FLSE) of α and denoted by .
Note that if observations of model (1.1) are crisp, i.e., , , then equation (3.2) and estimator (3.3) coincide with the classical least squares method.
In this section, we discuss the properties of the estimator. In order to obtain these properties, we need the following assumptions:
(A1) is a sequence of independent and identically distributed random vectors.
(A2) , .
The following two lemmas are given by Diananda .
Lemma 4.1 Let , be a sequence of random variables such that the distribution of is independent of t for every and n and such that this collection is independent of for every and p if . Assume , , where p and m are positive integers. Then has a limiting normal distribution with mean 0 and variance .
Lemma 4.2 Suppose that , , are sequences of random variables. Let , , such that , , , as , at every continuity point. Then at every continuity point of .
Now, we state our main results in the following theorems.
Theorem 4.1 Under the conditions of (A1)-(A3), let . Then , as , where , the notation stands for convergence in distribution.
Theorem 4.2 Under the conditions of (A1)-(A3), let . Then , as , where , where the notation stands for convergence in probability.
Theorem 4.3 Under the conditions of (A1)-(A3), we have as .
One-step forecasting: ;
Two-step forecasting: ;
n-step forecasting: .
In this section, we give the proofs of the theorems.
Thus, combining Lemma 4.1, we prove (5.5). The theorem follows from (5.1)-(5.5) and Lemma 4.2. □
Proof of Theorem 4.2
This, together with (5.6)-(5.9), completes the proof. □
Proof of Theorem 4.3
With the application of Slusky’s theorem and Theorems 4.1 and 4.2, we prove Theorem 4.3. □
In this section, we conduct some simulations to show the finite performance of the proposed method. The simulation uses the fuzzy autoregressive model (1.1).
Average estimates and average mean squared errors
7.4056 × 10−4
7.3562 × 10−4
From Table 1, we see that the estimation procedure works very well. For different sample sizes and different parameters, the average mean squared errors of are very small, and the average mean squared error of decreases as sample size increases. Furthermore, we also find that for the same sample size, the average mean squared error of decreases as the absolute value of the parameter becomes large.
In the second simulation, we illustrate the performance of the forecast procedure proposed above. We compare model (1.1) with the ordinary autoregressive model , where is error sequence.
Square sum of the forecast error
In this paper, we introduce a new fuzzy autoregressive model. The model can be considered as an extension of the standard autoregressive model since crisp values can be treated as degenerated fuzzy numbers. Least squares estimation is derived, and the asymptotic distribution of the proposed estimator is established. This estimation procedure is well defined because if we use crisp data instead of fuzzy observations, then our estimation reduces to the classical estimation. The simulation results indicate that the least squares estimation performs very well.
It should be noted that we here discuss the first-order autoregressive model with triangular fuzzy data. Further research needs to be undertaken to discover the analogous results for other models, such as the unstable first-order autoregressive model or high-order autoregressive model, with more complicated metrics and/or other types of fuzzy data. It is also interesting to consider the problem of testing hypotheses about the parameters in these models.
This work is supported by the Science and Technology Development Program of Jilin Province (201201082).
- Song Q, Chissom BS: Fuzzy time series and its models. Fuzzy Sets Syst. 1993, 54: 269–277. 10.1016/0165-0114(93)90372-OMathSciNetView ArticleGoogle Scholar
- Song Q, Chissom BS: Forecasting enrollments with fuzzy time series - part I. Fuzzy Sets Syst. 1993, 54: 1–9. 10.1016/0165-0114(93)90355-LMathSciNetView ArticleGoogle Scholar
- Song Q, Chissom BS: Forecasting enrollments with fuzzy time series - part II. Fuzzy Sets Syst. 1994, 62: 1–8. 10.1016/0165-0114(94)90067-1View ArticleGoogle Scholar
- Chen SM: Forecasting enrollments based on fuzzy time series. Fuzzy Sets Syst. 1996, 81: 311–319. 10.1016/0165-0114(95)00220-0View ArticleGoogle Scholar
- Hwang JR, Chen SM, Lee CH: Handling forecasting problems using fuzzy time series. Fuzzy Sets Syst. 1998, 100: 217–228. 10.1016/S0165-0114(97)00121-8View ArticleGoogle Scholar
- Sullivan J, Woodall WH: A comparison of fuzzy forecasting and Markov modeling. Fuzzy Sets Syst. 1994, 64: 279–293. 10.1016/0165-0114(94)90152-XView ArticleGoogle Scholar
- Chen SM, Hwang JR: Temperature prediction using fuzzy time series. IEEE Trans. Syst. Man Cybern., Part B, Cybern. 2000, 30: 263–275. 10.1109/3477.836375View ArticleGoogle Scholar
- Huarng K: Heuristic models of fuzzy time series for forecasting. Fuzzy Sets Syst. 2001, 123: 369–386. 10.1016/S0165-0114(00)00093-2MathSciNetView ArticleGoogle Scholar
- Huarng K, Yu HK: A Type 2 fuzzy time series model for stock index forecasting. Phys. A, Stat. Mech. Appl. 2005, 353: 445–462.View ArticleGoogle Scholar
- Huarng K, Yu HK: The application of neural networks to forecast fuzzy time series. Phys. A, Stat. Mech. Appl. 2006, 363: 481–491. 10.1016/j.physa.2005.08.014View ArticleGoogle Scholar
- Yu HK: A refined fuzzy time-series model for forecasting. Phys. A, Stat. Mech. Appl. 2005, 346: 657–681. 10.1016/j.physa.2004.07.024View ArticleGoogle Scholar
- Yu HK: Weighted fuzzy time series models for TAIEX forecasting. Phys. A, Stat. Mech. Appl. 2005, 349: 609–624. 10.1016/j.physa.2004.11.006View ArticleGoogle Scholar
- Ozawa K, Watanabe T, Kanke M: Fuzzy autoregressive model and its applications. 1997 First International Conference on Knowledge-Based Intelligent Electronic Systems 1997, 112–117.Google Scholar
- Niimura T, Ko HS, Ozawa K: A day-ahead electricity price prediction based on a fuzzy-neuro autoregressive model in a deregulated electricity market. 2. Proceedings of the 2002 International Joint Conference on Neural Networks 2002, 1362–1366.Google Scholar
- Kim HK, Yoon JH, Li Y: Asymptotic properties of least squares estimation with fuzzy observations. Inf. Sci. 2008, 178: 439–451. 10.1016/j.ins.2007.07.010MathSciNetView ArticleGoogle Scholar
- Zadeh LA, Klir GJ, Yuan B: Fuzzy Sets, Fuzzy Logic, and Fuzzy Systems: Selected Papers. World Scientific, Singapore; 1996.View ArticleGoogle Scholar
- Diamond P: Fuzzy least squares. Inf. Sci. 1998, 46: 141–157.MathSciNetView ArticleGoogle Scholar
- Diananda PH: Some probability limit theorems with statistical applications. Proc. Camb. Philos. Soc. 1953, 49: 239–246. 10.1017/S0305004100028334MathSciNetView ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.