- Research
- Open access
- Published:
A robust test for mean change in dependent observations
Journal of Inequalities and Applications volume 2015, Article number: 48 (2015)
Abstract
A robust test based on the indicators of the data minus the sample median is proposed to detect the change in the mean of α-mixing stochastic sequences. The asymptotic distribution of the test is established under the null hypothesis that the mean μ remains as a constant. The consistency of the proposed test is also obtained under the alternative hypothesis that μ changes at some unknown time. Simulations demonstrate that the test behaves well for heavy-tailed sequences.
1 Introduction
The problem of a mean change at an unknown location in a sequence of observations has received considerable attention in the literature. For example, Sen and Srivastava [1], Hawkins [2], Worsley [3] proposed tests for a change in the mean of normal series. Yao [4] proposed some estimators of the change point in a sequence of independent variables. For serially correlated data, Bai [5] considered the estimation of the change point in linear processes. Horváth and Kokoszka [6] gave an estimator of the change point in a long-range dependent series.
Most of the existing results in the statistic and econometric literature have concentrated on the case that the innovations are Gaussian. In fact, many economic and financial time series can be very heavy-tailed with infinite variances; see e.g. Mittnik and Rachev [7]. Therefore, the series with infinite-variance innovations aroused a great deal of interest of researchers in statistics, such as Phillips [8], Horváth and Kokoskza [9], Han and Tian [10, 11]. It is more efficient to construct robust procedures for heavy-tailed innovations, such as the M procedures in Hušková [12, 13] and the references therein. De Jong et al. [14] proposed a robust KPSS test based on the ‘sign’ of the data minus the sample median, which behaves rather well for heavy-tailed series. In this paper, we shall construct a robust test for the mean change in a sequence.
The rest of this paper is organized as follows: Section 2 introduces the models and necessary assumptions for the asymptotic properties. Section 3 gives the asymptotic distribution and the consistency of the test proposed in the paper. In Section 4, we shall show the statistical behaviors through simulations. All mathematical proofs are collected in the Appendix.
2 Model and assumptions
In the following, we concentrate ourselves on the model as follows:
where \(k_{0}\) is the change point.
In order to obtain the weak convergence and the convergence rate, \(X(t)\) satisfies the following.
Assumption 1
-
1.
The \(X_{j}\) are strictly stationary random variables, and \(\tilde{\mu}\) is the unique population median of \(\{X_{t}, 1\leq{t}\leq{T}\}\).
-
2.
The \(X_{j}\) are strong (α-) mixing, and for some finite \(r>2\) and \(C>0\), and for some \(\eta>0\), \(\alpha(m)\leq Cm^{-r/(r-2)-\eta}\).
-
3.
\(X_{j}-\tilde{\mu}\) has a continuous density \(f(x)\) in a neighborhood \([-\eta,\eta]\) of 0 for some \(\eta>0\), and \(\inf_{x\in[-\eta,\eta]}f(x)>0\).
-
4.
\(\sigma^{2}\in(0,\infty)\), where \(\sigma^{2}\) is defined as follows:
$$\sigma^{2}=\lim_{T\rightarrow\infty}E \Biggl(T^{-1/2}\sum _{t=1}^{T}\operatorname{sgn}(X_{t}- \tilde{\mu}) \Biggr)^{2}. $$
To derive the CLT of sign-transformed data, we need a kernel estimator, so we make the following assumption on the kernel function.
Assumption 2
-
1.
\(k(\cdot)\) satisfies \(\int_{-\infty}^{\infty}|\psi(\xi)|\,d\xi<\infty\), where
$$\psi(\xi)\,d\xi=(2\pi)^{-1}\int_{-\infty}^{\infty}k(x) \exp(-it\xi)\,dx. $$ -
2.
\(k(x)\) is continuous at all but a finite number of points, \(k(x)=k(-x)\), \(|k(x)|\leq l(x)\) where \(l(x)\) is nondecreasing and \(\int_{0}^{\infty}|l(x)|\,dx\leq\infty\), and \(k(0)=1\).
-
3.
\(\gamma_{T}/T\rightarrow0\), and \(\gamma_{T}\rightarrow\infty\) as \(T\rightarrow\infty\).
Remark 1
De Jong et al. [14] test the stationarity of a sequence under Assumption 1. We detect change in the mean of a sequence, so Assumption 1 holds under the null hypothesis and the alternative one. Since there is no moment condition for \(X_{t}\) in Assumption 1, even Cauchy series are allowed. The α-mixing sequences can include many time series, such as autoregressive or heteroscedastic series under some conditions. Assumption 2 allows some choices such as the Bartlett, quadratic spectral, and Parzen kernel functions.
3 Main results
Let \(m_{T}=\operatorname{med}\{Y_{1},\ldots,Y_{T}\}\). Then we transform the data \(Y_{1},\ldots, Y_{T}\) into the indicator data \(\operatorname{sgn}(Y_{t}-m_{T})\), where \(\operatorname{sgn}(x)=1\) if \(x>0\), \(\operatorname{sgn}(x)=-1\) if \(x<0\), \(\operatorname{sgn}(x)=0\) if \(x=0\). Based on these indicator data, De Jong et al. [14] replace \(\hat{\epsilon}_{t}=Y_{t}-\bar{Y}_{T}\) with \(\operatorname{sgn}(Y_{t}-m_{T})\) in the usual KPSS test and their simulations show that the new KPSS test exhibits some robustness for the heavy-tailed series.
The popularly used test to detect a mean change is based on the CUSUM type as follows:
We rewrite \(\Xi_{T}(\tau)\) under \(H_{0}\) as
According to the idea of De Jong et al. [14], replace \(\hat{\epsilon}_{t}=Y_{t}-\bar{Y}_{T}\) with \(\operatorname{sgn}(Y_{t}-m_{T})\) in (3); then we get a robust version of CUSUM as follows:
Then the test statistic proposed in this paper is
Under Assumptions 1, 2, we can obtain two asymptotic results as follows.
Theorem 1
If Assumptions 1, 2 hold, then under the null hypothesis \(H_{0}\), we have
where ‘⟹’ stands for the weak convergence.
Under the alternative hypothesis \(H_{1}\), a change in the mean happens at some time, we denote the time as \([T\tau_{0}]\). Let \(F(\cdot)\) be the common distribution function of \(X_{t}\) and \(\mu^{*}\) be the median of
Then we have the following.
Theorem 2
If Assumptions 1, 2 hold, then under the alternative hypothesis \(H_{1}\), we have
where \(\Delta=F(\mu^{*}-\mu_{1})-F(\mu^{*}-\mu_{2})\).
Remark 2
By Theorem 1, we reject \(H_{0}\) if \(\Gamma_{T}>c_{p}\), where the critic value \(c_{p}\) is the \((1-p)\) quantile of the Kolmogorov-Smirnov distribution. By Theorem 2, \(\Gamma_{T}\) is consistent asymptotically as the sample size \(T\stackrel{P}{\rightarrow}\infty\).
In order to apply the test in (5), we employ the HAC estimator instead of the unknown \(\sigma^{2}\) as
then the following theorem proves two results of the estimator \(\hat{\sigma}_{T}^{2}\) under \(H_{0}\) and \(H_{A}\), respectively.
Theorem 3
(i) Assuming that the conditions of Theorem 1 hold, then we have, as \(T\rightarrow\infty\),
(ii) Assuming that the conditions of Theorem 2 hold, then we have, as \(T\rightarrow\infty\),
where \(\sigma^{2}_{2}\) is defined as follows:
4 Simulation and empirical application
4.1 Simulation
In this section, we present Monte Carlo simulations to investigate the size and the power of the robust CUSUM and the ordinary CUSUM tests. Since a lot of information has been lost during the inference by using the indicator data instead of the original data, so we are concerned whether the indicator CUSUM test is robust to the heavy-tailed sequences; moreover, we may ask: how large is the loss in power in using indicators when the data has a nearly normal distribution? The HAC estimator \(\hat{\sigma}^{2}\) in the robust CUSUM test is a kernel estimator, so it is important to analyze whether the performance is affected by the choice of the kernel function \(k(\cdot)\) and the bandwidth \(\gamma_{T}\).
We consider the model as follows:
\(X_{t}\) is an autoregressive process \(X_{t}=0.5X_{t-1}+e_{t}\), where the \(\{e_{t}\}\) are independent noise generated by the program from JP Nolan. We vary the tail thickness of \(\{e_{t}\}\) by the different characteristic indices \(\alpha=1.97,1.83,1.41,1.14\), respectively. Accordingly the break times are \(\tau_{0}=0.3, 0.5\), respectively. During the simulations, we adopt 1.358 as the asymptotic critical value of \(\sup_{\tau\in{(0,1)}}|W(\tau)-\tau W(1)|\) at 95% for the various sample sizes \(T=300,500, 1{,}000\).
First, we consider the size of the tests. Tables 1 and 2 report the results when \(\sigma^{2}\) are estimated by the Bartlett kernel and the quadratic spectral kernel with the bandwidth \(\gamma_{T}=[4(T/100)^{1/4}]\) and \(\gamma_{T}=[8(T/100)^{1/4}]\), respectively, in \(1{,}000\) repetitions. From Tables 1 and 2, the ordinary CUSUM test based on the Bartlett kernel has better sizes, however, the one based on the quadratic spectral kernel has a severe problem of overrejection, so we can conclude that the choice of the kernel function has higher impact on the sizes of the two CUSUM tests than the selection of the bandwidth. Comparing the two tests based on the Bartlett kernel, the ordinary CUSUM test becomes underrejecting as the tail index α changes from 2 to 1, and the sizes of the robust test are closer to the nominal size 0.05. Furthermore, the size is closer to 0.05 as the sample size T increases, which is consistent with Theorem 1.
Now we shall show the power of the two tests through empirical powers. The empirical powers are calculated based on the rejection numbers of the null hypothesis \(H_{0}\) in \(1{,}000\) repetitions when the alternative hypothesis \(H_{1}\) holds. The results are included in Tables 3, 4, 5, 6. On the basis of Tables 3, 4, 5, 6, we can draw some conclusions. (i) The two CUSUM tests based on the Bartlett kernel and the quadratic spectral kernel become more powerful as the sample size T becomes larger. (ii) As the tail of the innovations gets heavier, the ordinary CUSUM test becomes less powerful, especially, the test hardly works, while the CUSUM test based on indicators is rather robust to the heavy-tailed innovations. (iii) The selection of the bandwidth has lower impact on the powers of the two CUSUM tests.
Finally, we consider the effects of the skewness in the innovations \(\{ e_{t}\}\) on the power of the proposed test through simulations. In order to obtain the results reported in Table 7, we take the \(e(t)\) in the model (12) as chi square distributions with a freedom degree \(n=1,2\mbox{ and }10\), respectively. On the basis of the simulations, the skewness of the innovations affects the powers the two CUSUM test significantly.
4.2 Empirical application
In this section, we take an empirical application on a series of daily stock price of LBC (SHANDONG LUBEI CHEMICAL Co., LTD) in the Shanghai Stocks Exchange. The stock prices in the group are observed from July 1st, 2004 to December 30th, 2005 with samples of 367 observations (as shown in Figure 1) and can be found in http://stock.business.sohu.com. As in Figure 2, the logarithm sequence is seen to exhibit a number of ‘outliers’, which are a manifestation of their heavy-tailed distributions, see Wang et al. [15]; the data can be well fitted by stable sequences.
Fitting a mean and computing the test proposed in this paper \(\Gamma _{1}=4.2123>1.358\), which indicates that a change in mean occurred, and \(\Xi_{T}(k)\) attains its maximum at \(k_{0}=175\) (21st, March, 2004) (as shown in Figure 3). Recall that LBC issued an announcement that its net profits in 2005 would decrease to 50% of that in 2004, in the 3rd Session Board of Directors’ 17th Meeting on March 8th, 2005 (\(k_{1}=166\)). The influence of the bad news was so strong that the stock price fell immediately in the following nine days, the mean of the logarithm return rate has a significant change after \(k_{0}=175\).
5 Concluding remarks
In this paper, we construct a nonparametric test based on the indicators of the data minus the sample median. When there exists no change in the mean of the data, the test has the usual distribution of the sup of the absolute value of a Brownian bridge. As Bai [5] pointed out, it is a difficult task in applications of autoregressive models. First, the order of an autoregressive model is not assumed to be known a priori and has to be estimated. Second, the often-used way to determine the order via the Akaike information criterion (AIC) and the Bayes information criterion (BIC) tends to overestimate its order if a change exists. However, the proposed test does not rely on the precise autoregressive models and the prior knowledge on the tail index α, so the proposed test is more applicable, although there exists a little distortion in its size for dependent sequences.
References
Sen, A, Srivastava, MS: On tests for detecting change in mean. Ann. Stat. 3, 96-103 (1975)
Hawkins, DM: Testing a sequence of observations for a shift in location. J. Am. Stat. Assoc. 72, 180-186 (1977)
Worsley, KJ: On the likelihood ratio test for a shift in locations of normal populations. J. Am. Stat. Assoc. 74, 365-367 (1979)
Yao, YC: Approximating the distribution of the ML estimate of the change point in a sequence of independent random variables. Ann. Stat. 3, 1321-1328 (1987)
Bai, J: Least squares estimation of a shift in linear processes. J. Time Ser. Anal. 15, 453-472 (1991)
Horváth, L, Kokoszka, P: The effect of long-range dependence on change-point estimators. J. Stat. Plan. Inference 64, 57-81 (1997)
Mittnik, S, Rachev, S: Stable Paretian Models in Finance. Wiley, New York (2000)
Phillips, PCB: Time series regression with a unit root and infinite-variance errors. Econom. Theory 6, 44-62 (1990)
Horváth, L, Kokoszka, P: A bootstrap approximation to a unit root test statistics for heavy-tailed observations. Stat. Probab. Lett. 62, 163-173 (2003)
Han, S, Tian, Z: Truncating estimator for the mean change-point in heavy-tailed dependent observations. Commun. Stat., Theory Methods 35, 43-52 (2006)
Han, S, Tian, Z: Bootstrap testing for changes in persistence with heavy-tailed innovations. Commun. Stat., Theory Methods 36, 2289-2299 (2007)
Hušková, M: Tests and estimators for change point problem based on M-statistics. Stat. Decis. 14, 115-136 (1996)
Hušková, M: M-Procedures for detection of changes for dependent observations. Commun. Stat., Simul. Comput. 41, 1032-1050 (2012)
De Jong, RM, Amsler, C, Schimidt, P: A robust version of the kpss test based on indicators. J. Econom. 137, 311-333 (2007)
Wang, JH, Wang, YL, Ke, AM: The stable distributions fitting and testing in stock returns of China. J. Wuhan Univ. Technol. 25, 99-102 (2003)
Kim, J, Pollard, D: Cube root asymptotics. Ann. Stat. 18, 191-219 (1990)
Fan, J, Yao, Q: Nonlinear Time Series: Nonparametric and Parametric Methods. Springer, Berlin (2003)
De Jong, RM, Davidson, J: Consistency of kernel estimators of heteroscedastic and autocorrelated covariance matrices. Econometrica 68, 407-423 (2000)
Acknowledgements
The authors are grateful to the two anonymous referees for their careful reading of the manuscript and many helpful comments which improve the manuscript greatly. We would like to thank Prof. John Nolan who provided the software for generating the stable innovations in Section 4. By financial support this work is supported by the National Natural Science Foundation of China (No. 11226217) and the Postdoctoral Science Special Foundation (Nos. 2012M510772, 2013T60266), which is gratefully acknowledged.
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
All authors contributed equally to the writing of this paper. All authors read and approved the final manuscript.
Appendix: Proofs of main results
Appendix: Proofs of main results
The proof of Theorem 1 is based on the following four lemmas.
Lemma 1
For \(L_{r}\)-bounded strong (α-) mixing random variables \(y_{Tt}\in{R}\), for which the mixing coefficients satisfy \(\alpha(m)\leq{Cm^{-r/(r-2)-\eta}}\) for some \(\eta>0\),
for constants C and \(C'\), where \(\| X\|=(E|X|^{r})^{1/r}\).
This lemma is Lemma 1 in De Jong et al. [14]; it is crucial for the proof of the following lemmas and theorems.
Lemma 2
Let
If the null hypothesis \(H_{0}\) holds, then under Assumption 1, for all \(K,\varepsilon>0\),
Proof
Since the proof is similar to Lemma 2 of De Jong et al. [14], we omit it. □
Lemma 3
Let \(y_{j}(\phi)\) be as in (14), and let
If the null hypothesis \(H_{0}\) holds, then under Assumption 1, for any \(K>0\),
Proof
The proof is similar to Lemma 3 of De Jong et al. [14], so we omit it. □
Lemma 4
If the null hypothesis \(H_{0}\) holds, then under Assumption 1,
Proof
The proof is similar to Lemma 4 of De Jong et al. [14], so we omit it. □
Proof of Theorem 1
According to Lemma 4, we can find a large K so that \(-K\leq T^{1/2}(m_{T}-\mu_{1}-\tilde{\mu})\leq{K}\). Then
where \(\tilde{m}_{T}\) is on the line between \(m_{T}\) and \(\mu+\tilde{\mu}\) and \(\tilde{m}_{T}-\mu_{1}-\tilde{\mu}=o_{P}(1)\) by Lemma 4. Then \(I_{1}=o_{P}(1)\) holds uniformly for all \(\tau\in[0,1]\) by Lemmas 3, 4. By definition, \(I_{2}=\sigma W_{T}(\tau)\). \(I_{3}=\tau\sigma W_{T}(1)+o_{P}(1)\) by Lemma 4. So we have
Noting that \(\vert T^{-1/2}\sum_{j=1}^{T}\operatorname{sgn}(Y_{j}-m_{T})\vert \leq T^{-1/2}\), we have
Based on (20), (21), by the functional central limit theorem,
If we can show \(\hat{\sigma}^{2}\stackrel{P}{\rightarrow}\sigma^{2}\), the proof of Theorem 1 is completed. Under the null hypothesis \(H_{0}\), \(\mu_{1}\) remains as a constant, so we can prove the consistency of \(\hat{\sigma}^{2}\) just as De Jong et al. [14]. □
The proof of Theorem 2 is based on Lemmas 1, 5, 6, 7 as follows.
Lemma 5
If the alternative hypothesis \(H_{1}\) holds and \(k_{0}=[T\tau_{0}]\) is the change point, let \(y_{j}(\phi)\) be as follows:
then under Assumption 1, for all \(K,\varepsilon>0\),
Proof
For \(y_{j}(\phi)\) as in (23), we have
Then for T large enough such that \(KT^{-1/2}\leq\eta\), under the alternative hypothesis \(H_{1}\),
where η stands for different constants at different equations. This establishes equicontinuity of \(I_{11}\) and \(I_{12}\). Similar to (26), we have
Since \(y_{j}(\phi)\) is non-increasing in ϕ,
and the last term has been proved earlier to be equicontinuous. Similarly \(y_{j}(\phi)\) is non-increasing in ϕ, we have
and the last term has been proved earlier to be equicontinuous too. By the triangle inequality, for all \(\varepsilon>0\),
the last term converges to 0 as \(\delta\rightarrow0\) by the equicontinuity of (27). Similarly, we can show
the last term converges to 0 as \(\delta\rightarrow0\) by the equicontinuity of (28) too. Now, we have completed the proof of Lemma 5. □
Lemma 6
If the alternative hypothesis \(H_{1}\) holds, let \(y_{j}(\phi)\) be as in (23), and
then under Assumption 1, for any \(K>0\),
Proof
Just as De Jong et al. [14], we can obtain from Kim and Pollard [16, Theorem 2.1]
through the arguments for the finite-dimensional convergence for each \(\phi\in[-K,K]\) and the stochastic equicontinuity of \(\sup_{\tau\in[0,1]}|G_{T}(\tau,\phi)-EG_{T}(\tau,\phi)|\). For every \(\phi\in[-K,K]\), by Lemma 1, for T large enough such that \(KT^{-1/2}\leq\eta\), we have
where constants \(C, C', C''>0\). Now we have shown the finite-dimensional convergence for each \(\phi\in[-K,K]\). By the triangle inequality,
Now stochastic equicontinuity follows from Lemma 5. □
Lemma 7
If the alternative hypothesis \(H_{1}\) holds, then under Assumption 1,
where \(\mu^{*}\) is defined as the median of (7).
Proof
For T large enough such that \(T\geq{K^{2}\eta^{-2}}\),
which implies that \(\limsup_{T\rightarrow\infty}P(T^{1/2}(m_{T}-\mu^{*})>K)\) can be made arbitrarily small by choosing K large enough under the alternative hypothesis \(H_{1}\). For \(P(T^{1/2}(m_{T}-\mu^{*})<-K)\), a similar result can be derived, which proves that \(m_{T}-\mu^{*}=O_{P}(T^{-1/2})\) under the alternative hypothesis \(H_{1}\). □
Proof of Theorem 2
We just consider the case \(k=[T\tau]\geq k_{0}=[T\tau_{0}]\), the case \(k\leq k_{0}\) can be analyzed similarly. According to Lemma 7, we can find K large enough so that \(-K\leq T^{-1/2}(m_{T}-\mu^{*})\leq{K}\) will happen with arbitrarily large probability. Then
Then \(I_{1}=o_{P}(1)\) by Lemma 6, \(I_{3}=o_{P}(1)\) by (25), with Proposition 2.8 of Fan and Yao [17], we have
Similarly, we can obtain
By the definition of \(\Xi_{T}(\tau)\),
as \(T\rightarrow\infty\), and \(\tau\geq\tau_{0}\), so
□
Proof of Theorem 3
Under the hypothesis \(H_{0}\), there is no shift in the mean, so the proof of (i) is nearly similar to the proof of the consistency of \(\hat{\sigma}_{T}\), so we just gave the details of the proof of (ii).
Noting that for \(y_{j}\) defined in (23),
so
Under the assumption that \(\gamma_{T}\rightarrow\infty\), \(\gamma_{T}/T\rightarrow0\), \(\gamma_{T}^{2}/T\rightarrow0\) as \(T\rightarrow\infty\), for \(y_{j}(\phi)\) defined in (23), by Lemma 7, we have \(b_{Ti}=O_{P}(T^{-1/2})\), then
and that
and
Therefore under Assumption 1 and the alternative hypothesis \(H_{1}\), \(\hat{\sigma}^{2}\) is asymptotically equivalent to
Furthermore,
and \(T^{-1/2}\sum_{t=1}^{T}|a_{Tt}|=o_{P}(1)\) by Lemma 6 under Assumption 1, and the second term is \(O_{P}(1)\) because
Finally,
by the last term is \(o_{P}(1)\) by Lemma 6 and Assumptions 1, 2, so we have shown that \(\hat{\sigma}^{2}\) asymptotically equals
Under Assumptions 1, 2 and the alternative hypothesis \(H_{1}\), \(\{ \operatorname{sgn}(Y_{j}-\mu^{*})\}\) satisfies the assumptions of Theorem 2.1 in De Jong and Davidson [18], so
so the proof of Theorem 2 has been completed. □
Rights and permissions
Open Access This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited.
About this article
Cite this article
Qin, R., Liu, W. A robust test for mean change in dependent observations. J Inequal Appl 2015, 48 (2015). https://doi.org/10.1186/s13660-015-0569-8
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13660-015-0569-8