- Research
- Open Access
- Published:
Local limit theorems without assuming finite third moment
Journal of Inequalities and Applications volume 2023, Article number: 21 (2023)
Abstract
One of the most fundamental probabilities is the probability at a particular point. The local limit theorem is the well-known theorem that estimates this probability. In this paper, we estimate this probability by the density function of normal distribution in the case of lattice integer-valued random variables. Our technique is the characteristic function method. We complete to relax the third moment condition of Siripraparat and Neammanee (J. Inequal. Appl. 2021:57, 2021) and the references therein and also obtain explicit constants of the error bound.
1 Introduction and main results
Let X be an integer-valued random variable. One of the most fundamental probabilities is the probability at a particular point, i.e., \(P(X = k)\) for some \(k\in \mathbb{Z}\). The local limit theorem is one of the theorems that estimate this probability and describe how \(P(X=k)\) approaches the normal density, \(\frac {1}{\sigma \sqrt{2\pi}}e^{-\frac{(k-\mu )^{2}}{2\sigma ^{2}}}\) where μ and \(\sigma ^{2}\) are mean and variance of X, respectively. There are two well-known techniques for deriving this theorem: the method of characteristic function and the Bernoulli part extraction method. The characteristic function method is to estimate the bound for the characteristic function of a random variable. This method has been used in a number of studies such as in the case of bounded random variables (see [3–6], and [7] for examples) and in the case of lattice random variables (see [7–9], and [10] for examples).
Let \(X_{1},X_{2},\ldots , X_{n}\) be independent integer-valued random variables with mean \(\mu _{j}\) and variance \(\sigma _{j}^{2}\) for all \(j=1,2,\ldots ,n\). Then let
If \(P(X_{j}=1)=p_{j}=1-P(X_{j}=0)\), then \(X_{j}\) is called a Bernoulli random variable with parameter \(p_{j}\) and \(S_{n}\) is said to be a Poisson binomial random variable. In addition, when we provide \(p_{1} = p_{2} = \cdots = p_{n} = p \), we call \(S_{n}\) a binomial random variable with parameters n and p and use the notation \(S_{n}\sim B(n,p)\). The first local limit theorem was proved by De Moivre and Laplace ([11], 1754) for a binomial random variable. We call X a lattice random variable with parameter \((a,d)\) if its values belong to \(\mathcal{L}(a,d) = \{ a + md : m \in \mathbb{Z} \}\), where a and \(d>0\) are integers. In addition, d is said to be maximal if there are no other numbers \(a'\) and \(d' > d\) for which \(P(X\in \mathcal{L}(a',d')) = 1\), and we call X a maximal lattice random variable with parameter \((a,d)\). Observe that the Bernoulli random variable is a maximal lattice random variable with parameter \((0,1)\). In the case that \(X_{j}\)s are common lattice \(\mathcal{L}(a,d)\) and identically distributed, Ibragimov and Linnik [12] gave the rate of convergence \(O ( \frac {1}{n^{\frac{1}{2}+\alpha}} )\), where \(0 < \alpha < \frac{1}{2}\) in 1971. For further information, they showed that if d is maximal and
where F the distribution function of \(X_{1}\), then
A few years later, Petrov [13] proved that if \(E|X_{1}|^{3} < \infty \), then (1.1) holds with \(\alpha = \frac{1}{2}\). Moreover, for the case that \(X_{j}\)s are nonidentically distributed lattice random variables with parameter \((0,1)\) that satisfy the third moment condition and some properties, Petrov [13] gave the following result:
The previous studies had not given explicit constants of the error bound until Korolev and Zhukov ([14], 2000). In 2017, Giuliano and Weber [15] used the Bernoulli part extraction method to give an error bound with explicit constants in the case of nonidentically distributed square integrable random variables taking values in a common lattice \(\mathcal{L}(a,d)\). By assuming finite third moment, Siripraparat and Neammanee [1] used the characteristic function technique to illustrate the rate of convergence to \(O ( \frac {1}{\sigma ^{2}} )\) in 2021. For a special case, one can see [2] and [16] in the case of Poisson binomial and binomial, respectively.
In this paper, we relax the third moment condition to find the local limit theorems for sums of independent lattice integer-valued random variables and also give explicit constants of the error bound. Our technique is the characteristic function method inspired by Petrov [13] and Siripraparat and Neammanee [1]. Throughout this paper, let \(X_{1},X_{2},\ldots ,X_{n}\) be independent common lattice random variables with parameter \((a,d)\) such that \(E|X_{j}|^{2+\alpha} < \infty \), where \(0<\alpha < 1\), for \(j=1,2,\ldots ,n\), and let \(S_{n} = \sum_{j=1}^{n}X_{j}\) with mean μ and variance \(\sigma ^{2}\). The following are our main results.
Theorem 1.1
Let \(\beta = \sum_{j=1}^{n}\beta _{j}\), where \(\beta _{j} = 2\sum_{m=-\infty}^{\infty} p_{jm}p_{j(m+1)}\) and \(p_{jm} = P(X_{j}= a+md)\). If \(\beta >0\) and \(\sigma ^{2}>d^{2}\), then
where \(\tau = \frac{d}{3^{\frac{1}{\alpha}} (\sum_{j=1}^{n}E|X_{j}-a|^{2+\alpha} )^{\frac{1}{2+\alpha}}}\).
Furthermore, if \(X_{1},X_{2},\ldots ,X_{n}\) are identically distributed and \(\beta _{1} >0\), then
where
We note that \(\beta _{j} > 0\) if \(X_{j}\) is a maximal lattice random variable. So, we can apply this result when d is maximal.
Theorem 1.2
Let \(\upsilon := \min_{1\leq j \leq n}\upsilon _{j}\), where \(\upsilon _{j} = 2\sum_{m=-\infty}^{\infty}p_{jm}p_{j(m+j)}\). If \(\upsilon _{j} > 0\) for all \(j=1,2,\ldots ,n\) and \(\sigma ^{2}>d^{2}\), then
where \(\tau = \frac{d}{3^{\frac{1}{\alpha}} (\sum_{j=1}^{n}E|X_{j}-a|^{2+\alpha} )^{\frac{1}{2+\alpha}}}\).
Furthermore, if \(X_{1},X_{2},\ldots ,X_{n}\) are identically distributed and \(\upsilon _{j} > 0\) for all \(j=1,2,\ldots ,n\), then for \(n\geq ( \frac{2\pi \cdot 3^{\frac{1}{\alpha}}(E|X_{1}-a|^{2+\alpha})^{\frac{1}{2+\alpha}}}{d} )^{\frac{2+\alpha}{1+\alpha}}\),
where
We organize this paper as follows: First, we give auxiliary results in Sect. 2 that will be used to prove the main theorems in Sect. 3. Finally, we give some examples in Sect. 4.
2 Auxiliary results
In the following lemmas, we use an idea from [17] to give bounds of a characteristic function to prove Theorem 1.1.
Lemma 2.1
Let X be any integer-valued random variable with mean \(\mu _{X}\), variance \(\sigma _{X}^{2}\), and characteristic function \(\psi _{X}\). If \(E|X|^{2+\alpha} < \infty \) for some \(0 < \alpha < 1\), then there exists a function \(g_{X}\) such that, for all \(|t|\leq (\frac{1}{3E|X|^{\alpha}} )^{\frac{1}{\alpha}}\),
- \((i)\):
-
\(|\psi _{X}(t)| \geq \frac{1}{3}\) and
- \((\mathit{ii})\):
-
\(\psi _{X}(t) = \exp \{i\mu _{X} t - \frac{1}{2}\sigma _{X}^{2}t^{2} + \int _{0}^{t}\frac{g_{X}(s)}{\psi _{X}(s)}\,\mathrm{d}s \}\) and \(\int _{0}^{t} | \frac{g_{X}(s)}{\psi _{X}(s)} |\,\mathrm{d}s \leq 9E|X|^{2+\alpha}|t|^{2+\alpha}\).
Proof
\((i)\) Using the fact that for \(x\in \mathbb{R}\), \(e^{ix} = 1 + 2^{1-\alpha}|x|^{\alpha}\Theta \) for some complex function Θ such that \(|\Theta | \leq 1\) ([17], p. 359), we get that
where \(\Theta _{1}\) is a complex random variable such that \(|\Theta _{1}| \leq 1\). From this fact and the inequality \(|z_{1} +z_{2}| \geq |z_{1}|-|z_{2}|\) for complex numbers \(z_{1}\) and \(z_{2}\), we can see that
Then, for all \(|t|\leq (\frac{1}{3E|X|^{\alpha}} )^{\frac{1}{\alpha}} \), we have \(|\psi _{X}(t)| = |Ee^{itX}| \geq \frac{1}{3}\).
\((\mathit{ii})\) Let \(t\in \mathbb{R}\) be such that \(|t| \leq (\frac{1}{3E|X|^{\alpha}} )^{\frac{1}{\alpha}}\). Since \(\psi _{X}(t) = Ee^{itX}\), we obtain \(\psi _{X}'(t) = iE(Xe^{itX}) \), which implies that
where
Hence
and then
that is,
From the fact that for \(x\in \mathbb{R}\), \(e^{ix} = 1 + ix + \frac{2^{1-\alpha}}{1+\alpha}|x|^{1+\alpha}\Theta \) for some complex function Θ such that \(|\Theta | \leq 1\) ([17], p. 359), we have that
where \(\Theta _{2}\) is a complex random variable such that \(|\Theta _{2}| \leq 1\). From (2.1)–(2.3), we have
According to Lyapunov’s inequality: \((E|X|^{r})^{\frac{1}{r}} \leq (E|X|^{s})^{\frac{1}{s}}\), where \(0 < r \leq s\), we have that \(E|X| \leq (E|X|^{2+\alpha})^{\frac{1}{2+\alpha}}\) and \(E|X|^{1+\alpha} \leq (E|X|^{2+\alpha})^{\frac{1+\alpha}{2+\alpha}}\), which imply that
We can use the same technique to show that
From these facts and (2.4), we have
Hence we can conclude from \((i)\) and (2.5) that for all \(|t|\leq (\frac{1}{3E|X|^{\alpha}} )^{\frac{1}{\alpha}} \) we have
which implies that
□
Lemma 2.2
Let \(\tau = \frac{1}{3^{\frac{1}{\alpha}}} ( \frac{1}{\sum_{j=1}^{n}E|X_{j}|^{2+\alpha}} )^{ \frac{1}{2+\alpha}}\). Then
for all \(|t|\leq \tau \).
Proof
From Lyapunov’s inequality, we have
which implies that
for all \(l=1,2,\ldots ,n\). This provides that
for all \(l=1,2,\ldots ,n\). From this fact and Lemma 2.1, we have for all \(|t| \leq \tau \),
where
From (2.6) and the inequality \(|e^{z} - 1| \leq |z|e^{|z|}\) for a complex number z, we get that for all \(|t|\leq \tau \),
□
3 Proof of the main results
3.1 Proof of Theorem 1.1
Proof
First, we will prove the theorem in the case of \(a=0\) and \(d=1\). Let \(Y_{1},Y_{2},\ldots ,Y_{n}\) be independent common lattice random variables with parameter \((0,1)\), and let
with \(E(W_{n})=\mu _{W}\), \(Var(W_{n})=\sigma _{W}^{2}\) and the characteristic function \(\psi _{W}\). Suppose that \(\beta _{Y_{j}} = 2\sum_{m=-\infty}^{\infty}P(Y_{j} = m)P(Y_{j} =m+1) > 0\) for all \(j=1,2,\ldots ,n\), and let \(\tau = \frac{1}{3^{\frac{1}{\alpha}}} ( \frac{1}{\sum_{j=1}^{n}E|Y_{j}|^{2+\alpha}} )^{ \frac{1}{2+\alpha}}\). Since \(P(W_{n} = k) = \frac{1}{2\pi}\int _{-\pi}^{\pi} e^{-ikt} \psi _{W}(t) \,\mathrm{d}t\) ([18], p. 511), we have
From Lemma 2.2, we have
To bound \(\int _{0}^{\tau} |t|^{2+\alpha}e^{ - \frac{1}{2}\sigma _{ W}^{2}t^{2}} \,\mathrm{d}t\), we let \(\tilde{\tau} = \tau ^{\frac{2+\alpha}{2}}\) and note that
and
Hence,
By the fact that
we have
and hence,
Using the fact that \(|\psi _{W}(t)| \leq e^{-\frac{1}{\pi ^{2}}\beta _{ W}t^{2}}\), where \(\beta _{W} = \sum_{j=1}^{n}\beta _{ Y_{j}}\), for \(t\in [0,\pi )\) ([1], p. 5), we have
In general, let \(X_{1},X_{2},\ldots ,X_{n}\) be independent lattice random variables with parameter \((a,d)\). For \(j=1,2,\ldots ,n\), let \(Y_{j} = \frac{X_{j}-a}{d}\) and \(W_{n} = Y_{1} + Y_{2} + \cdots + Y_{n}\). Observe that \(Y_{1},Y_{2},\ldots ,Y_{n}\) are independent common lattice random variables with parameter \((0,1)\) and
From this fact and the fact that
we have the conclusion of the theorem.
Furthermore, if \(X_{1},X_{2},\ldots ,X_{n}\) are identically distributed, then
which imply that
Since \(\frac{1+2\alpha}{2+\alpha} \geq \frac{1+\alpha}{2}\) and \(e^{-x} \leq \frac{1}{x}\) for a real number \(x>0\), we obtain that
and
where
□
3.2 Proof of Theorem 1.2
Proof
By the same reason of Theorem 1.1, it suffices to prove the theorem in case \(a=0\) and \(d=1\). Let \(Y_{1},Y_{2},\ldots ,Y_{n}\) be independent common lattice random variables with parameter \((0,1)\) with the characteristic functions \(\psi _{Y_{j}}\), and let
with \(E(W_{n})=\mu _{W}\), \(Var(W_{n})=\sigma _{W}^{2}\) and the characteristic function \(\psi _{W}\). Suppose that \(\upsilon _{Y_{j}} = 2\sum_{m=-\infty}^{ \infty}P(Y_{j} = m)P(Y_{j} =m+j) > 0\) for all \(j=1,2\ldots ,n\). From (3.1)–(3.2) in Theorem 1.1, we have
Siripraparat and Neammanee ([1], p. 6) showed that
From this fact and the fact that
for \(|t|\leq \pi \) and \(n\geq 2\) ([19], p. 399), we have
where \(\upsilon _{W} = \min_{1\leq j \leq n} \upsilon _{Y_{j}}\). Hence,
Furthermore, if \(X_{1},X_{2},\ldots ,X_{n}\) are identically distributed and \(\upsilon _{j} > 0\) for all \(j=1,2,\ldots ,n\), then
From (3.8) and \(n\geq ( \frac{2\pi \cdot 3^{\frac{1}{\alpha}}(E|X_{1}-a|^{2+\alpha})^{\frac{1}{2+\alpha}}}{d} )^{\frac{2+\alpha}{1+\alpha}}\), we obtain that
where
□
4 Examples
In our work, we relax the condition third moment to almost the second moment. The following example shows that there is an integer-valued random variable where the third moment does not exist but the aim moment exists.
Example 4.1
For \(j=1,2,\ldots ,n\), let
and assume that \(X_{1},X_{2},\ldots ,X_{n}\) are independent. Note that \(X_{1},X_{2},\ldots ,X_{n}\) are maximal lattice random variables with parameter \((0,2)\) and \(\mu _{j} = 1.3667\), \(\sigma _{j}^{2} = 2.7322\), \(\beta _{j}= 0.2025\),
and for \(\alpha \in (0,1)\),
for all \(j=1,2,\ldots ,n\). Let
By Theorem 1.1, we have
and Table 1.
Observe that we cannot apply Theorem 1.2 with Example 4.1 since \(\upsilon _{j} = 0 \) for some \(j \geq 3\).
Example 4.2
Let \(X_{1},X_{2},\ldots ,X_{n}\) be independent random variables defined by
for integer \(k\geq 2\). We see that \(X_{1},X_{2},\ldots ,X_{n}\) are common lattice random variables with parameter \((0,2)\) and
This implies that
Moreover, we have that
Let
By Theorem 1.1, we have
and Table 2.
Observe that we cannot apply Theorem 1.1 with Example 4.2 since \(\beta _{j} = 0 \) for \(j \geq 2\).
Availability of data and materials
Not applicable.
References
Siripraparat, T., Neammanee, K.: An improvement of convergence rate in the local limit theorem for integral-valued random variables. J. Inequal. Appl. 2021, 57, 1–18 (2021)
Siripraparat, T., Neammanee, K.: A local limit theorem for Poisson binomial random variables. ScienceAsia 47, 111–116 (2021)
Doob, J.L.: Stochastic Processes. Wiley, New York (1953)
Prokhorov, Y.V., Rozanov, Y.A.: Probability Theory [in Russian]. Nauka, Moscow (1973)
Statulyavichus, V.A.: Limit theorems for densities and asymptotic decompositions for distributions of sums of independent random variables. Theory Probab. Appl. 10(4), 582–595 (1965)
Ushakov, N.: Lower and upper bounds for characteristic functions. J. Math. Sci. 84, 1179–1189 (1997)
Ushakov, N.G.: Selected Topics in Characteristic Functions. VSP, Utrecht (1999)
Benedicks, M.: An estimate of the modulus of the characteristic function of a lattice distribution with application to remainder term estimates in local limit theorems. Ann. Probab. 3, 162–165 (1975)
Zhang, Z.: An upper bound for characteristic functions of lattice distributions with applications to survival probabilities of quantum states. J. Phys. A, Math. Theor. 40(1), 131–137 (2007)
Zhang, Z.: Bound for characteristic functions and Laplace transforms of probability distributions. Theory Probab. Appl. 56(2), 350–358 (2012)
McDonald, D.R.: The local limit theorem: a historical perspective. J. Iran. Stat. Soc. 4(2), 73–86 (2005)
Ibragimov, I.A., Linnik, I.V., Kingman, J.F.C.: Independent and Stationary Sequences of Random Variables. Wolters-Noordhoff, Groningen (1971)
Petrov, V.V.: Sums of Independent Random Variables. Springer, Berlin (1975)
Korolev, V., Zhukov, Y.V.: Convergence rate estimates in local limit theorems for Poisson random sums. Ann. Inst. Henri Poincaré 99(4), 1439–1444 (2000)
Giuliano, R., Weber, M.J.G.: Approximate local limit theorems with effective rate and application to random walks in random scenery. Bernoulli 23(4B), 3268–3310 (2017)
Zolotukhin, A.Y., Nagaev, S., Chebotarev, V.: On a bound of absolute constant in the Berry-Esseen inequality for i.i.d. Bernoulli random variables. Mod. Stoch. Theory Appl. 5(3), 385–410 (2018)
Sunklodas, J.K.: On the approximation of a binomial random sum. Lith. Math. J. 54(3), 356–365 (2014)
Feller, W.: An Introduction to Probability Theory and Its Applications, vol. 2. Wiley, New York (1971)
Freiman, G.A., Pitman, J.: Partitions into distinct large parts. J. Aust. Math. Soc. 57(3), 386–416 (1994)
Acknowledgements
The authors would like to thank the reviewers for their valuable comments and suggestions.
Funding
This work was supported by the Development and Promotion of Science and Technology Talents Project (DPST).
Author information
Authors and Affiliations
Contributions
All authors contributed equally to the writing of this paper. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Kammoo, P., Laipaporn, K. & Neammanee, K. Local limit theorems without assuming finite third moment. J Inequal Appl 2023, 21 (2023). https://doi.org/10.1186/s13660-023-02928-y
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13660-023-02928-y
MSC
- 60F05
Keywords
- Local limit theorem
- Normal density function
- Lattice random variable
- Rate of convergence
- Characteristic function